UnicodeString Implementations. ESUG 2024, Henrik Sperre Johansen

Talk from ESUG 2024

UnicodeString Implementations

PDF: http://archive.esug.org/ESUG2024/day2/02-Unicode-Henry.pdf

2. Q instantiations

3. Qinstantiations

UnicodeString Implementations

Henrik Sperre Johansen
Developer

iszhiohansenGinsanons com

4. Topics

o Unicode
o Implementations Overview
© Implementation Details

Qinstantiations

5. Unicode

o Character set
Encoding
Normalization
Equality

And more!

0.00 O

Qinstantiations

6. UnicodeString Overview

Pharo UTF-32 Codepoint Squeak v3 Latin 1
: . svenvc/ à
Cuis UTF-8 Codepoint UTF8String Latin 9

" . System
VAST UTF-8 Grapheme Rust / Swift locale

Qinstantiations

7. Equality

o Precomposed vs combining marks
o Multiple combining marks

o Normalized forms
o Case-insensitivity

Qinstantiations

8. Hashing

o Consistent with equality
o Consistent with single-byte strings

PA Pet | om | ue

Pharo stringHash: stringHash: stringHash:
Cuis primitiveStringHash + skip Convert to byteString primitiveStringHash + skip
optimisation Then same as ascii optimisation
VAST StringHash primitive core lo EsString seahash
en same as ascii

Qinstantiations

9. Rendering

o Pharo - FreeType2 library + embedded fonts
o Cuis — VectorCanvas + freetype parser + bundled fonts
o VAST - System rendering

Qinstantiations

10. O instantiations

Questions?

Henrik Sperre Johansen

Developer

igg'iohan sn instant com

Contact

General Inquiry
[email protected]

Sales
[email protected]

VAST Support Portal
vast-
support.instantiations.com

North America, Toll Free
855 476 2558

International
[phone]

ar pau en Ron ne nine Ua See pon Tama Toons
ana nn we pope) ster AN ua Company podia o Lew ns ol paras O)
‘sare ore uso einen purses Vena Des anos Daria nd ran nn ap een