Unicode: Going Down the Rabbit Hole
summary
Covers why Unicode is messy: historical scripts, Han unification tradeoffs, surrogate pairs limiting planes to 1.1 million, and emoji made of joiners and skin‑tone modifiers. Shows practical encodings (UTF‑8, UTF‑16, UTF‑32), points out UTF‑8 at 99% web prevalence and pitfalls when decoding with wrong code page. Describes C++ evolution (char8_t, u8 literals) and the SG16 plan to add a text type in C++23 and advises to normalize at the border and keep text in UTF‑8.
AI-written summary · about
chapters (50)
- 0:00Intro
- 1:55Overview
- 2:33Egyptian Hieroglyphs
- 6:43Latin
- 7:13Japanese
- 8:05Arabic
- 8:58Heroglyph
- 9:39Hiragana
- 10:19Katakana
- 12:26Korea
- 13:21Japan
- 13:54China
- 14:22Simplified Japanese
- 16:37ASCII
- 18:03GB2312
- 18:36NZ
- 19:51Israel
- 20:24Russia
- 20:50Chinese characters
- 21:14Unicode
- 24:48Han Unification
- 25:23What is a Character
- 25:42Are These the Same Character
- 26:37Simplified Chinese vs Traditional Chinese
- 26:55ASCII 2 Remapping
- 27:34Emoji
- 27:48Emoji Movie
- 28:00Emoji Controversy
- 29:10Emoji Accents
- 29:57Variable Length Encoding
- 31:56ASCII characters
- 33:13Encoding with EBC
- 33:55Reading text with the wrong encoding
- 34:28Im going to use the wrong encoding
- 34:45Reverse Emoji Bacon
- 35:06How to display Unicode
- 36:42Has anyone ever abused Unicode
- 37:27Inhiragana
- 37:39Upside Down
- 38:28No Support
- 38:39White String
- 39:19White Characters
- 40:31String literals
- 41:12Simple first 20
- 42:54Future Perfect
- 43:35Text Capable Type
- 44:28When to Convert
- 45:13Internet Usage
- 45:47Conclusion
- 46:27Questions
related talks
01h 24mUnicode: From First Principles to Practical Implementation
45mI ♥ Unicode
56mUnicode - going down the rabbit hole
01h 10mInteresting Characters
54mSTRINGS ATTACHED: FROM ASCII TO 🙊🙈🙉
40mUnicode: The hero or villain?
44mUNICODE + PHP for English Speakers
46mASCII to Unicode, what can possibly go w̵̳̓r̸̡̽ǒ̴̝n̴̬ͣg̶ͤ͜?