~/talk

ASCII to Unicode, what can possibly go w̵̳̓r̸̡̽ǒ̴̝n̴̬ͣg̶ͤ͜?

Talkat J-Fall 2023 · on Thursday, 2023-11-09· [web-platform]
links:none on file
slides:none on file

Explains how Unicode maps abstract code points into bytes via UTF‑8/16/32, claims Unicode reserves 1.1 million code points and notes Java 20 tracks Unicode 15.0 (15.1 released Sept); shows explicit mismatch of encoder/decoder and byte‑order issues (BOM) yields garbage or nulls. Demonstrates Java pitfalls: String.length returns UTF‑16 code units so emojis split into surrogates, naive substring or reverse produces question marks; using StringBuilder.reverse or code‑point APIs preserves graphemes. Recommends always declare and match the encoding.

AI-written summary · about

  1. 0:00Introduction to text encoding
  2. 1:27ASCII limitations and teleprinters
  3. 3:17Extending ASCII to support languages
  4. 6:32Unicode and its purpose
  5. 8:41Unicode code points and planes
  6. 11:40Unicode Transformation Formats
  7. 15:55UTF-8 vs UTF-16 vs UTF-32
  8. 18:29Explicit encoding matters
  9. 19:34String length and surrogates
  10. 22:49Reversing strings with emojis
  11. 25:20Encoding mismatches and garbage
  12. 27:51Normalizing Unicode characters
  13. 30:38Ligatures and compatibility
  14. 32:23Zalgo text and diacritics
  15. 33:28Emoji composition and skin tones
  16. 36:41Key takeaways and encoding agreement
  17. 37:22Q&A session
~/search
type to search 6,249 conferences, 138,987 speakers and 185,172 talks
~/help
cmdctrl k
search every conference, speaker and series
/
focus the filter search
h
home
c
conferences
s
speakers
e
series
t
light / dark — the status bar button does the same
?
this help
esc
close this, then clear every filter — or just the search, while you are typing in it

Ignored while you are typing. Pages without a filter rail have no search to focus.