HeapBuffers: Why not just using a binary serialization format for your managed memory?
summary
HeapBuffers stores Java objects off-heap FlatBuffers layout in a separate transferable heap, generates schema-specific GC and specialized Java code, and compacts/encodes on prepare so the memory image is immediately IO-ready. Cross-heap references are disallowed and strings are copied via the Java heap, which can be the main overhead. Benchmarks against Apache Fury show large wins—often orders of magnitude for IO and in one set 2.4x throughput / 4x latency—with a worst case of about 8% throughput loss when schemas are string-heavy.
AI-written summary · about
chapters (7)
- 0:00HeapBuffers intro
- 2:26Flat buffers in JVM
- 3:51HeapBuffers design
- 6:41HeapBuffers programming
- 9:53HeapBuffers performance
- 11:41Conclusion
- 12:23Q&A
