Hidden pearls for high-performance-persistence in Java

on YouTube ↗01h 12m

" summary

Quick survey of concrete options and claims: jOOQ, Speedment and JPA streams keep SQL as the single source and require tuned queries; Chronicle Bytes and Chronicle Maps write compact primitives and offer extremely low-latency append/read for logs and key/value at HFT scale (chronicle bytes for compact, blazing fast append). JetBrains Xodus is a transactional key/value + entity store with MVCC and a virtual file system for attachments (Xodus entity store with MVCC and VFS). MapDB provides Java collections with transactions and an eviction/overflow mechanism to combine memory and disk (expireOverflow cascading on- and off-heap tiers). MicroStream promises storing full Java object graphs without decomposition and shows the largest convenience/serialization payoff (store object graphs without decomposing).

AI-written summary · about

" chapters (30)

1. 0:00Introduction
2. 7:03Why what
3. 8:52Lets start
4. 9:20Persistence layer
5. 13:10Speedman
6. 15:00JavaStream
7. 16:21Coffee
8. 16:33High frequency trading
9. 16:59ChronicleBytes
10. 20:40Chronicle Maps
11. 25:44Xodos
12. 27:10Entity
13. 27:57Jetbrains
14. 28:24Environments
15. 32:25Entity Store
16. 34:29Virtual File System
17. 35:50Performance benchmarks
18. 36:38Data dump
19. 37:08Mapdb
20. 37:38Dropin replacement
21. 38:11MVCC
22. 39:26Data Structures
23. 43:11Cascading Data Structures
24. 44:50Commit and Rollback
25. 46:03Microstream
26. 47:49Open Source
27. 50:43Solution
28. 53:08Lazy loading
29. 54:10Microstream Hackathon
30. 54:59Tips

" related talks

• 48mHidden Pearls for Java Embedded High-Performance PersistenceSven Ruppert · Developer Summit 2020
• 01h 00mEclipse MicroStream - Ultra-fast Java cloud-native persistence for microservicesMarkus Kett · Voxxed Days Luxembourg 2023
• 54mEclipse MicroStream - Ultra-Fast Java Cloud-Native Persistence for MicroserviceMarkus Kett · JCON Europe 2023
• 44mJava In-Memory Database-Apps with MicroStreamFlorian Habermann · JCON 2020
• 50mUltra fast Java In Memory Database Apps and Microservices with MicroStreamMarkus Kett · JCON-ONLINE 2021
• 32mJava's Ignored Potential: Supercharge Database Apps with Java In-Memory ProcessMarkus Kett · JCON EUROPE 2025
• 45mCaching Unleashed: Supercharge Your Database ApplicationMarkus Kett · JCON EUROPE 2025
• 50mGetting started with MicroStream - High-Performance Java-Native PersistenceMarkus Kett, Christian Kümmel · JCON 2020