Efficient File Handling for Java Developers
summary
Practical guide to high-performance file I/O in Java based on experience building disk‑intensive applications (specifically Apache Ignite Native Store). Covers factors beyond workload that affect disk performance, techniques to maximize disk throughput, and common mistakes and misconceptions when using the Java I/O API. Aimed at experienced Java developers focused on disk performance.
AI-written summary · about
chapters (13)
- 0:00Efficient file handling intro
- 1:28Filesystem load types
- 3:34HDD vs SSD storage
- 8:14OS file access
- 12:24FileChannel modern approach
- 16:01Data alignment and caching
- 20:36mmap pros and cons
- 23:50OS cache direct control
- 26:18File copy optimization
- 33:11Multithreading file ops
- 35:22Open file limits
- 36:49TransferTo vs TransferFrom
- 40:45Summary and tips
related talks
57mDatabaseless High-Performance Java-Native Persistence
50mA Java Implementer's Guide to Better Apache Spark Performance
43mCaching and Beyond - Smarter Data Processing with Java
46mTechniques for Developing a High-Load Server in Java
49mBeyond the Data Grid: Fast Data Processing with Apache Ignite
45mbetter files: Towards a safe, sane I O library in Scala
45mHow to write fast in Apache Ignite
47mHunting issues in a Java app with 31G heap and 500G off-heap: an Apache Ignite case study