Speeding up bulk inserts with Spring + PostgreSQL
summary
Addresses slow bulk inserts into PostgreSQL when using Spring and shows concrete ways to speed them up, from simple configuration tweaks in Spring to custom PostgreSQL-side methods. Covers specific technologies Spring (Java) and PostgreSQL and focuses on practical optimization steps for large-volume data insertion.
AI-written summary · about
chapters (18)
- 0:00Introduction
- 1:23Talk goals and structure
- 2:05Bulk insert problem
- 4:34Memory usage analysis
- 6:24ID generation tuning
- 7:31Batch insert usage
- 8:57JDBC driver optimization
- 10:42Session-level cache management
- 12:51Spring Batch settings
- 13:14Custom layer creation
- 17:35Testing custom solution
- 17:59Drop indexes before insert
- 20:54PostgreSQL COPY command
- 23:22COPY Binary format
- 26:57Spring transaction integration
- 29:49Parallel inserts
- 36:21Summary
- 38:15Q&A
related talks
45mSpeeding Up Data Ingestion in PostgreSQL: From Custom Methods to Multithreading and Atomicity
52mBulk data processing and PostgreSQL thingy
52mPostgreSQL and Java: Best Practices
44mPostgres for Java Developers
14mPlanetary Scale Postgres for Spring Boot Apps: A Fast Migration Path for Devs
18mMaking Postgres inserts faster on Azure
47mA Journey to Postgres Productivity with Go
37mPostgres at Any Scale