When You Need to Build Your Own Database

on YouTube ↗41m

" summary

Examines when it becomes necessary for a company to implement its own database rather than use existing solutions. Discusses the practical problems and thresholds (scale, requirements, failures of off-the-shelf systems) that indicate building a custom database is justified, illustrated with developer experience from high-load systems.

AI-written summary · about

" chapters (13)

1. 0:00Introduction
2. 2:30Log system requirements
3. 3:56Elastic and Loki overview
4. 8:37Apache Parquet overview
5. 11:51Building your own database
6. 15:02HB project evolution
7. 18:18SH-Nothing architecture
8. 19:21Data storage optimization
9. 24:06Data structures for fast search
10. 27:01Exact search optimization
11. 28:58Distributed search challenges
12. 29:19When to build your own DB
13. 31:52Q&A

" related talks

• 42mBuilding with Purpose-Built Open Source Databases and BeyondLuis Ayala, Rodrigo Durán · AWS Public Sector Summit Mexico City 2020
• 25mBuilding Modern Applications with Custom DatabasesGabriel Paredes · AWS Summit Online América 2021
• 42mHow to Become a Great Database SpecialistIlya Kosmodemyanskiy · HighLoad++ Moscow 2018
• 45mBest Practices for Optimizing Database ProjectsVinicius Coimbra · DevDay 2018
• 42mHow to Build a Database-like ApplicationTommaso Allevi · Codemotion Madrid 2025
• 41mHow to choose the right database for your applicationZoe Steinkamp · NDC Oslo 2023
• 35m10 things a developer should know about databasesCarlos Tutte · Nerdearla 2020
• 06mWhen Database Meets DevOpsTomer Shay · Yalla DevOps 2021