How Tinkoff.ru Uses Greenplum
summary
Describes how Tinkoff.ru runs Greenplum for large-scale analytics: they implemented a custom replication system from Oracle and Postgres, run about 4,000 daily ETL jobs processing over 20 TB/day and store over 70 TB, and support roughly 1,000 daily users accessing the Greenplum cluster via SAS, Zeppelin and direct database clients.
AI-written summary · about
chapters (19)
- 0:00Introduction
- 1:15Data warehouse evolution
- 3:25Greenplum in action
- 5:11Modern architecture
- 7:50Data replication issues
- 10:44Replacing Unity Replicator
- 12:33Golden Gate solution
- 14:43Disaster Recovery design
- 17:12Backup problems
- 20:24Current DR system
- 21:28Greenplum nuances
- 23:59Query optimization
- 26:08Load and temperature
- 27:11File splits and performance
- 29:02Metadata issues
- 30:47Transactions and vacuum
- 32:36User training
- 34:23Operational tips
- 35:50Q&A
related talks
30mGreenplum Database — massive parallel processing with a shared-nothing architecture based on Postgres
35mFrom Stars to Storage Engines: Migrating Big Science Workloads Beyond Greenplum
46mBig databases, many servers, data center or cloud - it's all here!
27mBuilding a PostgreSQL data warehouse
26mLeveraging a Distributed SQL Database at Tokopedia: Best Practices & Lessons Learned
18mScaling Without Limits: KFIN's Journey to Distributed SQL
54mBreakout Session
20mBuild Your Business Based On PostgreSQL Databases