What I learned creating Postgres monitoring metrics for Citus on Azure

on YouTube ↗13m

" summary

Practical guide to Hyperscale (Citus) monitoring on Azure: recommends exporting constant, tagged metrics at a tunable granularity and alerting disk at ~90% before outages; use pg_stat_statements and pg_stat_activity to find long queries and connection leaks; monitor WAL size and replication slots to explain sudden disk growth; watch IO, cache/committed/dirty memory, and summarize log error types. Includes a real incident where one worker held most data, hit full disk, then recovered after scaling that worker to 2 TB.

AI-written summary · about

" chapters (6)

1. 0:00Introduction
2. 1:13Root cause analysis, alerts, & more
3. 2:18Granularity, constant monitoring, filtering, etc
4. 4:31System resource metrics
5. 7:52Database metrics
6. 10:12Citus-specific metrics

" related talks

• 24mCitus from the Customer eyesSai Krishna Srirampur · Citus Con: An Event for Postgres 2023
• 32mAuto scaling Azure Cosmos DB for PostgreSQL with Citus, Grafana & Azure ServerlessLucas Borges · Citus Con: An Event for Postgres 2023
• 16mOnline Scale-Out and Cloud Data IngestionAdam Wolk · Azure Cosmos DB: Liftoff 2022
• 44mDistributed Postgres with CitusWill Leinweber · HighLoad++ 2017
• 08mFoundations of Distributed PostgreSQL with CitusOnder Kalaci · Azure Cosmos DB: Liftoff 2022
• 25mSelf Hosted Citus using Cloud ComputingPaul De Audney · Citus Con: An Event for Postgres 2023
• 31mKEYNOTE: The Distributed PostgreSQL Problem & How Citus Solves itMarco Slot · Citus Con: An Event for Postgres 2023
• 32mWhat I learned benchmarking Citus & Postgres performance with HammerDBNaisila Puka · Citus Con: An Event for Postgres 2023