Pglog: a flexible log analyser

on YouTube ↗34m

" summary

Shows how to import CSV-format PostgreSQL logs into a local Postgres instance, using Postgres on laptop and a file_fdw/materialized views option; ships ready SQL reports for autovacuum, slow queries, checkpoints, temp files and errors; creates a partitioned PG log table plus views that let SQL pinpoint surprising hotspots (top-5 bloated tables, 80th-percentile temp-file sizes) and exclude outliers; runs in Docker for offline analysis and explicitly warns against use in production.

AI-written summary · about

" chapters (12)

1. 0:00Introduction
2. 2:37Why create PGLog
3. 5:51PGLog and PostgreSQL
4. 9:05Installation
5. 12:39Configuring PostgreSQL log settings
6. 16:37PGLog table setup
7. 19:51Standard reports
8. 24:53Checkpoint stats
9. 26:20Temp file report
10. 29:12Slow queries insights
11. 31:22Custom SQL analysis
12. 33:31Getting started

" related talks

• 57mQuery Logging and Workload AnalysisGreg Smith · Postgres Open 2012
• 43mLogging Not Just for LumberjacksGabrielle Roth · Postgres Open 2012
• 49mLeveraging pgBadger for Effective PostgreSQL TroubleshootingAlicja Kucharczyk · PostgreSQL Conference Europe 2023
• 49mProfessional PostgreSQL monitoring made easyPavlo Golub · PostgreSQL Conference Europe 2023
• 30mPostgreSQL Observability: The Log Configuration That Changes EverythingAlain Lesage · Devoxx France 2026
• 51mWhen Postgres Can't, You Can!Keith Fiske · PostgresOpen 2013
• 42mProfessional PostgreSQL monitoring made easyPavlo Golub · pgDay Paris 2025
• 25mPetabyte-scale Log management in Postgres using BaggerChris Travers · FOSSASIA PGDay 2025