Migrating Away from MySQL for an awesome full text search
summary
Migrates a Django app from MySQL to Postgres using Pi MySQL to pgsql (simple YAML script) and later PG loader (bulk load then create indexes) and measures real times: ~3 minutes for 4.5M rows with the simple script, 42 seconds for 756 MB with PG loader. Builds a full-text search that uses Postgres full text stemming, TS vector/query, TS rank and headline for highlights, per-field ranking and OR fallback, and shows it works and is performant.
AI-written summary · about
chapters (9)
- 0:00Start
- 1:18SPLIT PERSONALITY PRESENTATION
- 4:37LETS MIGRATE (PART 1)
- 10:33NOTES ON MIGRATION SPEED
- 17:15BENCHMARKING APPLES AND ORANGES
- 18:48WHAT'S THE BIG DEAL WITH STEMMING?
- 22:40SEARCH REQUIREMENTS
- 26:01ADD THE SEARCH MAGIC
- 33:05LETS TALK STRATEGY
related talks
59mLarge Scale MySQL Migration to PostgreSQL
38mSwitching Teams: Moving an Application from MySQL to PostgreSQL
46mPostgreSQL Beyond Django: Strategies to Get Max Performance with Álvaro Justen
43mOptimize Python & Django apps with Postgres superpowers
26mA pythonic full-text search
23mDjango with PostgreSQL superpowers
24mSearch From the Ground Up
22mDjango with PostgreSQL superpowers