How to Schedule Tasks with Celery and Django
summary
Celery integrates with Django using a message broker and optional scheduler and result store; the talk recommends RabbitMQ over Redis for brokers, warns Redis visibility-timeout pitfalls, and suggests Django ORM or Redis for results. A concrete case study generates voter rolls for 2,000+ centers by splitting voters into stations of 500–600 voters, compares serial, group, chain, and chord patterns, finds 7–8 second tasks ideal for graceful shutdown, and shows starmap runs sequentially not parallel.
AI-written summary · about
chapters (10)
- 0:00Introduction
- 3:19What is Celery
- 10:15Adding Celery to Django
- 13:30Configuring Celery tasks
- 16:03Scheduling with Celery Beat
- 18:54Result store setup
- 21:44Designing Celery tasks
- 26:25Voter roll case study
- 37:26Celery best practices
- 38:51Q&A
related talks
45mPlaying tasks with Django-Celery
45mPlaying tasks with Django-Celery
49mIntroduction to Celery
32mFrom crontab to celery with no regrets
17mBuild a prod-ready distributed task queue system with celery
28mBoosting Python Web Apps performance with Celery and Concurrency
19mOptimizing Data Retrieval with Python Celery
31mReinventing Django for the Real-Time Web