Building a hosting platform with Python
summary
A hosted Python platform is built using eventlet for millions of lightweight green threads (tested to 10 million, 10k active in production), ZeroMQ for request/response messaging and automatic load balancing, and Postgres for durable app metadata after a migration when Redis proved unsuited and moved Redis data to PostgreSQL. Seventeen cooperating daemons run across heterogeneous hardware and multiple datacenters with 90–200ms inter-site latency; large app images live on disk, a custom load‑balancer replaces HAProxy, and PTY wrappers handle interactive subprocesses reliably.
AI-written summary · about
chapters (29)
- 0:00Start
- 1:54Hardware
- 2:20Network
- 2:57Daemons by the Dozen
- 3:20Redundancy, Redundancy...
- 4:27Security
- 6:19Basic Technologies
- 6:41Moving Data
- 7:13Storage
- 8:05What is eventlet?
- 9:00Brief Example
- 10:13Standard Classes
- 10:51Daemon Example
- 11:28Greening The World
- 13:20Still, it's really useful
- 14:19The Beginning
- 14:56February - March
- 16:23What is Zero MQ?
- 17:14ZeroMQ Example
- 18:20zmq_loop example
- 18:52Other Nice ZeroMQ things
- 20:15What is a PTY?
- 20:47Attempt One
- 21:48Greened pty example
- 23:13The resource module
- 23:58The signal module
- 24:42The atexit module
- 25:04The shlex module
- 29:23Python is really very capable
related talks
39mArchitecture of a cloud hosting service using python technologies: django, ansible and celery
30mBuilding modern Python web apps with PostgreSQL
25mA microservices architecture with Python and Docker containers
33mLessons learned building Python microservices
19mPython for Cloud Services and Infrastructure Management
21mPractical Deployment Strategies for Production Python Apps
01h 02mUsing Python to Power Serverless Applications
28mBoosting Python Web Apps performance with Celery and Concurrency