Python at Cloudkick
summary
Cloudkick stores metrics in Cassandra for time series, uses MySQL for relational data and Solr for indexing, and sends real‑time UI updates via a Python Orbit/comet service; about 40 small network services run mostly in Twisted for 95% of backend network services. The agent is a C binary with an embedded Lua interpreter to implement checks and it opens persistent TCP connections. Event routing uses RabbitMQ with fanout/round‑robin/scoped policies; heavy streams go through Scribe->Cassandra. A custom test runner -> 50% faster parallelizes Django and Twisted tests.
AI-written summary · about
chapters (9)
- 0:00Start
- 1:50What is Cloudrick
- 8:02Python at Cloudkick
- 8:51Web application & Django
- 14:28Backend Services & Twisted
- 22:40Service Communication and RPC
- 27:54Testing
- 32:32Other places
- 33:34Questions?
related talks
19mPython for Cloud Services and Infrastructure Management
33mLessons learned building Python microservices
29mSwiss Army Django: Small Footprint ETL
29mTunnel Snakes Rule! Bringing the many worlds of Python together to monitor Melbourne's biggest infra
44mPython in the MicroServices world
27mPython, Pyramid, and Embedded Devices
21mUse Python to process 12mil events per minute and still keep it simple (Talk)
26mBuilding A Python Service Using Open Source Components That Connect, Transform & Deliver Data In RT