A microservices architecture with Python and Docker containers

on YouTube ↗25m

" summary

A production microservices pipeline runs as Docker containers with each task in its own container, using Python 2 glue and a custom Python package that bundles download, wrangle, notification and backup modules; data lands in Postgres and is indexed to Elasticsearch, a Streamlit dashboard reports metrics, and CI builds new images on push. The single small server (8 GB RAM, 4 vCPU) serves about 20,000 users/month, downloads 3k–9k docs daily, and has sent ~36,000 notifications, and the system works in production.

AI-written summary · about

" chapters (7)

1. 0:00Introduction
2. 0:42About the project
3. 1:49The website
4. 4:05Background
5. 6:28Architecture
6. 17:24Python libraries
7. 22:42Next steps

" related talks

• 40mA Tale of MicroservicesKonstantin Krivlenia · The Rolling Scopes Conference 2018
• 34mPython Micro-service ArchitectureRory Hart · PyCon Australia 2014
• 33mLessons learned building Python microservicesRichard Jones · PyCon AU 2019
• 44mPython in the MicroServices worldHari Krishnan · PyCon Singapore 2016
• 54mSnaking Python Into KubernetesJonathan Johnson · Developer Summit 2020
• 42mBuilding a hosting platform with PythonAndrew Godwin · EuroPython 2011
• 37mHow the hell do I run my microservices in production, and will it scaleDaniël van Gils · DevOps Pro Moscow 2016
• 30mHow To Build a Python Microservice Without Losing a JobAnton Caceres · EuroPython 2019