Building Cloud Native GDPR Friendly Systems for Data Collection
summary
Reproducible GDPR-compliant data pipeline built on Kubernetes that automates provisioning, TLS and mutual auth, and observability while keeping researcher onboarding to “build a container and a Deployment.” Uses gRPC (30% throughput gain over JSON), Pulumi-driven provisioning, Linkerd for mutual TLS and lightweight service mesh, Ambassador/Contour for protocol-aware ingress, cert-manager with Let’s Encrypt, Prometheus/Grafana and Argo Workflows. Runs modest 5–6 node clusters, went to production in Sept 2018, demo shows working end-to-end though gRPC‑Web and some ingress glue required extra effort; code is open source.
AI-written summary · about
chapters (13)
- 0:00Introduction
- 0:37What is GDPR
- 6:49GDPR Mapping
- 8:42GDPR Numbers
- 12:11ASIS
- 15:18Components
- 17:30Live Demo
- 18:49Project Overview
- 21:01GRPC
- 23:01Ingress
- 27:17Cert Manager
- 28:28Service Mesh
- 32:51Orgo
related talks
23mConstructing Building Blocks for Production Grade Cloud Native Deployments (with Cro... Hasan Türken
36mBuilding a Scalable Data Science & Machine Learning cloud using Kubernetes
30mBridging the DevOps to Data Divide with a Common Cloud Native Stack
41mCloud Native Security For The Rest Of Us
18mA Cloud-Native Tool for the mass
22mAnatomy of a production grade Kubernetes cluster
36mHow to Build Cloud-Native Platforms with Kubernetes
35mKubernetes journey