Data Access Automation at Scale
summary
Meta deploys an annotation API and schema language that validate ownership, fetchers, fields and edges, then auto-generate privacy-safe accessors and a unified query language; an asynchronous tier with checkpointing collects and merges data across hundreds of services and recovers from failures; an interactive visualizer speeds annotation; deployment spans Facebook, Instagram and WhatsApp and serves millions of requests daily, cutting integration time for new types to as low as a few minutes via code generation.
AI-written summary · about
related talks
15mArchitecting Scalable Data Lineage Graph for Privacy Compliance and Agentic Analysis
12mUsing GenAI to Accelerate Privacy Implementations
25mTechnical Metamorphosis: The 3 Stages of DSAR Automation
33mAutomating Data Analytics: Collect, Transform and Deploy - Lead With Change
14mApproaches and Challenges to Purpose Limitation across Diverse Data Uses
28mData Engineers: Privacy Is Your Problem
26mAn Easier Path to a Rich Catalog
24mDataEngBytes 2023 - MEL-T3-03 - Akira Wang & Abdi Farah