Designing Secure, Compliant, & Scalable Test Data Pipelines for Enterprise
summary
Claims a centralized test data pipeline that automates provisioning via a self-service portal, applies on‑the‑fly masking techniques including format preserve encryption and tokenization, and generates realistic data with synthetic first approach when prod data is unavailable. Implementation ties containerized data snapshots into CI/CD and version control, cutting data footprint ~74% and boosting compliance 92% while addressing cited costs like $3.5M breach fines and developer time losses of ~280 hours each year.
AI-written summary · about
chapters (10)
- 0:00Introduction
- 1:02Test data crisis
- 2:25Poor test data costs
- 4:10Enterprise test data components
- 7:35CI/CD integration
- 8:39Data masking for compliance
- 10:04ML synthetic data
- 11:49Bank test data case study
- 13:14Summary
- 13:57Q&A
related talks
46mBuilding a Self-Managing Test Data Marketplace
51mBuilding a Self-Service Marketplace for Test Data
39mModern Data Pipelines Testing Techniques: A Visual Guide
25mTesting Data Pipelines
47mTest Data Key to Effective Test Coverage
38mRedefining Test Data Strategy in the Gen AI Era
20mBuilding a Data Pipeline with Testing in Mind
34mTest Data Management Principles