Test Data Management Principles
summary
Shows a concrete pipeline that reads two production databases on different platforms, extracts a constrained subset (example: first 10 customers, data before July 1) to shrink terabytes to hundreds of megabytes, preserves cross‑database links via general relationships rather than DB foreign keys, and applies masking with a sequence number generator plus lookup and hash functions. Demo extracts 22 rows and inserts them into a test DB, keeping referential integrity intact.
AI-written summary · about
chapters (16)
- 0:00Introduction
- 0:33Challenges
- 3:38Data Management
- 8:59Production Setup
- 9:38Test Database
- 10:43Business Object
- 13:01Relationships
- 15:34Repeating
- 17:08Data from Production
- 18:05Waterfall
- 19:22Table Size Limit
- 19:45Extract Steps
- 20:54Data Protection
- 23:35Masking
- 23:51Overview
- 24:10Practical Demonstration
related talks
46mBuilding a Self-Managing Test Data Marketplace
47mEfficiency up, failed releases down; compliant production data for your test and dev environments
14mDesigning Secure, Compliant, & Scalable Test Data Pipelines for Enterprise
39mModern Data Pipelines Testing Techniques: A Visual Guide
51mBuilding a Self-Service Marketplace for Test Data
44mBro, Manage Test Data Like a Pro!- 47mEfficiency up, failed releases down; compliant production data for your test and dev environments
23mChallenges of database testing