Big Data: From Testing to Governance
summary
Implemented a company-wide data governance program that pairs robots + webdriver sampling with automated scans and a 90-minute freshness SLA, defines a single golden record, and enforces retention and disposal policies. Discovery: raw storage doubles to decade levels and about 20% test-artifact bulk in production. Actions: delete unused data, rotate credentials and issue personal accounts, and prioritize testing on high-value datasets. Result: consistency bugs become rare and fixes ship faster while compliance planning anticipates 72-hour breach notification and 4% turnover fines.
AI-written summary · about
chapters (11)
- 0:00Introduction
- 1:28Data quality definitions
- 4:38Data validity definitions
- 6:33Data timeliness definitions
- 7:41Data governance
- 10:17Data governance goal
- 14:44Is it real
- 16:28Who has access
- 19:36Data Privacy
- 23:14Personal Identifiers
- 25:30Conclusion
related talks
47mData governance
14mDesigning Secure, Compliant, & Scalable Test Data Pipelines for Enterprise
47mTest Data Key to Effective Test Coverage
38mRedefining Test Data Strategy in the Gen AI Era
40mScaling testing & test automation without losing control
15mRobust Coverage with Right Test Data | Need, Challenges, & Benefits
47mEfficiency up, failed releases down; compliant production data for your test and dev environments
46mBuilding a Self-Managing Test Data Marketplace