Securing sensitive information with Glue Sensitive Data Detection
summary
AWS Glue adds a Sensitive Data Detection transform that identifies PII at ingestion using a built‑in ML model plus out‑of‑the‑box and custom detectors (regex + contextual keywords), then either redacts data, adds a findings column or triggers custom transforms. Demo builds a custom detector for Canadian PR numbers, redacts rows so masked data lands in S3, and adds Lake Formation tags to enforce column‑level access; jobs provision resources in 6 seconds to provision resources and complete in about 1–3 minutes.
AI-written summary · about
chapters (8)
- 0:00Introduction to AWS Glue
- 3:34Data privacy challenges
- 9:09New sensitive data feature
- 13:42Custom detection and actions
- 17:34Workflow and configuration
- 19:48Demo: Redacting sensitive data
- 36:52Demo: Lake Formation security
- 56:36Conclusion and Q&A
related talks
16mAutomated Data Analytics
19mPreserving privacy on data collaboration with AWS Clean Rooms
27mProactively identifying threats & protecting sensitive data in S3
59mModern data lakes with Lake Formation, Amazon Redshift & AWS Glue
28mML + Big Data: Spark on Amazon SageMaker with Amazon Glue
46mProtecting sensitive data in huge datasets: Cloud tools you can use
26mGenerative AI driven sensitive data protection
20mData lake deep dive: Using accelerated indexing for threat detection