Architecting a security data lake at enterprise scale
summary
Comcast builds a cloud-native security data fabric that centralizes 10 petabytes of security telemetry from 100+ sources, auto-parses and normalizes it to the OCSF schema, and lands enriched records in a data lake pipeline (S3, Databricks → Snowflake) while feeding Splunk and Tableau. The platform supports continuous controls monitoring aligned to NIST 4.0 and PCI 2.0, interactive Databricks notebooks for threat hunting, AI/ML owner identification, several terabytes ingested daily, and role-based views that moved teams from reactive to prescriptive.
AI-written summary · about
chapters (8)
- 0:00Introduction to data fabric
- 1:45Data infrastructure levels
- 2:37Security data maturity path
- 6:31Building the data pipeline
- 7:58Implementing the fabric
- 11:32Core fabric capabilities
- 13:33Continuous controls monitoring
- 15:33Accelerating your journey
related talks
17mUnifying Your Security Data with Amazon Security Lake and OCSF
54mBuild your security data lake w/ Amazon Security Lake, featuring
22mUse generative AI and Amazon Security Lake to enhance threat analysis
15mSecuring the Cloud and Training Your Dragons
12mSecurity data gravity: Visibility & threat detection for data lakes
42mThreat Detection across all environments with SnowflakeData Security Lake
13mClosing the security visibility gap
47mDeveloping an autonomous framework with Security Lake & Torc Robotics