Elminating data silos with SDX

on YouTube ↗09m

" summary

SDX (Shared Data Experience) promises a single governance layer that keeps policies travel with the data across S3, Azure Data Lake, HDFS and Kudu so ETL, streaming and analytics run concurrently on the same physical data without performance penalty. It ships as part of the platform with over 1,000 customers in production and a shared data catalog for audit trails and access control. A cited customer scales IoT preventive maintenance to 300,000+ vehicles, and SDX supports multi-cluster security and cloud-first deployments.

AI-written summary · about

" chapters (5)

1. 0:00Introduction
2. 1:57What is SDX
3. 3:02Hidden performance
4. 5:45Governance and audit
5. 6:45SDX in the clouds

" related talks

• 27mConsistent Security, Governance And Flexibility For All WorkloadsStephen Donoghue, Allison Mau · Big Data LDN 2018
• 32mConnecting Silos In Real-time With Data VirtualizationBecky Smith · Big Data LDN 2018
• 24mHow To Remove Data Siloes: Tips & ConsiderationsNishant Dixit · Big Data LDN 2022
• 17mOpen Data Lakes: Latest stop in the big data journeyApurva Desai · ApacheCon@Home 2021
• 22mData virtualization - Unlocking data - From silos to success?Jean-Marc Boivin, Vincent L'Archeveque · Big Data & AI Toronto 2020
• 24mREDLake Azure - Enterprise Data Lake and Business SatellitesPredrag Ilic · DSC Europe 2022
• 24mA Single Data Platform for All of Your WorkloadsStephen Weingartner · DataEngBytes 2021
• 23mCross-company data exchange for the cloud.Pardis Noorzad · Scale By the Bay 2023