Modern Data Warehouse for Small and Medium Business
summary
SMB customers with data warehouses in the 300–600 MB range and not expected to exceed 1 TB use a hybrid pattern: keep the relational warehouse on Azure SQL DB for lifted stored procedures, send unstructured and IoT streams into a data lake, and use pipelines (Azure Data Factory or Synapse pipelines) plus serverless analysis and Spark for ad hoc big data and data science. This pattern serves as an interim, cost‑efficient solution that works, with a clear migration path: refactor stored procedures into mapping/wrangling data flows and move bronze/silver layers into the lakehouse.
AI-written summary · about
chapters (6)
- 0:00Introduction and agenda
- 1:06Modern data warehouse patterns
- 3:15SMB variation of the pattern
- 8:14When not to use this pattern
- 9:37Refactoring to end-to-end platform
- 11:01Summary and resources
related talks
55mBuilding Modern Data Warehouse with Azure Synapse Analytics!
50mWhen and how to migrate to Azure Synapse?
40mData Lake House in the Cloud: The Azure Solutions
01h 01mModern Data Warehousing Strategy
55mDesigning performant and scalable data lakes
42mBuilding Tomorrow's Warehouse Today: Modern Data Warehouse Modelling Insights
53mAzure Synapse Analytics: Evolving Azure SQL Data Warehouse
24mREDLake Azure - Enterprise Data Lake and Business Satellites