Application Lifecycle Management in Azure Data Factory

on YouTube ↗01h 07m

" summary

How to set up structured, safe development and deployment for Azure Data Factory using Azure DevOps integration and services, including methods, technologies and best practices to avoid breakages after ad-hoc changes and to enable team workflows. The talk also compares continuous integration and continuous delivery (CI/CD) differences when building data pipelines in Azure Synapse Studio.

AI-written summary · about

" chapters (10)

1. 0:00ALM in Azure Data Factory
2. 1:58ALM importance
3. 6:46Data Factory development stages
4. 11:01Getting started with Data Factory
5. 24:38Sourcecode integration demo
6. 31:23Data Factory best practices
7. 41:35ARM template deployment
8. 57:29Teamwork and branches
9. 1:00:19Automation and release pipelines
10. 1:03:18Conclusion and recommendations

" related talks

• 22mUsing Azure DevOps for Azure Data FactoryPaul Andrew · SQLBits 2020
• 46mAzure Key Vault, Azure Dev Ops and Data FactoryErwin de Kreuk · SQLBits 2020
• 07mOptimizing Data Pipelines with Azure Data FactoryLokeshkumar Madabathula · Conf42 Machine Learning 2025
• 01h 00mBuilding cloud-native data pipelines using Azure Data FactoryAbhishek Narain · AzConf 2020
• 41mA Case Study - Data Movement and Transformation using Azure Data FactoryALPA BUDDHABHATTI · Data Con LA 2021
• 36mContinuous Deployment, Testing in Production, Autoscaling and Business WorkflowsBenjamin Talmard · DevFest Nantes 2015
• 56mDataDevOps for the Modern Data Warehouse on Microsoft AzureLace Lofranco · NDC Sydney 2019
• 01h 12mAzure DevOps and the SSIS Development LifecycleAndy Leonard · All Things Open 2020