Top 10 Azure Data Factory Tips & Tricks
summary
Twenty concrete ADF practices: save then refresh before publish to avoid overwrites; check object dependencies before changing datasets or linked services; clone data flows to debug breakages; extract failure text via output.errors.message and capture rows via output.dataReads/output.dataWritten; use annotations on triggered runs; prefer parameters/global parameters and expressions to avoid nested activities; factor reusable email/logic into child pipelines; write variables to Blob by using copy activity additional columns. Also note ADF lists ~95 built‑in sources.
AI-written summary · about
chapters (11)
- 0:00Introduction to tips
- 0:24Save changes before publish
- 1:28Check dependencies before changes
- 4:00Clone objects for troubleshooting
- 5:46Access activity outputs dynamically
- 10:55Use annotations for triggers
- 13:23Leverage parameters and variables
- 16:56Use nested expressions in if
- 18:00Create child pipelines for reuse
- 19:02Write variables to blob storage
- 20:27Closing and thanks
related talks
07mOptimizing Data Pipelines with Azure Data Factory
50mMicrosoft Fabric Data Factory Q&A
01h 05mWorkflows of Highly Functional App & Data Engineering Teams
34mSeamless Automation: Transform Your Data Processing with Azure Data Factory
50mDeveloper Best Practices for Azure SQL : Avoiding common pitfalls when using the Cloud Database
01h 09mAzure SQL Database Development Inner and Outer Loops
36mHow to make your daily routine, code and database more efficient
22mAzure Infrastructure - What Not to Do
