Azure Data Factory For Data Engineers - Project on Covid19
Data Engineering project with Azure Data Factory, SQL, Data Lake, Databricks & more. Master CI/CD for real-world data pipelines. DP203 skills!
Course Content
Azure Data Factory For Data Engineers - Project on Covid19 is an all-levels Udemy course taught by Ramesh Retnasamy . 200,000+ Learners. It runs 12h 40m, is taught in English, and includes a certificate of completion. Learners rate it 4.6 out of 5 from 16,746 reviews, with 93,864 students enrolled. It is a paid course, last updated July 2025.
Welcome to a comprehensive course on Azure Data Factory (ADF), a leading cloud data integration service! This course provides hands-on experience building a robust data engineering solution using Azure Data Factory to address a real-world challenge: reporting on and predicting COVID-19 trends.
This isn't your typical Azure Data Factory course. We focus on practical application, equipping you with the skills to independently tackle data engineering projects. You'll gain proficiency in Azure Data Factory and related data engineering technologies.
What You'll Learn:
- Azure Data Factory (ADF) Fundamentals: A solid foundation in Azure Data Factory concepts and architecture.
- Data Pipeline Development: Build and manage complex data pipelines for data integration and transformation.
- Data Integration: Integrate data from various sources including HTTP clients, Azure Blob Storage, and Azure Data Lake Gen2.
- Control Flow Activities: Master control flow activities like Get Metadata, If Condition, ForEach, Delete, and Validation for pipeline orchestration.
- Parameters & Variables: Implement metadata-driven pipelines using Parameters and Variables in Pipelines, Datasets, and Linked Services.
- Debugging & Troubleshooting: Effectively debug data pipelines and resolve common issues.
- Pipeline Scheduling: Schedule pipelines using various triggers, including Event Triggers, Schedule Triggers, and Tumbling Window Triggers.
- Mapping Data Flows: Create powerful Mapping Data Flows for data transformation, covering all essential steps: Source, Filter, Select, Pivot, Lookup, Conditional Split, Derived Column, Aggregate, Join, and Sink.
- Data Flow Debugging: Investigate and fix failures in data flows.
- HDInsight & Databricks Integration: Execute HDInsight activities and Databricks Notebook activities within your Azure Data Factory pipelines for advanced data transformations.
- Pipeline & Trigger Dependencies: Orchestrate complex data flows by establishing dependencies between pipelines and triggers.
- Monitoring & Alerting: Monitor data pipelines using Azure Data Factory Monitor and Azure Monitor, setting up alerts and reporting metrics.
- Log Analytics: Create Log Analytics workspaces, build workbooks, and generate charts from Azure Data Factory logs.
- Azure Storage Solutions:
- Azure Storage Account: Create, manage, and secure Azure Storage Accounts.
- Azure Data Lake Gen2: Utilize Azure Data Lake Gen2 for scalable data storage.
- Azure SQL Database: Create and manage Azure SQL Databases, including pricing tiers, user management, table creation, and data loading.
- Azure HDInsight & Databricks:
- Create and manage HDInsight Clusters and Databricks Workspaces and clusters.
- Interact with HDInsight and Databricks using the UI and Ambari.
- Perform data transformations using Databricks Notebooks.
- Azure DevOps (CI/CD):
- Set up Azure DevOps Environment and configure Git Repositories.
- Implement CI/CD pipelines for automated release of Azure Data Factory artifacts.
- Configure build and release pipelines to deploy code to Test and Production environments.
- Parameterize CI/CD pipelines for seamless deployment to Azure Data Lake Storage.
Course Progression:
The course follows a logical, project-based approach. We build Azure Data Factory pipelines alongside explaining the underlying technical concepts. While not specifically designed for the DP203 Azure Data Engineer Associate certification, this course provides a strong foundation for the exam.
Key Features:
- Fast-Paced & Concise: Designed for efficient learning.
- Simple Language: No technical jargon, explained in easy-to-understand English.
- Real-World Application: Learn by building a practical data engineering solution.
Want AI in your product? Hire the team behind TutorialSearch.io
LLM features, RAG, agents and automation wired into a real product — built by the devs who shipped this site.