Udemybeginneren

Azure Data Factory Essentials Training (Hands-On)

Build ETL pipelines in Azure Data Factory! Integrate with Azure Databricks for powerful data processing. Learn data integration & analytics.

4.3(79)
400students
3h 36m
Certificate
Everton Oliveira
Everton OliveiraMicrosoft Certified Cloud Solutions Architect Expert & MCT

Course Content

Azure Data Factory Essentials Training (Hands-On) is a beginner-level Udemy course taught by Everton Oliveira. It runs 3h 36m, is taught in English, and includes a certificate of completion. Learners rate it 4.3 out of 5 from 79 reviews, with 400 students enrolled. It is a paid course, last updated October 2021.

Unlock the Power of Data Integration with Azure Data Factory

Master Azure Data Factory (ADF): A Comprehensive Guide for Data Engineers

This course provides a practical introduction to Azure Data Factory, a powerful cloud-based data integration service. Learn how to efficiently manage and automate data movement and transformation processes, enabling you to build robust ETL (Extract, Transform, Load) solutions. Through hands-on activities, quizzes, and a final project, you'll gain the skills to integrate diverse technologies and streamline your data pipelines.

Key Skills You'll Acquire:

  • Orchestrate Data Pipelines: Understand how ADF orchestrates various technologies for data transformation and analysis.
  • ADF Components: Become proficient in using core ADF components, including Pipelines, Datasets, Triggers, Linked Services, and more.
  • Data Integration: Learn to seamlessly integrate two or more technologies using ADF.
  • Data Pipeline Development: Confidently design and build medium-complexity, data-driven pipelines.
  • CI/CD for Data Pipelines: Develop and implement Continuous Integration and Continuous Delivery (CI/CD) pipelines in Azure DevOps for automated deployment of your ADF pipelines.

What You'll Learn:

  • Azure Data Factory Fundamentals:
    • Introduction to Azure Data Factory and its capabilities for integrating with a wide range of connectors.
    • Setting up Azure Data Factory from scratch using the Azure Portal and PowerShell.
    • Exploring ADF components: Linked Services, Pipelines, Datasets, Triggers, Integration Runtimes (IR) (including Azure IR, Self-hosted IR, and Azure-SSIS IR), Parameters (Pipeline, Activity, Global).
  • Data Ingestion and Transformation:
    • Ingesting data using the Copy Activity into Data Lake Store Gen2.
    • Copying data from AWS S3 to Azure SQL Database.
    • Creating Linked Services for Azure SQL Database.
    • Managing permissions for Data Factory Managed Identity on Azure SQL DB.
    • Ingesting Parquet files from AWS S3 into Azure SQL Database and Data Lake.
    • Transforming Data with Mapping Data Flows:
      • Walkthrough of Mapping Data Flows.
      • Identifying and utilizing transformations within Mapping Data Flows.
      • Working with multiple inputs and outputs.
      • Using schema modifiers and formatters.
      • Adding sources and sinks to Mapping Data Flows.
      • Defining source types (Dataset vs. Inline) and options.
      • Optimizing data loads with partitions.
      • Previewing data from the source.
  • Azure Data Factory & Databricks Integration:
    • Integrating Azure Data Factory with Databricks for advanced data transformation.
    • Authenticating and running Databricks notebooks from within ADF.
    • Project Walkthrough: Creating Azure Databricks and importing notebooks.
    • Transferring data using Databricks and Data Factory.
    • Validating data transfer in Databricks and Data Factory.
    • Orchestrating data transformation using Databricks notebooks within ADF.
  • Continuous Integration and Continuous Delivery (CI/CD):
    • Creating an Azure DevOps organization and project.
    • Setting up a Git repository in Azure DevOps.
    • Linking Data Factory to Azure DevOps repositories.
    • Versioning Azure Data Factory with branches.
    • Implementing a Data Factory release workflow.
    • Merging Data Factory code to the collaboration branch.
    • Creating CI/CD pipelines for Data Factory in Azure DevOps.
    • Executing release pipelines in Azure DevOps for ADF.

Who Should Take This Course?

This course is designed for data engineers, data architects, ETL developers, and anyone looking to leverage Azure Data Factory for data integration and automation.

Project:

Apply your knowledge by submitting a project demonstrating your understanding of ADF components, integration with Databricks, and pipeline orchestration.

Prerequisites:

  • Basic understanding of data warehousing concepts.
  • Familiarity with Azure services is helpful.

DP-203 Exam Preparation:

This course covers key topics relevant to the DP-203: Data Engineering on Microsoft Azure certification exam.

$ whoami — the devs behind tutorialsearch.io

Need a web app built? Hire the team behind TutorialSearch.io

We ship fast, production-grade full-stack apps (Next.js, React, edge infra) — the same stack that powers this site.

5.0
53m
beginner
pluralsight
5.0
1h 29m
beginner
pluralsight
5.0(122)
3h 38m
all
skillshare