Udemyallen

Apache Airflow Bootcamp: Hands-On Workflow Automation

Learn Apache Airflow! Build & manage powerful workflows. This step-by-step guide covers everything for robust automation. #Airflow #WorkflowAutomation

4.1(89)
591students
6h 2m
Certificate
Sriw World of Coding
Sriw World of CodingInstructor at Udemy

Course Content

Apache Airflow Bootcamp: Hands-On Workflow Automation is an all-levels Udemy course taught by Sriw World of Coding. It runs 6h 2m, is taught in English, and includes a certificate of completion. Learners rate it 4.1 out of 5 from 89 reviews, with 591 students enrolled. It is a paid course, last updated April 2025.

Master Apache Airflow: Workflow Automation Bootcamp

Unlock the power of Apache Airflow and become a proficient workflow automation expert! This comprehensive bootcamp takes you from beginner to confident Airflow user with hands-on experience and practical examples. Learn to build, manage, and optimize data pipelines for career advancement and efficient data handling.

What You'll Learn:

  • Introduction to Apache Airflow: Understand the purpose and benefits of using Airflow for data pipeline orchestration. Explore the pros and cons of adopting Airflow in your projects.
  • Airflow Architecture: Gain a deep understanding of Airflow's components and key terminology.
  • Installation & Configuration: A step-by-step guide to Airflow installation, configuring the airflow.cfg file, and launching the Airflow Web UI.
  • Airflow Web UI Navigation: Master the Airflow Web UI – explore DAG View, Grid View, Graph View, Calendar View, Task Duration View, Code View, Variable View, and Gantt View.
  • Directed Acyclic Graphs (DAGs):
    • Learn what a DAG is and how to create DAG definitions.
    • Explore various DAG creation methods.
    • Understand DAG Run, default_arguments, and DAG arguments.
    • Utilize parameters in DAGs and pass them through the TriggerDagRunOperator.
    • Master scheduling concepts including depends_on_past, wait_for_downstream, catchup, and backfill.
  • Airflow CLI & Cheatsheet: Leverage the Airflow CLI for efficient operations. Access a handy Airflow cheatsheet for quick reference.
  • Airflow Tasks: Understand tasks and task instances, and their lifecycle.
  • Airflow Operators: A detailed exploration of essential Airflow operators, including:
    • BashOperator
    • PostgresOperator
    • PythonOperator
    • SqliteOperator
    • EmailOperator
  • Airflow Sensors: Utilize sensors like FileSensor, SQLSensor, TimeDeltaSensor, and TimeSensor for conditional task execution.
  • Branching Logic: Implement branching logic with BranchSQLOperator, BranchPythonOperator, BranchDayOfWeekOperator, BranchDateTimeOperator, and ShortCircuitOperator.
  • DAG Dependencies & Task Groups: Manage DAG dependencies and leverage TaskGroups for organized workflows. Utilize TriggerDagRunOperator and ExternalTaskSensor.
  • Airflow Hooks: Understand and use Airflow hooks, such as PostgresHook and SHook, for database and system interactions.
  • Resource Management: Manage Airflow resources with pools and task priorities.
  • Airflow Executors: Explore different Airflow executors: SequentialExecutor and LocalExecutor. Learn how to transition to LocalExecutor.
  • Airflow Metadata Database & Roles: Understand the Airflow metadata database and manage user roles (admin, public, user, operator). Create custom roles and modify existing ones.
  • SLA (Service Level Agreement): Set and manage SLAs at the task and DAG levels. Handle SLA misses.
  • Advanced Concepts:
    • Utilize XComs for inter-task communication.
    • Retrieve context parameters and use callback functions.
    • Troubleshoot zombie tasks, SIGTERM, and SIGKILL errors.

This Apache Airflow bootcamp is perfect for data engineers, data scientists, and anyone looking to streamline their data pipelines and improve workflow automation. Start building powerful data workflows today!

$ whoami — the devs behind tutorialsearch.io

Need a web app built? Hire the team behind TutorialSearch.io

We ship fast, production-grade full-stack apps (Next.js, React, edge infra) — the same stack that powers this site.

skillshare
5.0(51)
1h 24m
beginner
skillshare
5.0(875)
12h 55m
all
skillshare

The Godot Bootcamp

by Michael Mcguire

5.0(300)
16h 13m
beginner
skillshare
5.0
18m
intermediate
pluralsight
5.0(45)
1h 36m
beginner