Data Engineering Project SQL, Python, Airflow, Docker, CI/CD
Learn Data Engineering: APIs, SQL, Python, Docker, Airflow & more! Build pipelines, ensure data quality, and master CI/CD. Get job-ready skills.
Course Content
Data Engineering Project SQL, Python, Airflow, Docker, CI/CD is an all-levels Udemy course taught by Matthew Schembri. It runs 5h 1m, is taught in English, and includes a certificate of completion. Learners rate it 4.7 out of 5 from 48 reviews, with 517 students enrolled. It is a paid course, last updated October 2025.
Unlock your career in Data Engineering with this hands-on course! Become proficient in building and maintaining robust data pipelines – the essential foundation for today's data-driven organizations. This practical program focuses on real-world application, equipping you with the skills to design, build, and deploy efficient data solutions.
Here's what you'll master:
- Python for Data Engineering: Develop powerful Python scripts to extract data from APIs using Postman, seamlessly load it into your data warehouse, and perform efficient ELT (Extract, Load, Transform) processes.
- SQL for Data Pipelines: Gain expertise in PostgreSQL, a leading data warehouse, and learn to interact with it using both psql and DBeaver. Build efficient queries and optimize data storage.
- Docker for Containerized Deployments: Learn to containerize your data applications with Docker. This makes your data pipelines portable, scalable, and easier to manage across different environments.
- Apache Airflow for Workflow Automation: Become skilled in data workflow automation using Apache Airflow. You'll learn to orchestrate complex data pipelines, schedule tasks, and monitor their execution – a critical skill for any data engineer.
- Testing and Data Quality Assurance: Ensure data reliability with comprehensive testing strategies. Learn to implement unit tests, integration tests, and end-to-end (E2E) tests using pytest and Airflow DAG tests. Validate data quality with SODA to meet business and technical requirements.
- CI/CD with GitHub Actions: Automate your development lifecycle with CI/CD (Continuous Integration/Continuous Delivery) using GitHub Actions. Implement automated testing and deployment pipelines for faster, more reliable releases.
This course provides practical, project-based learning using industry-standard tools: PostgreSQL, Python, Docker, Airflow, Postman, SODA, and GitHub Actions. You'll receive expert guidance throughout, enabling you to confidently build and manage modern data pipelines.
Want AI in your product? Hire the team behind TutorialSearch.io
LLM features, RAG, agents and automation wired into a real product — built by the devs who shipped this site.