From 0 to 1: The Oozie Orchestration Framework
Learn Oozie workflows, coordinators & bundles. A practical guide to orchestrating data pipelines. Master Oozie for efficient workflow management.
$ Need a web app, AI feature or SaaS built? Hire the devs behind TutorialSearch.io — start a project
This topic covers building robust data pipelines using tools like SQL, Python, and Airflow. Learn to design, develop, and deploy automated workflows for data ingestion, transformation, and loading. Gain skills in data quality, scheduling, and monitoring to ensure reliable and efficient data processing.
Learn Oozie workflows, coordinators & bundles. A practical guide to orchestrating data pipelines. Master Oozie for efficient workflow management.
Learn Snowflake data pipelines! Build batch & streaming processes. Connect to external data, handle errors, and work with structured/semi-structured data securely.
Master Apache Airflow! Learn workflow management, automation, and data pipelines. Perfect for beginners to advanced users. Boost your data skills today.
Learn real-time data processing with Apache Kafka and Kafka Streams API. Build scalable stream processing applications. Master data pipelines & event-driven architectures.
Master Apache Kafka! Hands-on experience building producers & consumers with Java, Node.js & Python. Learn core features & real-world applications.
Learn Apache NiFi! This introductory course teaches you to master data flow automation. Build powerful data pipelines with ease. Get started with NiFi today.
Learn Flink with Scala 3! Build production-ready data pipelines through practical exercises. Master stream processing and big data applications.
Master ETL/ELT with Snowflake & Airflow. Process large datasets (250+ GB) using efficient data pipelines. Learn data integration techniques.
Automate research & engineering workflows with Python! Learn to write scripts for efficient postprocessing. Perfect for data analysis & automation.
Learn Presto data pipelines! Query data in HDFS, MySQL & Kafka using Presto CLI, R Studio & Tableau. Build end-to-end data solutions.
Learn Presto data pipelines! Query data in HDFS, MySQL & Kafka using Presto CLI, R Studio & Tableau. Build end-to-end data solutions.
Learn data engineering with Kafka, Spark, Flink, Airflow & AWS. Build real-world projects using PostgreSQL & data pipelines. Hands-on skills!
LLM features, RAG, agents and automation wired into a real product — built by the devs who shipped this site.
Explore more topics related to Data Pipelines.
Learn to clean, reshape, and prepare data for analysis using tools like Power Query (M language). This tutorial covers data cleaning techniques, data type conversions, merging datasets, and creating custom data transformations. Improve data quality and unlock deeper insights through effective data preparation. Practical exercises included.
Learn to build robust CI/CD (Continuous Integration/Continuous Delivery) pipelines using GitHub Actions. This topic covers automating build, test, and deployment processes. Explore workflow configuration, secrets management, and best practices for efficient software delivery. Gain skills for streamlined development and faster release cycles.
Explore techniques for creating impactful data visualizations using tools like R Markdown. Learn to transform raw data into compelling narratives, effectively communicating insights to diverse audiences. This topic covers chart types, dashboard creation, and data storytelling principles for data professionals.
This topic encompasses the core competencies needed for a successful data science career. Learn essential skills including SQL for data retrieval, Tableau for data visualization, Python for programming and scripting, and Machine Learning/Deep Learning for predictive modeling. Develop a well-rounded skillset to tackle real-world data challenges and advance your career.
Explore Power BI's capabilities for data visualization and analysis. This topic covers data modeling, DAX calculations, report design, and interactive dashboards. Learn to extract insights from data, create compelling visuals, and build robust reports for data-driven decision-making. Prepare for the PL-300 certification.
Explore core data science methods and techniques for effective analysis and modeling. This includes statistical analysis, machine learning algorithms (regression, classification, clustering), data preprocessing, and model evaluation. Learn to apply these methods to real-world datasets and gain insights for data-driven decision-making. Focuses on practical application and future trends.
This topic covers the end-to-end process of building and maintaining data pipelines. Learn about ETL, data warehousing, data modeling, and data quality. Explore tools like Databricks and Spark for efficient data processing. Gain skills to design robust and scalable data solutions for various business needs.
Unlock the power of Python for data analysis! This topic covers essential libraries like Pandas, NumPy, and Matplotlib for data manipulation, cleaning, and visualization. Learn data structures, statistical analysis, and build data-driven insights. Ideal for those seeking a practical Python data analysis skillset.
Data Pipelines typically involve data extraction, transformation, and loading (ETL) processes to move data from various sources to a destination. These stages ensure data quality and availability for analysis, forming the backbone of data-driven decision-making.
Data Pipelines are broader than ETL, encompassing real-time data streaming and more complex data transformations. ETL usually focuses on batch processing, while pipelines handle both batch and continuous data flow for modern data science applications.
Programming skills crucial for Data Pipelines include Python, SQL, and potentially Java or Scala, depending on the technology stack. Expertise in data manipulation libraries like Pandas and Spark is also highly beneficial for building efficient pipelines.
Data Pipelines ensure a reliable and efficient flow of data, enabling data scientists to focus on analysis and modeling. Without robust pipelines, data scientists spend excessive time on data preparation, hindering project timelines and insights.
Popular tools for Data Pipelines include Apache Kafka, Apache Airflow, and cloud-based services like AWS Glue and Azure Data Factory. The choice depends on factors like data volume, velocity, and the desired level of automation.