Building Batch Data Pipelines on Google Cloud
Master data pipelines for batch processing! Learn when to use Extra-Load, Extract-Load-Transform, or Extract-Transform-Load. Optimize your data workflows.
Course Content
Building Batch Data Pipelines on Google Cloud is an intermediate-level Pluralsight course taught by Google Cloud. It runs 2h 23m, is taught in English, and includes a certificate of completion. It is a paid course, first published June 2022.
Understanding Data Pipelines is crucial for modern data management. This course dives deep into the core concepts of batch data processing and guides you through selecting the right data pipeline paradigm. We'll explore the three main approaches: Extra-Load, Extract-Load-Transform (ELT), and Extract-Transform-Load (ETL), clarifying when each is most appropriate for your specific needs.
You'll gain practical knowledge of powerful Google Cloud technologies for data transformation. We'll cover:
- BigQuery: Leverage Google's fully managed, serverless data warehouse for efficient data transformation and analysis.
- Dataproc: Learn to execute Spark jobs on Google Cloud Dataproc for scalable data processing.
- Cloud Data Fusion: Discover how to build robust data pipelines using visual pipeline graphs in Cloud Data Fusion.
- Dataflow: Explore serverless data processing with Dataflow for building scalable and reliable data pipelines.
Through hands-on labs using Qwiklabs, you'll build real-world data pipeline components on Google Cloud. Master the art of designing, building, and deploying effective data pipelines to unlock the full potential of your data. Learn to choose the optimal ETL or ELT strategy for your batch data workflows.
Want AI in your product? Hire the team behind TutorialSearch.io
LLM features, RAG, agents and automation wired into a real product — built by the devs who shipped this site.