Udemyallen

Data Lake, Firehose, Glue, Athena, S3 and AWS SDK for .NET

Build a scalable data lake with AWS! Learn Kinesis Firehose, Glue, S3, Athena & AWS SDK. Data engineering skills for modern analytics.

4.3(680)
3,415students
1h 54m
Certificate
Darren Cox
Darren CoxAWS Certified Solution Architect/Developer & Music lover

Course Content

Data Lake, Firehose, Glue, Athena, S3 and AWS SDK for .NET is an all-levels Udemy course taught by Darren Cox. It runs 1h 54m, is taught in English, and includes a certificate of completion. Learners rate it 4.3 out of 5 from 680 reviews, with 3,415 students enrolled. It is a paid course, first published March 2020.

Build a robust Data Lake on AWS with this hands-on course! This practical training uses a series of lab exercises within the AWS Console to demonstrate a complete proof of concept. You'll gain expertise in leveraging key AWS services including Kinesis Data Firehose, AWS Glue, S3, and Athena.

Learn how to securely and automatically ingest data from a local SQL Server database to AWS RDS. We'll utilize the AWS SDK with C# code (.NET SDK) to build this data pipeline. While we focus on .NET, the underlying concepts are easily transferable to other programming languages.

Key topics covered:

  • Data Lake Architecture: Understand the components and best practices for building a scalable data lake.
  • AWS Kinesis Data Firehose: Learn to efficiently stream data into your data lake.
  • AWS Glue: Discover how to automate ETL (Extract, Transform, Load) processes.
  • Amazon S3: Master data storage and management in S3.
  • Amazon Athena: Query data directly in S3 using SQL.
  • AWS SDK (C#): Utilize the AWS SDK for .NET to interact with AWS services.
  • Secure Data Ingestion: Implement secure data transfer from on-premises SQL Server to AWS RDS.
  • Data Transformation: Learn to transform data for optimal analysis.
  • Parquet File Creation: Create and manage efficient Parquet files for optimized storage and querying.
  • S3 Data Transfer (Alternative to Firehose): Explore methods for directly transferring data to S3 without using Kinesis Data Firehose.

What you'll get:

  • Full Working Source Code: Access complete, runnable code for the entire proof of concept.
  • Practical Lab Exercises: Hands-on experience building and deploying your own data lake.
  • Transferable Skills: Learn concepts applicable to various programming languages.
$ whoami — the devs behind tutorialsearch.io

Want AI in your product? Hire the team behind TutorialSearch.io

LLM features, RAG, agents and automation wired into a real product — built by the devs who shipped this site.

5.0
53m
beginner
pluralsight
5.0
1h 29m
beginner
pluralsight
5.0(766)
2h 58m
intermediate
skillshare