Data Lake, Firehose, Glue, Athena, S3 and AWS SDK for .NET
Build a scalable data lake with AWS! Learn Kinesis Firehose, Glue, S3, Athena & AWS SDK. Data engineering skills for modern analytics.
Course Content
Data Lake, Firehose, Glue, Athena, S3 and AWS SDK for .NET is an all-levels Udemy course taught by Darren Cox. It runs 1h 54m, is taught in English, and includes a certificate of completion. Learners rate it 4.3 out of 5 from 680 reviews, with 3,415 students enrolled. It is a paid course, first published March 2020.
Build a robust Data Lake on AWS with this hands-on course! This practical training uses a series of lab exercises within the AWS Console to demonstrate a complete proof of concept. You'll gain expertise in leveraging key AWS services including Kinesis Data Firehose, AWS Glue, S3, and Athena.
Learn how to securely and automatically ingest data from a local SQL Server database to AWS RDS. We'll utilize the AWS SDK with C# code (.NET SDK) to build this data pipeline. While we focus on .NET, the underlying concepts are easily transferable to other programming languages.
Key topics covered:
- Data Lake Architecture: Understand the components and best practices for building a scalable data lake.
- AWS Kinesis Data Firehose: Learn to efficiently stream data into your data lake.
- AWS Glue: Discover how to automate ETL (Extract, Transform, Load) processes.
- Amazon S3: Master data storage and management in S3.
- Amazon Athena: Query data directly in S3 using SQL.
- AWS SDK (C#): Utilize the AWS SDK for .NET to interact with AWS services.
- Secure Data Ingestion: Implement secure data transfer from on-premises SQL Server to AWS RDS.
- Data Transformation: Learn to transform data for optimal analysis.
- Parquet File Creation: Create and manage efficient Parquet files for optimized storage and querying.
- S3 Data Transfer (Alternative to Firehose): Explore methods for directly transferring data to S3 without using Kinesis Data Firehose.
What you'll get:
- Full Working Source Code: Access complete, runnable code for the entire proof of concept.
- Practical Lab Exercises: Hands-on experience building and deploying your own data lake.
- Transferable Skills: Learn concepts applicable to various programming languages.
Want AI in your product? Hire the team behind TutorialSearch.io
LLM features, RAG, agents and automation wired into a real product — built by the devs who shipped this site.