Udemyintermediatezh

Transformer原理与代码精讲(PyTorch)

深度学习新范式

4.3(3)
45students
3h 3m
Certificate
Frank BAI
Frank BAIProfessor

Course Content

Transformer原理与代码精讲(PyTorch) is an intermediate-level Udemy course taught by Frank BAI. It runs 3h 3m, is taught in Chinese, and includes a certificate of completion. Learners rate it 4.3 out of 5 from 3 reviews, with 45 students enrolled. It is a paid course, last updated February 2022.

Explore the revolutionary Transformer architecture, a cornerstone of modern Natural Language Processing (NLP) and rapidly transforming Computer Vision (CV). This course dives deep into the principles and practical implementation of Transformers, equipping you with the knowledge to leverage this powerful deep learning paradigm.

Master the Core Concepts:

  • Attention Mechanism & Self-Attention: Understand the fundamental building blocks of Transformer models.
  • Transformer Architecture Overview: Get a comprehensive understanding of the overall structure.
  • Multi-Head Attention (Encoder): Explore how parallel attention mechanisms enhance performance.
  • Positional Encoding (Encoder): Learn how to incorporate positional information into the model.
  • Residual Connections & Layer Normalization: Discover techniques for stable and efficient training.
  • Feed Forward Network (FFN): Understand the role of the FFN in processing information.
  • Transformer Training & Performance: Delve into the training process and key performance metrics.
  • Machine Translation Workflow: Trace the steps involved in using Transformers for translation tasks.

Hands-on Implementation with PyTorch:

This course provides a detailed, step-by-step walkthrough of Transformer implementation using PyTorch. We'll use Jupyter Notebooks for interactive learning.

  • PyTorch Setup: Learn how to install and configure PyTorch for Transformer development.
  • Encoder Code Breakdown: Analyze the code responsible for processing input sequences.
  • Decoder Code Breakdown: Understand the code that generates output sequences.
  • Hyperparameter Tuning: Explore how to optimize Transformer performance through hyperparameter adjustments.
  • Training Examples (Synthetic Data): See a practical training example using randomly generated data.
  • Training Examples (German-English Translation): Apply Transformers to a real-world machine translation task.

This course is ideal for anyone looking to gain a deep understanding of Transformers and their applications in NLP and CV. You'll gain the skills to build and train your own Transformer models using PyTorch.

$ whoami — the devs behind tutorialsearch.io

Want AI in your product? Hire the team behind TutorialSearch.io

LLM features, RAG, agents and automation wired into a real product — built by the devs who shipped this site.

5.0(81)
38m
beginner
5.0(10)
1h 46m
all

中國針灸學:初階【認識經絡與穴位】

by 駿緯視聽醫學器材股份有限公司 MEDITALENT ENTERPRISES LTD.

5.0(1)
5h 2m
all

中國針灸學-21.針刺補瀉

by 駿緯視聽醫學器材股份有限公司 MEDITALENT ENTERPRISES LTD.

5.0(2)
44m
all