Transformer and Attention Mechanism
Master the foundations of Transformers and attention mechanisms to power AI applications. Understand tokenization, embeddings, and self-attention to enhance your AI skills.
Introduction
Learning Objectives
Introduction
Strengths and Weaknesses in LLMs
Discriminative vs. Generative AI
Quiz
Introduction
Transformers
Embeddings
Attention
Quiz
Introduction
Similarity
Keys and Queries Matrices
Multi Head Attention
Attention Mechanism
Quiz
Introduction
Feedforward Neural Networks
Types of Neural Networks
Quiz
Introduction
Softmax
Tokenization
Positional Encoding
Quiz