Neural Networks + LLM Foundations

Morning Outline: Neural Networks

• Computational Graphs
• Non-Linearities (Sigmoid, ReLU, Tanh)
• Automatic Differentiation in PyTorch
• slides

Afternoon Outline: Language Models & Transformers

• Text generation as Iterative Classification
• Transformer Architecture (attention-based models)
• Benefits of Self-Attention
• slides

Lab Activity

The afternoon activity is LLM Foundations Lab.