Here are my contacts

• LinkedIn ( talking about: AI, Quantum, and Physics)
• Beyond Entropy - my Newsletter on Emergent Technologies

Course Outline

• Basics of LLMs, the Attention Mechanism, and the Transformer Architecture
• Autoregressive Generative Language Model: GPT-2
• Continued Pre-training & Fine-tuning Open Source LLMs
• Retrieval Augmented Generation (RAG) and AI Agents
• Evaluate LLMs

Technical Requisites

• A Google/Gmail account for accessing Colab Notebooks

Lecture Material

• Slides: Link here (.pdf version here)
• Lecture 1: The Transformer Architecture
• Lecture 2: Coding GPT-2 step by step
• Lecture 3: Continued Pre-training & Fine-tune Llama on Unsloth