AI tutorials

General

• MLU-EXPLAIN
• Deep Learning is Not So Mysterious or Different
• AI Digest: Interactive AI explainers
• OpenAI Academy
• Evolution of LLMs

Loss Functions

• Understanding Categorical Cross-Entropy Loss, Binary Cross-Entropy Loss, Softmax Loss, Logistic Loss, Focal Loss and all those confusing names

Diffusion

• 2024-06: Step-by-Step Diffusion: An Elementary Tutorial

Transformer

• Low-level:
  • Peter Bloem: Transformers from scratch
  • Brandon Rohrer: Transformers from Scratch
• Wolfram: What Is ChatGPT Doing … and Why Does It Work?
• The Illustrated Transformer
• Transformers Explained Visually — Not Just How, but Why They Work So Well
• Understanding Positional Encoding in Transformers

Visualizations

• LLM Visualization
• Transformer Explainer (paper)
• Phrase completion
• Karpathy: Tiktoken Emoji

LLM

• Toy Models of Superposition
• A Survey on Large Language Models: Applications, Challenges, Limitations, and Practical Usage
• Aman AI: Overview of Large Language Models
• Awesome-LLM: Curated list of LLM projects
• The Big Book of Large Language Models (Damien Benveniste)
• 2025-01: Foundations of Large Language Models

Video

• Andrej Karpathy:
  • How I use LLMs
  • Deep Dive into LLMs like ChatGPT

Prompt Engineering

• 2025-04: Lee Boonstra (Google): Prompt Engineering

Other Visualizations

• A Visual Exploration of Gaussian Processes
• Inside the Matrix: Visualizing Matrix Multiplication, Attention and Beyond
• Neural network training makes beautiful fractals