Tracks

Eight tracks take you from no background to how large language models work inside. Follow the route in order, or start wherever matches what you already know.

40 lessons, about 10 hr 45 min in all. Not sure where to start?

  1. Novice7 lessons, 1 hr 37 min

    AI from zero

    What AI is, how it learns from examples, and how a chatbot picks its next word.

    Start with What is AI, really?

  2. Beginner8 lessons, 2 hr 8 min

    How machines learn

    Loss, gradients, and generalization: the loop behind every trained model.

    Start with The learning loop

  3. Intermediate6 lessons, 1 hr 38 min

    Neural networks

    Neurons, layers, and backpropagation, built up one piece at a time.

    Builds on How machines learn

    Start with Layers are matrix multiplications

    Intermediate6 lessons, 1 hr 32 min

    Language as vectors

    Tokens, embeddings, and similarity: how text becomes geometry.

    Builds on How machines learn

    Start with Tokens

  4. Advanced8 lessons, 2 hr 21 min

    Transformers and LLMs

    Attention, the transformer block, and how large language models are trained.

    Builds on Neural networks and Language as vectors

    Start with Predicting the next token

    IntermediateComing soon

    Learning by trial and error

    Rewards, exploration, and how agents learn to act, from bandits to RLHF.

    Builds on How machines learn and Neural networks

  5. AdvancedComing soon

    Inside the model

    Look inside a real language model, watch circuits form, and steer what it says.

    Builds on Transformers and LLMs

    Advanced5 lessons, 1 hr 29 min

    Frontiers

    Diffusion, multimodal models, agents, and reasoning.

    Builds on Transformers and LLMs

    Start with Diffusion: from noise to data

Try "embedding", "softmax", "overfitting", or "backpropagation".