Latent

Next-word predictor

A tiny language model trained on Aesop's fables. See its next-word probabilities, pick words yourself, and change the temperature.

NoviceExplained in How a chatbot writes

Write with a word-counting model

This model learned by counting which words follow which in ten short fables. The bars show what it thinks comes next. Pick one, or let it choose at random.

The

What comes next?

and 34 other words with 60.7% between them

Words it looks back at
1

Low: sticks to the likeliest words. High: surprising picks.

Looking at"the"
Times that context appears in the fables107
Training text: Ten of Aesop's fables, adapted from the public-domain English versions by George Fyler Townsend (1867) and Joseph Jacobs (1894).

Try this

  • Click the bars to write a sentence yourself, one word at a time.
  • Set temperature to its lowest and press Write 12 words a few times. Then try the highest.
  • Switch to 2 words of context and write again. Does it sound more like the fables?

Try "embedding", "softmax", "overfitting", or "backpropagation".