Latent

A tiny neural network

Train a network with one hidden layer on curved data and watch several straight lines combine into a curved boundary.

NoviceExplained in Networks of neurons

A tiny neural network

Two inputs, a layer of hidden neurons, and an output. Train it and watch the shading: one neuron can only draw a straight line, but several together can bend.

Hidden neurons
Data
Training steps0
Lossn/a
Points classified correctly0%
Numbers the network learns7

Try this

  • Train with 1 hidden neuron on Circle, then with 4. How many lines does it take to surround the middle?
  • Try XOR with 2 hidden neurons, then with 3 or 4.
  • Turn off the lines and watch only the shading while it trains.

Try "embedding", "softmax", "overfitting", or "backpropagation".