Prediction

Prediction is a visualisation of how language models generate text.

Like the autocomplete feature on your phone or email, a language model predicts what word is most likely to come next based on the words that came before it. This experiment uses a simple predictive system called a Markov Chain and applies it to a selection of books.
In the visualisation:

• Each point represents a unique word from the book.
• The app selects a random word as a starting point.
• One of these words is selected.
• The process repeats, creating a continuous chain of predictions.

Try that yourself, by selecting a different book from the dropdown menu.