Context window
How much text a model can consider at once, including your conversation and files.
For example
A large context window lets a chatbot read a whole textbook chapter you upload and answer questions about it.
Related terms
- Base model A model after pre-training, before it learns to be an assistant.
- Chatbot An app you can talk or type to, often powered by a language model.
- Context The words before, which help make a better guess.
- Dimension One of the numbers in a vector; one direction on the map.
- Distance How far apart two words are on the map. Small distance, similar meaning.
- Embedding A list of numbers that gives a word (or picture, or sound) an address on a map of meanings.