Base model
A model after pre-training, before it learns to be an assistant.
Learn it through a story
- How a Chatbot Goes to School (Jugnupur Tales Vol 2, Ch 5)
Short on time? Read the 5-minute version.
Related terms
- AI watermark A visible label or hidden signal showing that content was made with AI.
- Chatbot An app you can talk or type to, often powered by a language model.
- Context The words before, which help make a better guess.
- Context window How much text a model can consider at once, including your conversation and files.
- Dimension One of the numbers in a vector; one direction on the map.
- Distance How far apart two words are on the map. Small distance, similar meaning.