Token
A small piece of text, a word or part of a word, that a language model reads and writes.
For example
"Unbelievable" may be split into tokens like "un", "believ" and "able". AI prices are often counted per million tokens.
Related terms
- Retrieval-augmented generation (RAG) The AI first looks up trusted documents, then answers using what it found.
- Semantic search Searching by meaning instead of exact words.
- System prompt Hidden instructions an app gives the AI before your message, setting its role and rules.
- Temperature A setting that controls how random or creative a model's answers are.
- Vector A list of numbers, like (14, 16). Also an arrow with a length and direction.
- Verify To check that something is true.