Attention
The part of a transformer that lets each word look at the other words that matter for its meaning.
For example
In "I sat on the bank of the river", attention links "bank" to "river", not to money.
Related terms
- Anomaly Something that doesn’t fit the usual pattern.
- Artificial neuron A tiny calculator that multiplies its inputs by weights, adds them, and decides.
- Backpropagation The method networks use to work out the slope for every weight at once.
- Classifier An AI that sorts things into groups, like wet or dry.
- Clustering Putting similar things into groups.
- Confidence How sure a model says it is about an answer.