Transformer
The neural network design behind most modern chatbots, which uses attention to weigh which words matter.
For example
The T in GPT stands for Transformer: Generative Pre-trained Transformer.
Related terms
- Threshold The line the total must cross for the neuron to say “yes”.
- Training The whole process of adjusting a model’s weights using examples.
- Training data The examples an AI learns from.
- Underfitting A rule too simple to capture the pattern, even in the training data.
- Unlabelled data Examples with no right answers attached.
- Unsupervised learning Finding patterns without being told the answers.