High-bandwidth memory (HBM)
Very fast memory stacked next to AI chips. Making it uses factory capacity that once made phone memory.
For example
The AI boom's demand for HBM is one reason phone prices rose in 2026.
Related terms
- Compute The computing power needed to train and run AI.
- Data centre A building full of computers that run websites, apps and AI.
- GPU A chip that can do huge numbers of calculations at once; AI uses lots of them.
- Inference Using a trained model to answer questions; a small cost each time, repeated billions of times.
- Latency The delay between asking and getting an answer.
- Server A powerful computer, usually with no screen, that does work for many people over the internet.