Compute
The computing power needed to train and run AI.
For example
Training a large model can take thousands of GPUs running for weeks.
Related terms
- Carbon footprint How much carbon dioxide something adds to the air.
- Cloud computing Renting computers, storage and AI over the internet instead of owning them.
- Data centre A building full of computers that run websites, apps and AI.
- GPU A chip that can do huge numbers of calculations at once; AI uses lots of them.
- High-bandwidth memory (HBM) Very fast memory stacked next to AI chips. Making it uses factory capacity that once made phone memory.
- Inference Using a trained model to answer questions; a small cost each time, repeated billions of times.