Infrastructure & Compute
AI energy consumption
The energy used to develop, train or operate AI systems.
Example
A team measures electricity consumed during an AI system training run.
Why people use it
It helps teams understand the electricity needed to provide an AI service.
What you'll hear
“How much electricity does this task use?”
What this means for you
Ask what an energy estimate includes before comparing services.
Can you control it?
No
No direct control. This describes a wider issue, concept or result rather than something you can simply switch on or off in a tool.
Common questions
- Can a shared service use energy while waiting for requests?
- Yes. Keeping equipment available can use power even when it is not actively answering your question.
- Does training use all the energy?
- No. Running the service afterward also uses electricity, potentially across many requests.
- Can a shorter answer use less energy?
- Often, but the size of the AI system and how it runs also matter.