Skip to content

Infrastructure & Compute

Accelerator

Specialized hardware designed to speed up computationally intensive workloads such as AI.

Example

A team adds an accelerator to reduce the time needed for model inference.

Why it matters

It can reduce the time or energy needed for suitable repeated calculations.

You'll hear it

“This accelerator helps only if our software can use it.”

Can you control it?

Set by the team

The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.

Common questions

Does accelerator mean the same device in every product?
No. Different hardware designs target different kinds of work.
Can moving data limit the benefit?
Yes. Fast calculation may still wait for information to arrive.
Can a task become slower despite added hardware?
It can if transfer or coordination overhead outweighs the accelerated work.

AI chatbot

Still have questions?

Ask the AI chatbot about this term or another AI concept.

Up to 500 characters.

Ask LATHIC about AI. Relevant glossary entries may be included.

Your question, the glossary entries it matches, and a rotating pseudonymous identifier go to Microsoft Azure’s OpenAI service through Vercel AI Gateway to generate an answer. Zero retention and no training are required of the provider, and LATHIC does not save your question or answer. Privacy Notice