Skip to content

Infrastructure & Compute

Cluster

A group of connected computers or accelerators working together.

Example

A cluster combines many machines to train or serve a large model.

Why it matters

It combines resources when one machine is insufficient or shared operation is useful.

You'll hear it

“One machine failed, but the rest of the group is still working.”

Can you control it?

Set by the team

The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.

Common questions

Does adding machines always improve speed?
No. Communication and coordination can reduce the benefit.
Can a shared dependency affect the whole cluster?
Yes. Common storage, networking or control services can create wider failures.
Must every machine be identical?
Not necessarily. Some setups combine machines with different roles or capabilities.

AI chatbot

Still have questions?

Ask the AI chatbot about this term or another AI concept.

Up to 500 characters.

Ask LATHIC about AI. Relevant glossary entries may be included.

Your question, the glossary entries it matches, and a rotating pseudonymous identifier go to Microsoft Azure’s OpenAI service through Vercel AI Gateway to generate an answer. Zero retention and no training are required of the provider, and LATHIC does not save your question or answer. Privacy Notice