Skip to content

Infrastructure & Compute

Distributed training

Training a model using multiple processors or machines working together.

Example

Hundreds of machines coordinate one training run and exchange updates.

Why people use it

Knowing how “Distributed training” works helps teams plan the hardware and services needed to run AI.

What you'll hear

“What does Distributed training mean for the infrastructure we need?”

Related terms