Infrastructure & Compute
Sharding
Splitting model parameters or data across multiple devices or machines.
Example
A model too large for one GPU is divided across several devices.
Why people use it
Teams use “Sharding” when they need to plan the hardware and services needed to run AI.
What you'll hear
“What does Sharding mean for the infrastructure we need?”