Infrastructure & Compute
Memory bandwidth
How quickly data can move between memory and a processor.
Example
Limited memory bandwidth slows inference even though the processor can calculate faster.
Why people use it
Understanding “Memory bandwidth” helps teams plan the hardware and services needed to run AI.
What you'll hear
“What does Memory bandwidth mean for the infrastructure we need?”