Skip to content

Infrastructure & Compute

Caching

Saving previously computed data or responses so they can be reused quickly.

Example

Frequently reused model results are cached instead of recomputed.

Why people use it

Teams use “Caching” when they need to plan the hardware and services needed to run AI.

What you'll hear

“What does Caching mean for the infrastructure we need?”

Related terms