Model Serving & Economics
Mixture of experts
MoE
A model architecture that routes each input through only some specialized sub-networks rather than the entire model.
Example
Only a few specialist components activate for each request in a mixture-of-experts model.
Why people use it
Teams use “Mixture of experts” when they need to balance model quality, reliability, speed, and cost.
What you'll hear
“How does Mixture of experts affect latency, quality, or cost at scale?”