LodeHQ
AI news for people who shipFree, by email

AI · cerebras.ai · Thursday, 19 November 2026

Cerebras says splitting inference cuts power per token fivefold

Cerebras’ production disaggregated inference setup delivers five times more tokens per megawatt at the company’s ultrafast speeds, giving inference providers more capacity from the same power budget. GPUs process the prompt, or prefill, while Cerebras systems generate the response, or decode. That split matches each stage to different hardware and is now available through Cerebras Inference Cloud and to infrastructure partners.

Read the source: cerebras.ai ↗In the 19 November issue →