Cerebras says splitting inference cuts power per token fivefold
Cerebras’ production disaggregated inference setup delivers five times more tokens per megawatt at the company’s ultrafast speeds, giving inference providers more capacity from the same power budget. GPUs process the prompt, or prefill, while Cerebras systems generate the response, or decode. That split matches each stage to different hardware and is now available through Cerebras Inference Cloud and to infrastructure partners.