Splash roughly doubles Qwen3.8 speed on Apple silicon
Apple-silicon users can run Qwen3.8-27B at 74 tokens per second on short prompts with Splash, roughly twice the speed of the next-fastest engine in Inco’s test. Splash is an open-source inference engine with model-specific GPU kernels and memory planning, plus a DFlash 2 draft model that predicts tokens for the main model to verify. With four requests running together, it reached 170 tokens per second on a 48 GB M5 Pro.