Google’s frozen Multi-Token Prediction slashes Gemini Nano latency on Pixel phones
Google retrofitted its frozen Gemini Nano v3 models with Multi-Token Prediction, letting the phone generate several tokens per forward pass instead of one. The change cuts latency and power use on Pixel 9/10, making on‑device features like notification summaries and proofread feel instant without extra memory‑hungry draft models.