LodeHQ
AI news for people who shipFree, by email

AI · thinkingmachines.ai · Tuesday, 17 November 2026

NVFP4 cuts training arithmetic, but error decides where it fits

Thinking Machines shows how 4-bit NVFP4 can make training arithmetic up to 6x faster than BF16 on NVIDIA’s GB300, while using 3.6x fewer bits per value. The catch is larger rounding error: the team uses higher-precision formats where repeated errors could disrupt learning, and NVFP4 where speed and memory savings matter more, such as reinforcement-learning sampling. The result is a stage-by-stage precision strategy, not an all-4-bit switch.

Read the source: thinkingmachines.ai ↗In the 17 November issue →