NVFP4 cuts training arithmetic, but error decides where it fits
Thinking Machines shows how 4-bit NVFP4 can make training arithmetic up to 6x faster than BF16 on NVIDIA’s GB300, while using 3.6x fewer bits per value. The catch is larger rounding error: the team uses higher-precision formats where repeated errors could disrupt learning, and NVFP4 where speed and memory savings matter more, such as reinforcement-learning sampling. The result is a stage-by-stage precision strategy, not an all-4-bit switch.