LLMs Still Can’t Invent Zero, Even With Language Pre‑training
A study tests whether GPT‑2‑scale language models can independently infer the mathematical concept of zero. The models fail outright without examples, but after seeing a few dozen instances they learn it, and prior language pre‑training cuts the required examples by roughly half. The result shows language skills can scaffold, yet true mathematical discovery remains out of reach.