Scaling Threshold Reveals Reasoning and Truthfulness Switch at 3.5B Parameters
Researchers measured the interaction between reasoning and truthfulness across 63 language models and found a phase transition around 3.5 billion parameters. Below this size the two capabilities anticorrelate, while above it they cooperate, and the transition can be shifted by architecture, data curation, and training tricks. The paper provides a dashboard and predictive tools.