LodeHQ
AI news for people who shipFree, by email

AI · lesswrong.com · Sunday, 4 October 2026

Cleaner synthetic training can hide false beliefs inside model representations

False beliefs implanted with synthetic document finetuning can look like ordinary learned knowledge, making a key detection method less reliable for alignment and control research. The method trains models on documents whose synthetic fingerprints are reduced, then tests their middle-layer activations with a linear probe, a simple classifier; some subtly implausible false facts become indistinguishable from pretraining-acquired facts. Eg​​regiously implausible facts remain detectable, and the implanted beliefs do not always carry into downstream reasoning.

Read the source: lesswrong.com ↗In the 4 October issue →