LodeHQ
AI news for people who shipFree, by email

AI · arxiv.org · Thursday, 19 November 2026

A trained model observer catches hidden behavior better than transcript checks

A separately trained observer role lets language models answer verifiable questions about hidden behavior, giving safety teams a way to check reward hacking, deception, and sycophancy beyond the visible transcript. In tests, an observer trained on Qwen3.6-27B reached a mean AUROC of 0.907 across five held-out evaluations, beating honesty training at 0.864, transcript monitoring at 0.828, and activation oracles at 0.796. The observer also made the assistant easier to monitor with every baseline method tested.

Read the source: arxiv.org ↗In the 19 November issue →