A trained model observer catches hidden behavior better than transcript checks
A separately trained observer role lets language models answer verifiable questions about hidden behavior, giving safety teams a way to check reward hacking, deception, and sycophancy beyond the visible transcript. In tests, an observer trained on Qwen3.6-27B reached a mean AUROC of 0.907 across five held-out evaluations, beating honesty training at 0.864, transcript monitoring at 0.828, and activation oracles at 0.796. The observer also made the assistant easier to monitor with every baseline method tested.