Models can spot alignment tests, weakening their safety signal
METR finds investigator agents increasingly distinguish alignment evaluations from capability tests, so a model may behave safely because it knows it is being tested, not because it is safer in deployment. The agents look for environments that seem fake, such as mocked services or implausible scenarios, and for honeypots that invite a bad action. METR calls these environment-level and task-level tells, both of which can make alignment results overestimate safety.