Preventative persona steering still changes model refusal behavior
Teams using preventative steering to reduce sycophancy or hallucination should test safety behavior, not just capability: an audit of three models found that the method still changed refusal behavior. The approach adds a persona vector during fine-tuning, then removes it at evaluation, so the trait is never encoded in the weights. The study measured three safety benchmarks alongside trait expression, coherence, and MMLU, and found the refusal change depended on the trait.