Rater Stress Skews RLHF Preferences, New Audit Framework Exposes Bias
The authors reveal that pairwise preference labels in RLHF can encode raters' stress or fatigue instead of actual output quality, creating a structured bias that survives aggregation. They introduce a testable hypothesis and an audit protocol to detect, measure, and mitigate this rater state bias in preference datasets.