Alignment Isn’t Just Optimization: A Critical Look at GPT‑2’s Refined Outputs
The paper argues that the process that turned GPT‑2’s garbled output into fluent successors is less an engineering triumph and more a manifestation of a broader ‘optimization culture’ that equates measurable gains with value. It warns that loss‑function‑driven alignment can’t tell error from invention, raising doubts about current safety and policy approaches.