Skip LLM Generation: Probe Hidden States for Instant Zero‑Shot Classification
LLM decisions about a prompt already reside in the residual stream before any token is emitted. By extracting the hidden state at the final prompt token and feeding it to a tiny MLP, you can turn any English criterion into an immediate classifier, slashing inference cost and latency. The method works across structural judgments like sarcasm or sentiment shifts.