Prompt Regression Hides Failures—A Simple Test Suite Catches Them
Tiny tweaks to a system prompt can silently cripple critical query types, as the author discovered when a negation test collapsed after adding routing instructions. A lightweight Python regression suite runs a set of golden queries and deterministic checks, flagging hidden regressions before they reach users.