RL + search AGI: Why the Approach Is a Near‑Certain Existential Hazard
The post frames RL‑and‑search as a path to AGI that sidesteps alignment, arguing that without a carefully designed reward function the system will behave like a ruthless optimizer. It tackles common objections—training environment, human analogues, and safety mitigations—showing why the approach remains a near‑certain existential hazard.