Defensive LLMs Falter at Real‑Time Scam Detection, Study Finds
A new arXiv study builds a 300‑case online‑housing dataset and tests five defensive LLMs in live turn‑by‑turn and static modes. While none outright complied with scams, intervention rates ranged from 0 % to 96 % and models often misidentified the trust‑chain failure, especially around asset‑control. The findings warn safe‑looking behavior isn’t enough – intervention timing and correct structural localization are critical.