Anthropic’s robots.txt blunder let Claude chats surface in Google
Anthropic blocked its shared Claude chat URLs with a robots.txt disallow, not a noindex tag, and Google still indexed the links. The mistake surfaced real‑world data leaks—from crypto keys to confidential résumés—showing that disallow merely hides content from crawlers, it doesn’t stop URLs from appearing in search results.