LLMs are more receptive to left-leaning users across nearly 150,000 debate chats
The authors rebuilt 5,376 online debates as LLM conversations and ran nearly 150,000 controlled multi-turn chats varying users' politics, expertise, argument style and position. Models were systematically more receptive to left-leaning than right-leaning users, even when both defended the same position or argued in the same conversation. The pattern appeared across multiple models but is not fixed: fine-tuning on different political corpora can largely erase or reverse it.