Study Finds LLM Political Bias Varies by Measurement Method, Not Consistently Left-Leaning
A new arXiv preprint examines political bias in large language models (LLMs) using both abstract policy questionnaires and real-world Swiss referenda. The study finds that while LLMs appear left-leaning on surveys, their responses to actual referenda are more centrist and sometimes show a general aversion to change rather than a clear left-right bias. The language in which questions are posed can also significantly affect model responses.
Why it matters: This suggests that previous claims of consistent leftward bias in LLMs may not generalize to real-world decision contexts, raising questions about how AI political alignment should be measured and interpreted.
Full story at: arXiv Computers and Society ↗