Skip to content
conftrace_
2026 EMNLP EMNLP 2026

Forewarned Is Not Forearmed: How Coordinated LLMs Shift Reader Opinions in News Comment Sections

AbstractLarge language models (LLMs) can generate human-like online comments at scale, raising concerns that coordinated AI campaigns could manipulate public opinion. While prior work has shown that single AI messages can persuade individual readers, it remains untested whether coordinated multi-agent LLM campaigns, in which multiple agents jointly plan, divide roles, and manage visibility, can shift reader opinions in news comment sections, and whether per-comment AI labels can mitigate such influence. We address these questions through a controlled experiment with 1,000 U.S. adults reading news articles on a Reddit-like platform. Each participant was randomly assigned to one of six conditions, crossing three comment sources (human, independently generated AI, or coordinated multi-agent LLM) with two label settings (per-comment "Likely AI-generated" badges from a deployed detector, shown or hidden). Coordinated LLM comments did not increase average persuasion over independently generated AI comments, but disproportionately converted readers who initially disagreed and compressed opinion diversity by 12%, manufacturing apparent consensus where genuine disagreement existed. The labels reduced the perceived believability of comments but did not reliably reduce actual opinion change. These findings reveal what we call a Knowing-Resisting dissociation between source recognition and behavioral resistance, and indicate that per-comment disclosure alone is insufficient to counter coordinated LLM opinion campaigns.

More from EMNLP 2026

All EMNLP 2026 papers →