LLM-Based Bot Broadens the Range of Arguments in Online Discussions, Even When Transparently Disclosed as AI

Valeria Vuk, Cristina Sarasua, Fabrizio Gilardi · 2025

Read LLM-Based Bot Broadens the Range of Arguments in Online Discussions, Even When Transparently Disclosed as AI by Valeria Vuk, Cristina Sarasua, Fabrizio Gilardi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-17073.txt.

Introduction

Valeria Vuk, Cristina Sarasua, and Fabrizio Gilardi test an AI bot in online debate in a 2025 study. Town talk online oft narrows to one camp's views. Their bot reads the chat, spots missed points, and drops them in. Two set trials ran in a chat room. The bot's acts faced counts of point span, hard and felt. Its AI tag was shown in plain sight.

The bot widened point span by both counts with clear force. The AI tag did not blunt that gain. Folk took in points from a known bot much as from a hid one. The authors pitch such bots as fair guards for town talk.

Catalog record

CREATORValeria Vuk, Cristina Sarasua, Fabrizio Gilardi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE86 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-17073

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLM-Based Bot Broadens the Range of Arguments in Online Discussions, Even When Transparently Disclosed as AI Valeria Vuk, Cristina Sarasua, Fabrizio Gilardi Abstract A wide range of participation is essential for democracy, as it helps prevent the dominance of extreme views, erosion of legitimacy, and political polarization. However, engagement in online political discussions often features a limited spectrum of views due to high levels of self-selection and the tendency of online platforms to facilitate exchanges primarily among like-minded individuals. This study examines whether an LLM-based bot can widen the scope of perspectives expressed by participants in online discussions through two pre-registered randomized experiments conducted in a chatroom. We evaluate the impact of a bot that actively monitors discussions, identifies missing arguments, and introduces them into the conversation. The results indicate that our bot significantly expands the range of arguments, as measured by both objective and subjective metrics. Furthermore, disclosure of the bot as AI does not significantly alter these effects. These findings suggest that LLM-based moderation tools can positively influence online political discourse. Introduction Broad participation is a cornerstone of democracy, ensuring that many different voices and interests are reflected in political processes. While decision-making processes that allow direct citizen participation often enjoy greater legitimacy [ 1 , 2 ] , their democratic value depends on the consideration of a wide range of perspectives [ 3 , 4 ] . Digital platforms have the potential to reduce barriers to participation by enabling individuals to engage in discussions anytime and from anywhere. However, disparities in interest, skills, and available time, often linked to socio-economic status, mean that some individuals are less likely than others to engage in political activities on social media, online forums, or e-participation platforms [ 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 ] . Digital platforms often reinforce homogeneity by encouraging interactions among like-minded individuals [ 15 , 16 ] and prioritizing content aligned with existing beliefs [ 17 ] . As a result, online discussions may exhibit a limited range of perspectives, which can increase polarization [ 18 , 19 , 20 ] . These dynamics pose challenges for a healthy democracy. A limited range of perspectives in online discussions can be addressed through various mechanisms, such as ensuring a representative selection of participants [ 11 , 21 ] , encouraging less enthusiastic participants to contribute [ 22 ] , or structuring discussions to ensure balanced participation [ 23 ] . However, no automated approach currently exists for online discussions that accounts for the strong self-selection bias in political discourse. Consequently, recruitment strategies alone are insufficient, and moderators cannot fully compensate for the absence of underrepresented perspectives. Large Language Models (LLMs) offer new opportunities to improve discourse on digital platforms [ 24 ] . Previous research has shown that integrating conversational agents into online debates can significantly enhance women’s participation [ 25 ] . Integrating AI chat assistants suggesting context-aware rephrasings into online political discussions can significantly enhance perceived conversation quality and democratic reciprocity [ 26 ] . When used as a mediator in deliberative settings, AI tools can help groups find common ground [ 27 ] . Building on these studies, we propose ArgumentBot, an LLM-based argument moderator designed to identify and introduce missing arguments into online discussions, thereby broadening the range of perspectives participants are exposed to and potentially engage with. We focus on whether AI should be used in healthcare because it is timely, elicits diverse benefit–risk arguments, and remains open enough for participants to consider unfamiliar perspectives. The bot works with a list of relevant arguments that we compiled. To ensure comprehensiveness, while acknowledging that no list can be entirely exhaustive, we consulted 66 experts from politics, academia, and civil society (e.g., NGOs and civic tech organizations) across Europe. These experts responded to a curated survey with open-ended questions on the use of AI in healthcare. Their responses were independently coded by two co-authors of this paper to identify distinct arguments. The full list of arguments is available in the supplementary material (table S1). Figure 1: ArgumentBot at work. It monitors discussions, identifies missing arguments, and introduces them into the conversation, without explicitly prompting participants to respond. Figure 1 illustrates how ArgumentBot works in practice. At predefined intervals (2, 5, and 8 minutes) during the discussion, the ongoing conversation is compared to the compiled list of arguments using an LLM. The model identifies missing arguments and randomly selects one to introduce. ArgumentBot then presents the selected argument with the statement “Have you considered [argument]?” followed by a brief explanation prepared by the same two co-authors who coded the survey responses. The exact prompt used for the LLM interaction is provided in the supplementary material (supplementary text). Importantly, ArgumentBot introduces the arguments into the conversation without explicitly prompting participants to respond to them. To evaluate ArgumentBot’s impact on the discussions, we conducted two pre-registered randomized controlled experiments (N = 1,786 and N = 2,611) in which participants engaged in 10-minute group discussions with three or four other participants, with or without ArgumentBot’s intervention. ArgumentBot was presented in different roles (regular participant, moderator, AI participant, or AI moderator) to assess how its role and labeling influenced discussion dynamics. We preregistered three key hypotheses, slightly rephrased here without affecting methodology, analyses, or findings. First, we argue that ArgumentBot broadens the range of arguments expressed in the discussion. This does not refer to the overall variety of arguments within a discussion, but more specifically to the unique arguments that participants engage with, either by introducing them or responding to them. Mooreover, ArgumentBot may amplify underrepresented perspectives. In group discussions, dominant voices often shape the conversation, while those who perceive themselves as holding minority views tend to remain silent [ 28 , 29 ] . While our study does not focus on specific mechanisms, we expect ArgumentBot’s intervention to expand the range of arguments participants engage with. Therefore, our first and main hypothesis is: H1: ArgumentBot increases the number of unique arguments mentioned by participants in the treatment groups compared to those in the control group. Second, we posit that introducing previously absent arguments can increase the extent to which all participants contribute with similar frequency to the discussion. This claim builds on research on minority opinions, particularly the peer-pressure experiment [ 29 ] and the spiral of silence theory [ 28 ] . The classic peer-pressure experiment showed that participants often conformed to a unanimous but clearly incorrect majority. However, the presence of even one dissenter significantly reduced conformity [ 29 ] . The spiral of silence theory builds on the idea people are more likely to express their views when they perceive them as widely shared, and more likely to stay silent when they feel in the minority, which creates a self-reinforcing dominance of one view. Introducing dissent can disrupt this dynamic by legitimizing alternative perspectives and encouraging broader participation [ 28 ] . Therefore, introducing new arguments could promote more balanced participation: H2: ArgumentBot leads to more balanced participation among participants in the treatment groups compared to the control group. Third, we contend that introducing missing arguments might make the debate feel more

Read the complete text