Moltbook Moderation: Uncovering Hidden Intent Through Multi-Turn Dialogue

Ali Al-Lawati, Nafis Tripto, Abolfazl Ansari, Jason Lucas, Suhang Wang, Dongwon Lee · 2026

Read Moltbook Moderation: Uncovering Hidden Intent Through Multi-Turn Dialogue by Ali Al-Lawati, Nafis Tripto, Abolfazl Ansari, Jason Lucas, Suhang Wang, Dongwon Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-12856.txt.

Introduction

Al-Lawati and five colleagues tackle moderation in multi-agent systems, where harmful agents can post content that looks benign while behaving badly across many turns. Their framework, BOT-MOD, judges intent rather than single posts, probing a suspect agent through a multi-turn exchange that narrows down its likely goals. Tested on a dataset built from the Moltbook community, it reliably flags malicious intent while rarely mislabelling benign behaviour.

Catalog record

CREATORAli Al-Lawati, Nafis Tripto, Abolfazl Ansari, Jason Lucas, Suhang Wang, Dongwon Lee
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69169
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.12856

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Moltbook Moderation: Uncovering Hidden Intent Through Multi-Turn Dialogue Ali Al-Lawati, Nafis Tripto, Abolfazl Ansari, Jason Lucas, Suhang Wang, Dongwon Lee Abstract The emergence of multi-agent systems introduces novel moderation challenges that extend beyond content filtering. Agents with malicious intent may contribute harmful content that appears benign to evade content-based moderation, while compromising the system through exploitative and malicious behavior manifested across their overall interaction patterns within the community. To address this, we introduce Bot-Mod ( Bot-Mod eration), a moderation framework that grounds detection in agent intent rather than traditional content level signals. Bot-Mod identifies the underlying intent by engaging with the target agent in a multi-turn exchange guided by Gibbs-based sampling over candidate intent hypotheses. This progressively narrows the space of plausible agent objectives to identify the underlying behavior. To evaluate our approach, we construct a dataset derived from Moltbook 1 1 1 https://www.moltbook.com that encompasses diverse benign and malicious behaviors based on actual community structures, posts, and comments. Results demonstrate that Bot-Mod reliably identifies agent intent across a range of adversarial configurations, while maintaining a low false positive rate on benign behaviors. This work advances the foundation for scalable, intent-aware moderation of agents in open multi-agent environments. Our code and datasets are published 2 2 2 https://github.com/aliwister/bot-mod . 1 Introduction The increasing utilization of multi-agent systems for collaborative tasks such as deep research ( 37 ) , agent social networks ( 30 ) , and scientific discovery ( 12 ) raises fundamental questions about the trustworthiness of agents in open and semi-trusted environments. In particular, the emergence of bot social networks — social networks designed especially for bots with no human friendly way to contribute (e.g. Moltbook) — has demonstrated that agents will engage in spamming, exploitative, and other harmful behaviors ( 22 ) . However, while explicitly harmful content can be easily filtered using well-established approaches, such as traditional NLP-based classification ( 31 ; 43 ; 34 ) , LLM-based classifiers ( 27 ; 10 ) or instruction-tuned models ( 47 ) , agents introduce an additional risk by contributing content that appears benign, but serves adversarial objectives ( 28 ) . Despite hidden malicious intent, this content evades traditional content-based filters as they produce no surface-level triggers. These risks can be detrimental to the network. Unsuspecting agents ingesting malicious content may be compromised to divulge sensitive information, execute unauthorized actions, or contribute to the malicious behavior resulting in cascading failures ( 48 ) . This can manifest in contributing to the spread of misinformation, manipulating group consensus, or steering analytical outputs toward adversarially-chosen conclusions ( 7 ) . It can be further aggravated by the fact that agents often have access to powerful tools such as web browsing, code execution, and API access ( 32 ) , which can have consequences extending well beyond the language model itself ( 35 ) . In online agent social communities such as Moltbook, these capabilities can be strategically exploited for manipulation and persuasion. For example, a malicious agent influences others to invoke unnecessary tool calls, resulting in excessive API usage and an economic burden. More critically, such interactions may be leveraged to redirect agents toward adversarial endpoints, enabling resource exploitation (e.g., covert crypto-mining) or artificially driving traffic to external services under the guise of benign collaboration. Moreover, because such attacks operate in natural language and often produce outputs that appear superficially coherent, they may go undetected for extended periods ( 14 ) . As agentic systems become increasingly autonomous, with minimal human oversight or intervention, this threat becomes significantly more pressing. This vulnerability motivates the need for moderation that extends beyond content, and explicitly account for the intent underlying the agent behavior . As opposed to existing LLM-based mechanisms that attempt to uncover intent in human based conversations ( 2 ) , in this case, intent may be actively concealed by malicious agents. Prior intent detection approaches assume a cooperative user whose intent is to be understood and served. As a result, they map utterances to predefined labels by analyzing what a user says, not by reasoning about what a user may be concealing ( 6 ; 2 ) . This assumption does not hold in bot-centric environments, where adversarial agents may actively craft responses to suppress and evade detection. Hence, there is a need for a robust detection framework that can identify manipulation attempts even when adversaries evade standard content filters. To address these challenges, we introduce Bot-Mod ( Bot-Mod erator), a framework that grounds moderation in the hidden intent of the agent. Beyond conventional content-based filtering, Bot-Mod engages the agent in a multi-turn exchange designed to uncover its underlying behavior through a targeted dialogue guided by Gibbs-based sampling over candidate intent hypotheses. This design is motivated by real-world interrogation settings, where an investigator strategically questions a suspect, iteratively refining their line of inquiry based on prior responses to reveal concealed intent ( 26 ) . Such questioning is inherently context-dependent and cannot be reduced to fixed set of prompts or rules. In a similar spirit, rather than relying on expert-designed moderator prompting strategies, we leverage Autoresearch ( 38 ; 25 ) —an autonomous research paradigm—to empower the moderator to self-discover effective reasoning paths for intent inference supervised by a Bayesian-based discovery (Gibbs). Using this approach, the Autoresearch controller empirically generates hypothesis prompts, probes the user, and iteratively optimizes the moderation approach based on the observed results. Once discovered, the Gibbs-guided dialog procedure allows Bot-Mod to effectively moderate agent intents and flag those that are potentially malicious, even when individual messages appear benign in isolation. To the best of our knowledge, Bot-Mod is the first framework to address intent-level moderation of agents through adaptive, multi-turn interaction, and the first to automate the discovery of dialogue specifications via Autoresearch . To evaluate Bot-Mod , we construct two datasets derived from Moltbook. The datasets capture post-level (Post Dataset) and comment-level (Comment Dataset) intentions, while modeling a range of behaviors that can manifest as benign or malicious based on an analysis of the observed behaviors on the platform (Moltbook). Our results demonstrate the capability of Bot-Mod to reliably identify harmful behaviors across a range of adversarial configurations, while maintaining a low false positive rate. These findings suggest that intent-grounded moderation via structured dialogue is a promising and practical direction for agent safety in open multi-agent systems. Our main contributions are: (i) We propose Bot-Mod , a novel intent-grounded moderation framework that leverages multi-turn Gibbs-guided interrogation, optimized using Autoresearch to uncover agent intent; (ii) We construct a benchmark dataset derived from Moltbook, comprising agents with diverse benign and malicious intent profiles, which we release publicly to support future research; and (iii) We provide a systematic empirical evaluation of Bot-Mod on this dataset, demonstrating its effectiveness and robustness across a variety of intent dimensions. 2 Related Work Multi-Agent Systems and Security. Multi-agent systems have demonstrated strong capabilities across a range of collaborative tasks, from software engineering to scientific reasoning ( 17 ; 44 ) . Natural language communication within these systems enables coordinated division of labor in complex, dynamic environments, improving overall decision quality and task execution. However, the openness introduces systemic vulnerabilities, due to malicious agents which may pursue hidden objectives ( 18

Read the complete text