TRACE-Bot: Detecting Emerging LLM-Driven Social Bots via Implicit Semantic Representations and AIGC-Enhanced Behavioral Patterns PubID: pubid:
Zhongbo Wang, Zhiyu Lin, Zhu Wang, Haizhou Wang · 2026
Read TRACE-Bot: Detecting Emerging LLM-Driven Social Bots via Implicit Semantic Representations and AIGC-Enhanced Behavioral Patterns PubID: pubid: by Zhongbo Wang, Zhiyu Lin, Zhu Wang, Haizhou Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02147.txt.
Introduction
Wang, Lin, Wang and Wang hunt social bots driven by large language models, whose human like text slips past single signal detectors. Their TRACE-Bot joins two channels: implicit semantic patterns from profiles, interactions and posts, and behavioral patterns sharpened by AI generated content detectors. A light prediction head classifies the fused picture. On two public bot datasets it hits about 98 percent and 97 percent accuracy, holding up well against advanced bot tricks.
Catalog record
| CREATOR | Zhongbo Wang, Zhiyu Lin, Zhu Wang, Haizhou Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52703 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.02147
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TRACE-Bot: Detecting Emerging LLM-Driven Social Bots via Implicit Semantic Representations and AIGC-Enhanced Behavioral Patterns PubID: pubid: Zhongbo Wang, Zhiyu Lin, Zhu Wang, Haizhou Wang Abstract Large Language Model-driven (LLM-driven) social bots pose a growing threat to online discourse by generating human-like content that evades conventional detection. Existing methods suffer from limited detection accuracy due to over-reliance on single-modality signals, insufficient sensitivity to the specific generative patterns of Artificial Intelligence-Generated Content (AIGC), and a failure to adequately model the interplay between linguistic patterns and behavioral dynamics. To address these limitations, we propose TRACE-Bot, a unified dual-channel framework that jointly models implicit semantic representations and AIGC-enhanced behavioral patterns. TRACE-Bot constructs fine-grained representations from heterogeneous sources, including personal information data, interaction behavior data and tweet data. A dual-channel architecture captures linguistic representations via a pretrained language model and behavioral irregularities via multidimensional activity features augmented with signals from state-of-the-art (SOTA) AIGC detectors. The fused representations are then classified through a lightweight prediction head. Experiments on two public LLM-driven social bot datasets demonstrate SOTA performance, achieving accuracies of 98.46% and 97.50%, respectively. The results further indicate strong robustness against advanced bot strategies, highlighting the effectiveness of jointly leveraging implicit semantic representations and AIGC-enhanced behavioral patterns for emerging LLM-driven social bot detection. I Introduction I-A Background With the deep integration of Artificial Intelligence (AI) and social media, public opinion dissemination is shifting from human-driven to human-machine coexistence. Central to this transformation are social bots: automated accounts designed to mimic humans and influence discourse on salient topics [ 1 ] . Empirical studies indicate that 9%-15% of active Twitter accounts exhibit bot-like characteristics [ 2 ] , significantly impacting information dynamics. Recent advances in NLP [ 3 ] and Large Language Models (LLMs) [ 4 , 5 ] have catalyzed LLM-driven social bots [ 6 , 7 ] that dynamically adapt linguistic and behavioral patterns to convincingly emulate humans [ 8 ] . This sophistication invalidates the static features, behavioral stationarity, and linguistic diversity assumptions of conventional detection methods [ 9 , 10 , 11 ] , causing notable performance degradation in SOTA models [ 12 , 13 ] . Consequently, robust paradigms explicitly modeling the adaptive and temporally evolving nature of these bots are urgently needed. I-B Related Work Existing social bot detection methods can be divided into two categories based on the underlying generation mechanisms of the bots: traditional social bot detection methods and LLM-driven social bot detection methods. Traditional social bot detection has evolved from early rule-based or heuristic methods relying on behavioral or account indicators [ 14 , 15 , 16 , 17 ] to Machine Learning (ML) techniques [ 1 , 18 , 19 , 20 , 21 ] . More recently, Deep Learning (DL) and neural network-based methods [ 22 , 23 , 24 , 25 , 26 ] have shifted focus toward automatic representation learning from raw textual, behavioral, and graph data, significantly reducing the need for manual feature engineering. Building on this, LLMs-based methods [ 27 , 28 , 29 ] now leverage advanced contextual reasoning to enhance performance in adversarial settings. Conversely, LLM-driven social bots generate highly human-like content with adaptive interaction strategies, posing severe challenges to current detectors. Most existing methods rely heavily on linguistic patterns or isolated content features, lacking effective fusion of heterogeneous multimodal data and failing to jointly model textual semantics and behavioral dynamics. Consequently, these approaches struggle to distinguish LLM-driven social bots from authentic users, leading to degraded accuracy. Addressing these limitations necessitates novel paradigms specifically tailored for LLM-driven social bots to ensure the security and trustworthiness of digital ecosystems. I-C Challenges In recent years, research on social bots has primarily focused on traditional social bots, while studies on detecting the new generation LLM-driven social bots are relatively scarce and face several challenges as follows: First, they exhibit limited capability in modeling and effectively fusing heterogeneous multimodal information. Most methods rely on unimodal inputs (e.g., text or behavior alone) or adopt simplistic fusion strategies, failing to capture the complex interplay between non-human semantics and LLM-generated behavioral patterns. Second, current models primarily focus on surface-level textual or statistical behavioral features and lack sensitivity to intrinsic AIGC characteristics, such as generation regularities, distributional biases, and latent semantic traces introduced by LLMs. Third, semantic representations and behavioral patterns are often modeled independently, ignoring their intrinsic correlations. This decoupled paradigm hinders the alignment of implicit semantic representations with behavioral signatures, thereby limiting detection performance in LLM-driven social bot scenarios. I-D Contributions To address the aforementioned challenges in detecting LLM-driven social bots, this study proposes a novel detection framework named TRACE-Bot, which integrates implicit semantic representations and AIGC-enhanced behavioral patterns within a unified dual-channel architecture. The main contributions of this study are summarized as follows: • To overcome limitations in fusing heterogeneous multimodal data, we propose a novel feature processing approach tailored for LLM-driven bots. By integrating personal information data, interaction behavior data, and tweet data, our method improves feature-level detection accuracy and precision by approximately 0.4%. • To address the insensitivity of existing features to AIGC patterns, we construct AIGC-enhanced behavioral patterns by integrating SOTA detectors, enabling efficient identification of LLM-driven social bots. To the best of our knowledge, this is the first work leveraging AIGC detection for social bot detection. • We propose a behavior sequence construction method that integrates multidimensional interaction features into time-structured sequences. These sequences characterize bot patterns in operational modes, activity rhythms, and interaction strategies, enabling precise differentiation between automated accounts and human users. • To overcome the limitation of decoupled text-behavior modeling, we propose a dual-channel collaborative framework. It jointly integrates features: a GPT-2-based text channel captures linguistic style and coherence, while an MLP-based behavior channel mines anomalous patterns and LLMs traces from normalized features. Experiments show a peak accuracy of 98.46% in detecting LLM-driven social bots. To the best of our knowledge, this is the first work exploring text-behavior dual-channel fusion for social bot detection. I-E Organization The remainder of this paper is organized as follows: Section II reviews related work; Section III details the TRACE-Bot architecture; Section IV describes the experimental design, implementation, and results analysis; Section V discusses limitations; Section VI outlines future directions; and Section VII concludes with key findings and contributions. II RELATED WORK II-A Rule-based or Simple Heuristic Methods Early studies employed rule-based or simple heuristic methods exploiting observable patterns via four key features. Account metadata (e.g., creation time, follower ratios) reveals abnormal bot lifespans [ 14 ] . Activity levels detect high-frequency interactions, achieving up to 70% social bot detection accuracy [ 15 ] . Content characteristics identify repetitive, template-like structures with limited vocabulary [ 16 ] . Network-level features capture dense clustering and low reciprocity [ 17 ] . Rule-based or heuristic methods rely on predefined thresholds and manually designed rules, offering advantages in simplicity and computational efficiency. However, as social bots increasingly mimic human behaviors, the differences between bots and human users become subtle and intentionally concealed. Consequently, approaches based on static features and fixed rules are easily evaded and exhibit limited generalization ability, resulting in reduced detection performance against advanced social bots. II-B Machine Learning-based Methods Compared with rule-based or heuristic methods, ML-based methods improve detection accuracy and flexibility by