Court of LLMs: Evidence-Augmented Generation via Multi-LLM Collaboration for Text-Attributed Graph Anomaly Detection Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia

Yiming Xu, Jiarun Chen, Zhen Peng, Zihan Chen, Qika Lin, Lan Ma, Bin Shi, Bo Dong · 2025

Read Court of LLMs: Evidence-Augmented Generation via Multi-LLM Collaboration for Text-Attributed Graph Anomaly Detection Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia by Yiming Xu, Jiarun Chen, Zhen Peng, Zihan Chen, Qika Lin, Lan Ma, Bin Shi, Bo Dong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-00507.txt.

Introduction

Yiming Xu and co-authors set language models against each other like witnesses in court to catch graph anomalies, in this 2025 paper. Text-attributed graphs, networks whose nodes carry rich text, hide anomalies in both structure and wording. Older detectors read the text with shallow tools and miss semantic clues. A panel of large language models, each arguing from evidence, is the proposed remedy.

One model's claims get checked and enriched by the others, an evidence-augmented process the authors frame as a court. The collaboration aims at verdicts a single model would flub. Fraud, spam, and intrusion detection all run on such graphs, and textual nuance is often exactly where the anomaly hides.

Catalog record

CREATORYiming Xu, Jiarun Chen, Zhen Peng, Zihan Chen, Qika Lin, Lan Ma, Bin Shi, Bo Dong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-00507

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Court of LLMs: Evidence-Augmented Generation via Multi-LLM Collaboration for Text-Attributed Graph Anomaly Detection Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), October 27–31, 2025, Dublin, Ireland DOI: 10.1145/3746027.3754821 ISBN: 979-8-4007-2035-2/2025/10 CCS: Computing methodologies Learning latent representations CCS: Mathematics of computing Graph algorithms Yiming Xu, Jiarun Chen, Zhen Peng, Zihan Chen, Qika Lin, Lan Ma, Bin Shi, Bo Dong Abstract . The natural combination of intricate topological structures and rich textual information in text-attributed graphs (TAGs) opens up a novel perspective for graph anomaly detection (GAD). However, existing GAD methods primarily focus on designing complex optimization objectives within the graph domain, overlooking the complementary value of the textual modality, whose features are often encoded by shallow embedding techniques, such as bag-of-words or skip-gram, so that semantic context related to anomalies may be missed. To unleash the enormous potential of textual modality, large language models (LLMs) have emerged as promising alternatives due to their strong semantic understanding and reasoning capabilities. Nevertheless, their application to TAG anomaly detection remains nascent, and they struggle to encode high-order structural information inherent in graphs due to input length constraints. For high-quality anomaly detection in TAGs, we propose CoLL , a novel framework that combines LLMs and graph neural networks (GNNs) to leverage their complementary strengths. CoLL employs multi-LLM collaboration for evidence-augmented generation to capture anomaly-relevant contexts while delivering human-readable rationales for detected anomalies. Moreover, CoLL integrates a GNN equipped with a gating mechanism to adaptively fuse textual features with evidence while preserving high-order topological information. Extensive experiments demonstrate the superiority of CoLL, achieving an average improvement of 13.37% in AP. This study opens a new avenue for incorporating LLMs in advancing GAD. 1 1 1 The code and data are available at: https://github.com/yimingxu24/CoLL. 1. Introduction Figure 1 . Illustration of our basic idea. The superiority of graph data in capturing complicated interactions between entities has made it widely used in various high-impact domains, such as biomedicine ( Ye et al. 2021 ) , cybersecurity ( Pazho et al. 2023 ) , and tax analysis ( Zheng et al. 2023 ) . As reliability and stability become crucial in these graph-centric applications ( Cheng et al. 2021 ; Zhang et al. 2022a ; Shi et al. 2023 ; Xu et al. 2025b ) , there has been a growing focus on the graph anomaly detection (GAD) ( Ma et al. 2021 ) task, which aims to identify suspicious entities that deviate significantly from normal. In the real world, graph data often goes beyond structural interactions and involves rich textual information. For instance, e-commerce networks include rich raw texts in product names, descriptions, tags, and reviews ( Zhu et al. 2021 ) , while social media platforms encompass user profiles, posts, and comments ( Luo et al. 2017 ) . Such graphs are commonly referred to as text-attributed graphs (TAGs) ( Zhang et al. 2024 ; Yan et al. 2023 ) . Due to the natural involvement of both textual and structural modalities, TAGs offer a more nuanced perspective on anomalies, introducing the emerging challenge of text-attributed graph anomaly detection (TAGAD). While TAGs provide valuable textual signals beyond graph topology, existing efforts have predominantly focused on addressing the challenge of limited anomaly labels in the graph domain ( Liu et al. 2021 ) . To this end, researchers have developed elaborate self-supervised tasks for training graph neural networks (GNNs) to detect anomalies ( Duan et al. 2023 ; Xu et al. 2025a ) . For example, SAMCL ( Hu et al. 2023 ) employs six distinct loss functions to improve detection performance. However, the text information attached to nodes in TAGs rarely receives special attention. Most existing methods encode raw texts as shallow embeddings by multi-hot vector, bag-of-words (BoW) ( Harris 1954 ) or skip-gram ( Mikolov et al. 2013 ) models for use. Despite notable progress, a key issue persists: existing textual feature extraction processes focus on learning general semantic patterns, which are inherently misaligned with the objectives of anomaly detection. As shown in Figure 1 (a), node 126 contains obvious factual errors (wrong birthplace and team name, etc.), but shares the identical BoW encoding as the normal node 824. Since general-purpose encoding cannot expose anomaly-indicative signals hidden in the text semantics, the model struggles to identify subtle contextual irregularities. While fine-tuning general-purpose pretrained language models with anomaly labels might help bridge this gap, the sparsity of anomaly labels and the unbounded, diverse nature of anomalies in graphs ( Ma et al. 2021 ) make it infeasible to train such large models in a reliable and scalable way. Thus, effectively exposing anomaly cues from textual information without relying on labels remains an open challenge. Fortunately, large language models (LLMs) successfully encapsulate extensive knowledge and have demonstrated remarkable capabilities across various knowledge-intensive tasks ( Zhao et al. 2023b ; Yu et al. 2023 ) . Their strong semantic understanding and reasoning abilities open up new opportunities for generating direct, interpretable evidence or conclusion to support anomaly detection, particularly in capturing anomaly-specific contextual knowledge and subtle semantic inconsistencies. Analogous to presenting direct evidence in a courtroom, this approach minimizes distractions from irrelevant background information, allowing for correct and fair judgments ( Morgan and Mannheimer 2008 ; Keane and McKeown 2022 ) , as illustrated in Figure 1 (b). In addition, insights from previous GAD research also emphasize the significance of capturing high-order information within graphs for precise anomaly detection ( Jin et al. 2021 ; Ma et al. 2021 ) . However, directly feeding a node along with its multi-hop neighborhood textual information into an LLM to generate reliable evidence or accurate anomaly predictions faces significant challenges. As the neighborhood expands exponentially, the length and complexity of the associated textual context grow rapidly. Constrained by the limited input context length of LLMs ( Wang et al. 2024 ) and their tendency to lose middle information when accessing long-context inputs ( Liu et al. 2024c ; Firooz et al. 2024 ) , LLMs struggle to encode global high-order structural information ( Zhao et al. 2023a ; Chen et al. 2024 ) , which leads to suboptimal anomaly detection performance. In contrast, GNNs excel at preserving high-order topological structures with high fidelity ( Waikhom and Patgiri 2023 ) , providing a complementary solution to address this limitation. Thus, it seems more sensible to combine the semantic understanding capabilities of LLMs with the topological modeling strengths of GNNs to address the inherent challenges of TAGAD. To achieve high-quality detection capabilities tailored to TAGs, we propose CoLL , a novel framework for TAGAD. As anomalies typically manifest as either contextual or structural ( Ma et al. 2021 ) , CoLL leverages multi-LLM collaboration, where each LLM is assigned a specialized role, to generate evidence from complementary perspectives. In addition, CoLL integrates a gating mechanism and a GNN module to capture global high-order structural information embedded in the graph topology. Specifically, we devise two LLM-driven prosecutors to generate evidence from contextual and structural perspectives. The contextual prosecutor examines the factual accuracy of the textual attributes of a node, while the structural prosecutor assesses the consistency between

Read the complete text