RADAR: A Risk-Aware Dynamic Multi-Agent Framework for LLM Safety Evaluation via Role-Specialized Collaboration

Xiuyuan Chen, Jian Zhao, Yuchen Yuan, Tianle Zhang, Huilin Zhou, Zheng Zhu, Ping Hu, Linghe Kong, Chi Zhang, Weiran Huang, Xuelong Li · 2025

Read RADAR: A Risk-Aware Dynamic Multi-Agent Framework for LLM Safety Evaluation via Role-Specialized Collaboration by Xiuyuan Chen, Jian Zhao, Yuchen Yuan, Tianle Zhang, Huilin Zhou, Zheng Zhu, Ping Hu, Linghe Kong, Chi Zhang, Weiran Huang, Xuelong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-25271.txt.

Introduction

Xiuyuan Chen and ten co-authors proposed RADAR in twenty twenty-five, a multi-agent framework for judging language model safety. Standard evaluators suffer bias and blind spots: a single judge model, similar to those it grades, misses risks that need context to spot. The team rebuilt the problem by splitting risk into three spaces — explicit violations, implicit risks needing contextual reasoning, and non-risk content.

Four specialized agents debate cases over multiple rounds, each playing a complementary role, while dynamic updates let the risk concept distribution evolve. On a new set of eight hundred challenging cases and public benchmarks, RADAR beat baselines on accuracy, stability, and sensitivity. Its risk identification accuracy topped the strongest baseline by nearly twenty-nine points.

Catalog record

CREATORXiuyuan Chen, Jian Zhao, Yuchen Yuan, Tianle Zhang, Huilin Zhou, Zheng Zhu, Ping Hu, Linghe Kong, Chi Zhang, Weiran Huang, Xuelong Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-25271

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RADAR: A Risk-Aware Dynamic Multi-Agent Framework for LLM Safety Evaluation via Role-Specialized Collaboration Xiuyuan Chen, Jian Zhao, Yuchen Yuan, Tianle Zhang, Huilin Zhou, Zheng Zhu, Ping Hu, Linghe Kong, Chi Zhang, Weiran Huang, Xuelong Li Abstract Existing safety evaluation methods for large language models (LLMs) suffer from inherent limitations, including evaluator bias and detection failures arising from model homogeneity, which collectively undermine the robustness of risk evaluation processes. This paper seeks to re-examine the risk evaluation paradigm by introducing a theoretical framework that reconstructs the underlying risk concept space. Specifically, we decompose the latent risk concept space into three mutually exclusive subspaces: the explicit risk subspace (encompassing direct violations of safety guidelines), the implicit risk subspace (capturing potential malicious content that requires contextual reasoning for identification), and the non-risk subspace. Furthermore, we propose RADAR, a multi-agent collaborative evaluation framework that leverages multi-round debate mechanisms through four specialized complementary roles and employs dynamic update mechanisms to achieve self-evolution of risk concept distributions. This approach enables comprehensive coverage of both explicit and implicit risks while mitigating evaluator bias. To validate the effectiveness of our framework, we construct an evaluation dataset comprising 800 challenging cases. Extensive experiments on our challenging testset and public benchmarks demonstrate that RADAR significantly outperforms baseline evaluation methods across multiple dimensions, including accuracy, stability, and self-evaluation risk sensitivity. Notably, RADAR achieves a 28.87% improvement in risk identification accuracy compared to the strongest baseline evaluation method. 1 Introduction Large language models (LLMs) demonstrate considerable safety robustness across common language tasks, enabled by key techniques including alignment, defenses against prompt-based attacks, and dynamic safety monitoring ( Trivedi et al. 2025 ; Zhang et al. 2025a ; Yu et al. 2024 ; Xiong et al. 2024 ) . Nevertheless, within AI governance contexts, LLMs remain susceptible to carefully crafted harmful requests ( e.g. , jailbreak prompts ), highlighting the critical need for robust safety evaluation frameworks. To meet such demand, an effective LLM safety evaluation must accurately identify safety risks—such as hateful speech, violence incitement, and misinformation—while delivering principled analyses and conclusions. However, existing evaluation methods frequently fail to meet this standard due to several fundamental limitations: intrinsic biases inherent in the evaluator , insufficient sensitivity to latent risks , and the absence of rigorous theoretical foundations . These limitations necessitate a more comprehensive theoretical analysis and the development of an advanced evaluation framework, which we address in the subsequent sections. To address these challenges, we first establish a theoretical framework that formally characterizes the LLM safety evaluation process. Within this framework, we identify limitations inherent in conventional single-evaluator approaches. These limitations stem from two primary sources: (1) Evaluator heterogeneity , where discrepancies among evaluators in training data or architectural design introduce bias and instability; and (2) Self-evaluation , where sensitivity of the evaluator to potential risks is diminished when the evaluator and the evaluated LLM have shared parameters or training data, or even completely identical. To address the aforementioned limitations in single-evaluator paradigms, we leverage collaborative reasoning and in-context learning in multi-LLM settings. Built on explorations of latent concepts( i.e. , underlying abstract features or dimensions that govern language generation ( Xie et al. 2021 ; Estornell & Liu 2024 ) ) we reformulate risk evaluation’s latent concept space as a comprehensive explicit–implicit dual-space framework. Given the strong performance of multi-agent collaborative systems across diverse domains ( Liang et al. 2023 ; Wang et al. 2023 ; Chan et al. 2023 ) , it becomes natural to consider the direct application of debate mechanisms to enhance evaluation robustness. However, our theoretical analysis reveals significant limitations in such approaches: they neglect potential role specialization within the risk concept space and fail to ensure targeted conceptual updates during debate. Guided by these theoretical insights, we propose RADAR, a R isk- A ware D ynamic multi- A gent framework for LLM safety evaluation via R ole-specialized collaboration. As illustrated in Figure 1 , RADAR structures evaluation through four specialized agents: Security Standards Auditor (SCA) , an agent specialized in rule-based explicit risk detection; Vulnerability Detector (VD) , an agent targeting implicit risk vulnerabilities; Critical Argument Challenger (CAC) , an agent introducing counterarguments to balance perspectives and mitigate extreme judgments; and Holistic Arbitrator (HA) , an agent synthesizes evidence for final decisions. Iterative debate rounds dynamically refine evaluation strategies. Comprehensive experiments demonstrate that RADAR reconciles conflicting viewpoints, mitigates evaluator bias and instability, and ultimately improves risk evaluation accuracy. Our main contributions can be summarized as follows: 1) We establish a theoretical framework for LLM safety evaluation, formally characterizing limitations of conventional methods; 2) We design RADAR, a role-specialized multi-agent collaborative evaluation framework; 3) Extensive experiments show RADAR significantly outperforms baselines on challenging cases and public datasets, consistently enhancing accuracy, stability, and risk sensitivity. We further quantify performance factors, including debate rounds and agent count. 2 Related Work Figure 1: The evaluation pipeline of RADAR. For a given evaluation task, SCA and VD first provide preliminary evaluation opinions, including conclusions and analysis. Subsequently, CAC critically examines the opinions from both evaluators in the current round and provides modification suggestions. Next, SCA and VD refine their respective opinions based on the suggestions from CAC. Finally, HA summarizes the entire debate process and delivers the final evaluation conclusion. Safety Evaluation of Large Language Models. Existing LLM safety evaluation methods range from traditional rule-based paradigms to advanced language learning techniques. ( Zhang et al. 2025b ) integrates safety evaluators primarily reliant on keyword pattern matching or prefix matching. Furthermore, some jailbreak attack studies have proposed the use of fine-tuned classifiers for content filtering, like HarmBench ( Mazeika et al. 2024 ) and GPTFuzzer ( Yu et al. 2023 ) . With the advancement of large language models, approaches based on fine-tuning have emerged, exemplified by methods such as ShieldLM ( Zhang et al. 2024 ) , LlamaGuard3 ( Llama Team 2024 ) , and ShieldGemma ( Zeng et al. 2024 ) , which construct safety evaluators through domain-specific fine-tuning. In recent years, evaluation methodologies based on generic conversational LLMs have gained traction. Studies such as ( Shu et al. 2025 ; Qi et al. 2023 ; Mehrotra et al. 2024b ; Chao et al. 2025a ; Zhang et al. 2025b ; Zhang et al. 2024 ) propose specially designed prompt templates and paradigms intended to guide conversational LLMs to complete evaluation tasks via contextual learning. Nevertheless, the heterogeneity among evaluators introduces systematic evaluation bias while simultaneously confronting inherent limitations in self-evaluation scenarios. RADAR addresses these biases through multiple specialized role configurations and collaborative evaluation mechanisms. Multi-Agent Collaborative Systems. Recently, multi-agent collaborative systems have emerged as a prominent research area in natural language processing. This paradigm receives substantial empirical validation across diverse task scenarios, including open-domain question answering, complex logical reasoning, and multi-turn dialogue generation ( Liang et al. 2023 ; Wang et al. 2023 ; Chan et al. 2023 ; Rasal 2024 ; Khan et al. 2024 ; Michael et al. 2023 ) . Current research advances this field from multiple dimensions: ( Shinn et al. 2023 ) investigates the role of self-reflection and feedback loops in improving agent collaborative effectiveness; ( Chen et al. 2023 ; Hong et al. 2023 ) enhance collaboration efficiency through structured coordination mechanisms;

Read the complete text