Decision-Theoretic Safety Assessment of Persona-Driven Multi-Agent Systems in O-RAN

Zeinab Nezami, Syed Ali Raza Zaidi, Maryam Hafeez, Louis Powell, Vara Prasad Talari, Mallik Tatipamula · 2026

Read Decision-Theoretic Safety Assessment of Persona-Driven Multi-Agent Systems in O-RAN by Zeinab Nezami, Syed Ali Raza Zaidi, Maryam Hafeez, Louis Powell, Vara Prasad Talari, Mallik Tatipamula (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-09682.txt.

Introduction

Nezami and five colleagues test persona-driven multi-agent systems for self-run control of Open Radio Access Networks. Five expert agents, planning, coordination, resource allocation, code generation, and analysis, take set personas with priorities, risk tolerance, and decision style. A three-part decision-theory test scores rule-following, guideline fit, and team effects across 486 setups on two optimization tasks. Persona-agent fit shifts solo scores by about 14 percent and shapes teamwork, while retrieval design caps tuning. Single-agent changes ripple system-wide, and some mixes clash.

Catalog record

CREATORZeinab Nezami, Syed Ali Raza Zaidi, Maryam Hafeez, Louis Powell, Vara Prasad Talari, Mallik Tatipamula
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61583
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.09682

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Decision-Theoretic Safety Assessment of Persona-Driven Multi-Agent Systems in O-RAN Zeinab Nezami, Syed Ali Raza Zaidi, Maryam Hafeez, Louis Powell, Vara Prasad Talari, Mallik Tatipamula Abstract Autonomous network management in Open Radio Access Networks requires intelligent decision-making across conflicting objectives, yet existing LLM-based multi-agent systems employ homogeneous strategies and lack systematic pre-deployment validation. We introduce a persona-driven multi-agent framework where configurable behavioral personas—structured specifications encoding optimization priorities, risk tolerance, and decision-making style—influence five specialized agents (planning, coordination, resource allocation, code generation, analysis). To enable rigorous validation, we develop a three-dimensional evaluation framework grounded in decision theory, measuring normative compliance (optimality adherence), prescriptive alignment (behavioral guideline consistency), and behavioral dynamics (emergent system properties). We evaluate 486 persona configurations across two O-RAN optimization challenges (energy-efficient resource allocation and network load balancing). Results demonstrate that persona-agent alignment significantly impacts both individual performance (±14.3% range) and emergent multi-agent coordination, with retrieval architecture (GraphRAG vs. RAG) fundamentally constraining customization effectiveness. Single-agent persona modifications propagate system-wide through cascading effects, with certain combinations exhibiting detectable fundamental incompatibilities. Our framework provides systematic validation mechanisms for deploying LLM-based automation in mission-critical telecommunications infrastructure. I Introduction The Open Radio Access Network (O-RAN) architecture disaggregates traditionally monolithic telecommunications systems into open, interoperable components, enabling intelligent automation through programmable applications (xApps, rApps) running on RAN Intelligent Controllers [ 30 , 6 ] . However, realizing autonomous network management requires context-aware decision-making that balances competing objectives—energy efficiency, quality of service, and load distribution—in highly dynamic environments. Current automation approaches struggle with such multi-objective optimization, often resorting to conservative, one-size-fits-all solutions that fail to exploit O-RAN’s full potential. The stakes for reliable automation are substantial: UK businesses lost £3.7 billion to internet failures in 2023 [ 1 ] , while the European Union Agency for Cybersecurity documented significant telecommunications security incidents in 2024 [ 26 ] , highlighting the critical need for dependable automation in safety-critical infrastructure. Large Language Models (LLMs) demonstrate remarkable capabilities in reasoning, planning, and code generation [ 32 , 9 ] , opening new possibilities for intelligent network automation. However, existing LLM-based multi-agent systems employ homogeneous decision-making strategies that cannot adapt to varying operational priorities [ 45 , 53 ] . Critically, they lack principled methods for customizing agent behavioral profiles and optimization preferences to specific network conditions or roles, and provide no systematic validation frameworks that assess both individual agent performance and emergent system-wide coordination dynamics before deployment in safety-critical infrastructure. We address these limitations through a persona-driven multi-agent framework for autonomous O-RAN network management. Behavioral personas —structured specifications encoding an agent’s optimization priorities, risk tolerance, and decision-making style—systematically influence how five specialized agents (planner, coordinator, resource allocator, code generator, and analyzer) collaboratively approach network optimization tasks. To enable rigorous pre-deployment validation, we develop a decision-theoretic evaluation framework [ 3 ] measuring persona impact across three complementary dimensions: normative compliance (adherence to optimality criteria), prescriptive alignment (guideline consistency), and behavioral dynamics (emergent system properties). Comprehensive evaluation of 486 persona configurations reveals that customization yields highly heterogeneous impacts—performance deltas range from +13.9 % (well-aligned personas) to -14.3 % (misaligned personas)—with single-agent modifications propagating system-wide through cascading coordination effects. This paper makes the following contributions: 1. A persona-driven multi-agent architecture where behavioral personas influence decision-making across five specialized roles, evaluated across task complexity levels and retrieval architectures (RAG vs. GraphRAG). 2. A three-dimensional evaluation framework: (a) normative evaluation revealing Allocator scores collapse 19% on multi-objective tasks while CodeAgent improves 3%, demonstrating retrieval architecture effects; (b) prescriptive evaluation uncovering failure signatures (0.50/0.50/0.50 patterns) indicating systematic persona rejection; (c) behavioral evaluation capturing knowledge expansion, semantic convergence, and code quality progression. 3. Evidence from 486 configurations that retrieval architecture fundamentally shapes behavior: GraphRAG agents show 27% knowledge expansion improvement on complex tasks while RAG agents maintain 40% convergence acceleration, revealing architectural constraints personas cannot overcome. 4. Empirical demonstration of system-wide cascading effects: single persona changes propagate to all agents with system-wide deltas from +6.21 % to -0.74 %, and misalignments degrading 50% of components despite local optimizations. 5. Evidence that persona effectiveness depends on task structure: CodeAgent personas achieve 6% differentiation on generation tasks while PlannerAgent personas show 2.9% impact on planning, indicating role-specific customization limits. 6. Open-source implementation including orchestration, persona system, three-dimensional evaluation pipeline, and all 486 configurations. Our findings reveal critical insights for safety-critical infrastructure deployment: (1) persona-agent alignment influences individual performance and coordination dynamics; (2) retrieval architecture constrains customization effectiveness—GraphRAG excels at multi-objective optimization but suffers semantic drift in negotiations while RAG provides stable convergence but limited expansion; (3) certain combinations exhibit fundamental incompatibilities detectable through evaluation (CreativeThinker-Planner: -14.3 %, FastFailAuditor abandonment); (4) aggressive local optimization degrades system-wide performance through cascading effects. The remainder of this paper is organized as follows. Section II reviews related work. Section III presents system architecture and persona framework. Section IV describes evaluation methodology. Section VI analyzes experimental results. Section VII concludes. II Related Work Generative AI has demonstrated potential in automating telecom tasks including code refactoring [ 15 ] and network configuration [ 18 , 50 ] . While recent work explores generative multi-agent systems (GMAS) for telecom [ 29 , 28 , 35 ] , emphasis has been on benchmarking and automation rather than safety. To our knowledge, no research addresses safety risks in GMAS for telecom through systematic persona matching. We review four strands: (i) GMAS for telecom, (ii) safety challenges in GenAI, (iii) code quality and verification, and (iv) agent evaluation frameworks. Generative Multi-Agent Systems for Telecom. Panek et al. [ 33 ] propose a modular framework for cloud-native 5G networks employing chain-of-thought reasoning. Zou et al. [ 55 ] introduce edge-based multi-model deployment reducing centralized infrastructure reliance. Li et al. [ 22 ] design multi-agent systems for agile telecom workflows with specialized agents handling prompt engineering and resource optimization. Wu et al. [ 49 ] introduce AutoGen for conversational multi-agent coordination. While these studies demonstrate GenAI orchestration feasibility in telecom, none systematically addresses safety risks or behavioral consistency. Recently, Nezami et al. [ 27 ] proposed a safety evaluation framework for cooperative GMAS in telecom, focusing on miscoordination risks shaped by persona diversity, demonstrating progressive improvements in analyzer penalties and agent consistency across iterative runs. However, their work emphasizes safety pathways rather than systematic pre-deployment validation across normative, prescriptive, and behavioral dimensions, leaving a gap in comprehensive multi-dimensional assessment frameworks for mission-critical infrastructure deployment. Safety Challenges in GenAI Systems. Safety concerns span multiple dimensions. Freitas et al. [ 13 ] survey risks including hallucination and misinformation, auditing commercial chatbots. Wang et al. [ 43 ] propose proactive multi-agent reinforcement learning, highlighting safety concerns including high dimensionality and non-stationarity. Bellay et al. [ 4 ] outline risks including instability and incomplete contextual awareness. METR [ 25 ] pioneered systematic assessment of catastrophic risks from autonomous AI, emphasizing independent evaluation before high-stakes deployment. In telecom, [ 19 ] emphasize system-level safety and compositional explainability across heterogeneous models. These studies establish safety importance but focus on single-agent contexts or general MARL rather than mission-critical telecom infrastructure. Code Quality and Verification of LLM Outputs. LLM-generated code quality remains critical. Pearce et al. [ 34 ] found 40% of GitHub Copilot code in security-critical scenarios contained vulnerabilities. Krebs and Mazumdar [ 20 ] found detailed prompts

Read the complete text