Who Sees the Risk? Stakeholder Conflicts and Explanatory Policies in LLM-based Risk Assessment
Srishti Yadav, Jasmina Gajcin, Erik Miehling, Elizabeth Daly · 2025
Read Who Sees the Risk? Stakeholder Conflicts and Explanatory Policies in LLM-based Risk Assessment by Srishti Yadav, Jasmina Gajcin, Erik Miehling, Elizabeth Daly (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-03152.txt.
Introduction
Srishti Yadav, Jasmina Gajcin, Erik Miehling, and Elizabeth Daly ask whose view of risk should count when an AI system is judged. A doctor, a patient, and a regulator may rate the same medical AI very differently. Their 2025 framework uses language models as judges grounded in each stakeholder's stance, drawing on the Risk Atlas Nexus and an explanation method called GloVE to produce readable, stakeholder-specific policies.
Three real cases, medical AI, self-driving cars, and fraud detection, show the method at work. An interactive visualization then lays out where and why stakeholder views clash. The team finds that perspective strongly shapes both risk ratings and conflict patterns. Their pitch is governance-facing: risk tools should show their disagreements, not average them away.
Catalog record
| CREATOR | Srishti Yadav, Jasmina Gajcin, Erik Miehling, Elizabeth Daly |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-03152
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Who Sees the Risk? Stakeholder Conflicts and Explanatory Policies in LLM-based Risk Assessment Srishti Yadav, Jasmina Gajcin, Erik Miehling, Elizabeth Daly Abstract Understanding how different stakeholders perceive risks in AI systems is essential for their responsible deployment. This paper presents a framework for stakeholder-grounded risk assessment by using LLMs, acting as judges to predict and explain risks. Using the Risk Atlas Nexus and GloVE explanation method, our framework generates stakeholder-specific, interpretable policies that shows how different stakeholders agree or disagree about the same risks. We demonstrate our method using three real-world AI use cases of medical AI, autonomous vehicles, and fraud detection domain. We further propose an interactive visualization that reveals how and why conflicts emerge across stakeholder perspectives, enhancing transparency in conflict reasoning. Our results show that stakeholder perspectives significantly influence risk perception and conflict patterns. Our work emphasizes the importance of these stakeholder-aware explanations needed to make LLM-based evaluations more transparent, interpretable, and aligned with human-centered AI governance goals. Introduction In recent years, unprecedented deployment of large language models (LLMs) has raised concerns about reliability, explainability and safety of these models in real world usecases. The need for responsible use of these models has led to increased interest in governance of AI models which encompasses standardized principles and evaluations to ensure that the AI systems behave reliably, robustly and reflect societal values. In order to address safety concerns, the research community has developed specialized safety benchmarks like SafetyBench ( 22 ) , HarmBench ( 11 ) , SG-Bench ( 15 ) to evaluate models for harmful behaviors such as toxicity, hallucination, or misuse. Figure 1: Overview of our stakeholder-centered AI risk assessment pipeline. The use case (“AI medical diagnosis assistant that determines if someone needs surgery”) generates relevant stakeholders such as doctors, patients etc.. Each stakeholder undergoes a risk assessment that produces individual risk profiles (e.g., harmful output, data bias, unexplainable output). The GloVE component then generates conflict explanations, showing the conflicts that emerge between stakeholders’ risk perspectives In order to bring structure and guidance when considering risks, several taxonomies and frameworks have emerged such as the Top 10 for LLMs and Generative AI Apps ( 18 ) , the NIST AI Risk Management Framework ( 17 ) , the MIT AI Risk Repository ( 13 ; 19 ) , and IBM Risk Atlas Nexus ( 1 ) . These risk frameworks can help link risks to inform governance mechanisms. Recent works have explored the use of LLMs take into account the use case context in order to prioritise which risks are most related to the AI system ( 6 ; 16 ; 3 ) . However, most existing approaches remain stakeholder-agnostic, overlooking the nuanced ways in which different stakeholders may perceive and prioritize risks which is an essential concern for responsible governance. This gap limits the effectiveness of governance tools in multi-stakeholder environments. We propose leveraging stakeholder specific personas as part of the risk prioritisation process. By considering our framework on stakeholder perspectives, our approach reveals points of alignment and disagreement on risk assessment across stakeholders for a given AI use case. This enables more context-sensitive governance decisions and supports inclusive risk mitigation planning. We generate explanations for stakeholder conflicts using the GloVE pipeline ( 7 ) that allows for a more transparent and context-sensitive interpretation of LLM-as-a-Judge behaviors helping bridge the gap between model understanding and human-centered risk understanding. In our paper, we make the following contributions: 1. We propose a stakeholder driven policy explanation pipeline to observe the policy conflicts that emerge with different stakeholders using rule-based explanations. 2. We identify and explain how stakeholder conflicts emerge on three real-world AI usecases to demonstrate the practicality of the framework. 3. We propose a tool for visualizing and interpreting these emerged conflicts. Literature Review Persona in LLMs Assigning distinct personas to LLMs has emerged as a method to elicit different behaviours across tasks, showing that outputs vary under different assumed identities. For example, PersonaLLM ( 9 ) showed that GPT-3.5 and GPT-4, when assigned Big Five personality ( 5 ) , produce writings that aligned with those personas. Similarly 8 ’s work on the effect of persona in LLM simulations show that incorporating persona (e.g. demographic) variables via prompting in LLMs provides modest but statistically significant improvements. More recently, 4 assigned 8 personas across 4 political and socio-demographic attributes to show that personas induce motivated reasoning in LLMs. These works indicate that inducing personas in LLMs alters LLM behaviour and can be a useful method to study outputs where grounding tasks on different personas can give us useful information about how personas are affected in those tasks. Prompt Robustness Relying on a single prompt is brittle ( 10 ) but aggregating results from meaning preserving paraphrases can lead to better claims. 14 show that averaging over an instruction paraphrase set (rather than choosing one prompt) yields more stable scores. 20 showed that different paraphrase types (lexical, syntactic, morphological) elicit divergent behaviors and 2 argued that robustness to paraphrasing should be a standard reliability check alongside other perturbations. 12 showed that distinct paraphrase types elicit measurably different behaviors even when semantics is held constant. This is particularly important when working with real world usecases. Imagine a scenario where an LLM is tasked to help diagnose a patient. Even if the LLMs gives results with highest predictions, if its results vary on different runs, a doctor can not rely on the evaluations of the LLM. Hence, prompt robustness is an important step in LLM evaluation to ensure the robustness of the output prediction. AI Risk Taxonomies Risk assessment is an integral step of AI system deployment. While several risk taxonomies have been proposed to map out the landscape of existing risks, the research on risk assessment is still quite fragmented. 21 initially developed a comprehensive taxonomy of LLM risks, categorizing 21 distinct risk types ranging from discrimination and misinformation to malicious use and environmental harms into 6 broad categories. Subsequently, 19 proposed the AI Risk Repository, which looked at 777 risk statements from 43 prior frameworks and categorized them into a hierarchical structure into causal and domain-specific risks. Complimentary to this work, there has been an emergence in governance-oriented taxonomies to operationalize AI risk management like NIST ( 17 ) , OWASP ( 18 ) and IBM AI Risk Atlas ( 1 ) . These frameworks have attempted to structure how AI risks are identified, categorized, and mitigated across organizational and model-governance dimensions to identify, measure, and mitigate technical and systemic risks. Methodology Our goal is to take risk prediction and stakeholder-grounded explanation of these risks (what we call policies ) to analyze how risks and their interpretations vary across different stakeholders in different AI use cases. We start with synthetic dataset of three real world use cases and their associated stakeholders to ground risk predictions in the stakeholders. Next, we use the IBM AI Risk Atlas Nexus for identifying potential risks within each stakeholder’s context. Finally, we use the GloVE explanation framework to get stakeholder-specific policies that capture how different stakeholders reason about the same risks. The following sections describe each of these components in detail. Dataset Construction We introduce stakeholders as personas - which are intended