SHARP: Social Harm Analysis via Risk Profiles for Measuring Inequities in Large Language Models
Alok Abhishek, Tushar Bandopadhyay, Lisa Erickson · 2026
Read SHARP: Social Harm Analysis via Risk Profiles for Measuring Inequities in Large Language Models by Alok Abhishek, Tushar Bandopadhyay, Lisa Erickson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21235.txt.
Introduction
Alok Abhishek, Tushar Bandopadhyay, and Lisa Erickson argue that current safety tests for large language models hide the harms that matter most. Models now work in high-stakes fields where a rare but severe failure can cause lasting damage. Most benchmarks still shrink social risk into one average score.
Their framework, called SHARP, builds risk profiles instead of single scores. It tracks how harm is spread out, how risk factors interact, and how bad the worst cases get. A single average can make an unfair model look safe. Profiles show which groups face the worst outcomes and where the danger concentrates.
Catalog record
| CREATOR | Alok Abhishek, Tushar Bandopadhyay, Lisa Erickson |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21235
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SHARP: Social Harm Analysis via Risk Profiles for Measuring Inequities in Large Language Models Alok Abhishek, Tushar Bandopadhyay, Lisa Erickson Abstract Large language models (LLMs) are increasingly deployed in high-stakes domains, where rare but severe failures can result in irreversible harm. However, prevailing evaluation benchmarks often reduce complex social risk to mean-centered scalar scores, thereby obscuring distributional structure, cross-dimensional interactions, and worst-case behavior. This paper introduces Social Harm Analysis via Risk Profiles (SHARP), a framework for multidimensional, distribution-aware evaluation of social harm. SHARP models harm as a multivariate random variable and integrates explicit decomposition into bias, fairness, ethics, and epistemic reliability with a union-of-failures aggregation reparameterized as additive cumulative log-risk. The framework further employs risk-sensitive distributional statistics, with Conditional Value at Risk (CVaR 95 ) as a primary metric, to characterize worst-case model behavior. Application of SHARP to eleven frontier LLMs, evaluated on a fixed corpus of n = 901 n=901 socially sensitive prompts, reveals that models with similar average risk can exhibit more than twofold differences in tail exposure and volatility. Across models, dimension-wise marginal tail behavior varies systematically across harm dimensions, with bias exhibiting the strongest tail severities, epistemic and fairness risks occupying intermediate regimes, and ethical misalignment consistently lower; together, these patterns reveal heterogeneous, model-dependent failure structures that scalar benchmarks conflate. These findings indicate that responsible evaluation and governance of LLMs require moving beyond scalar averages toward multidimensional, tail-sensitive risk profiling. 1 Introduction Large language models (LLMs) and LLM-powered agents have moved from experimental artifacts to integral components of decision-making systems with material societal impact. They are increasingly deployed in high-stakes domains such as healthcare, finance, hiring, welfare allocation, and criminal justice, where failures can produce durable or irreversible harm [ 11 , 3 , 20 , 16 ] . This trend is further accelerated by the emergence of agentic systems capable of autonomous planning, tool use, and multi-step reasoning, which are progressively entrusted with consequential decisions governing access to resources, opportunity, and liberty [ 6 , 8 ] . As a result, LLM failures no longer appear solely as isolated errors, but as systemic risks embedded within broader socio-technical infrastructures [ 9 , 15 ] . This deployment trajectory exposes a structural vulnerability. LLMs are trained on large-scale corpora assembled from web text, digitized media, and institutional sources that reflect historical inequities, uneven representation, and entrenched power asymmetries, and may therefore encode and amplify these patterns without normative grounding or contextual awareness. Prior work has characterized such systems as stochastic parrots , emphasizing their reliance on statistical association rather than grounded reasoning or social understanding [ 4 ] . When integrated into high-stakes pipelines, these properties can give rise to systematic harms spanning biased representation, inequitable treatment across demographic groups, ethical misalignment, and epistemic failures such as hallucination and misinformation [ 5 , 21 , 13 ] . Empirical evidence from criminal justice risk assessment, lending, and hiring systems demonstrates that such harms arise predictably when models optimized for aggregate performance are deployed across heterogeneous populations [ 11 , 14 ] . Despite substantial progress in fairness-aware learning and responsible AI, prevailing evaluation practices remain poorly aligned with deployment risk [ 3 , 10 ] . Capability benchmarks, bias audits, and safety evaluations continue to rely predominantly on mean-centered scalar summaries, such as average accuracy, win rates, or aggregate bias scores. While informative for coarse comparison, these metrics collapse heterogeneous behavior into point estimates and obscure the distributional structure of harm. In particular, models with similar average performance can exhibit sharply divergent upper-tail behavior, producing rare but severe failures under specific prompts or contexts; in high-stakes settings, such tail events often dominate practical risk, yet tail-sensitive quantities and cross-dimensional interactions remain largely absent from standard evaluation pipelines [ 10 , 17 ] . Governance and auditing mechanisms face analogous limitations. Regulatory frameworks such as the EU AI Act and algorithmic accountability initiatives articulate high-level principles of fairness, accountability, and transparency, but translating these principles into auditable, empirically grounded, and risk-sensitive metrics remains an open technical challenge [ 2 , 12 , 23 ] . Developer-led self-audits are susceptible to incomplete coverage and conflicts of interest, while participatory and community-centered approaches, though normatively valuable, are difficult to scale and are rarely integrated into mainstream evaluation workflows [ 7 , 18 ] . This paper argues that social harm in LLMs cannot be adequately characterized as a scalar quantity. Harm varies across prompts, concentrates in the upper tail of model behavior, and manifests through multiple interacting mechanisms, including bias, fairness violations, ethical misalignment, and epistemic unreliability. In high-stakes contexts, these tail events correspond to worst-case failures with disproportionate impact. Therefore, effective evaluation requires methods that explicitly model the distributional geometry of harm and its cross-dimensional interactions, rather than reducing behavior to averaged scores. To address this gap, we introduce Social Harm Analysis via Risk Profiles (SHARP), a framework for multidimensional, distribution-aware evaluation of social harm in LLMs under a fixed evaluation protocol. SHARP departs from mean-based assessment along three axes. First, it decomposes harm into four constituent dimensions: bias, fairness, ethics, and epistemic reliability, enabling targeted diagnosis of distinct failure modes. Second, it treats harm as a distributional quantity, preserving prompt-level variability rather than collapsing behavior into point estimates. Third, it adopts risk-sensitive aggregation, modeling compounded harm via a union-of-failures formulation that is reparameterized as additive cumulative log-risk, and summarizes model behavior using tail-focused statistics such as Conditional Value at Risk ( \mathrm{CVaR}_{95} ). Methodologically, SHARP introduces a layered evaluation architecture. At the prompt level, model responses are embedded into a four-dimensional harm space using a multi-judge LLM-as-a-judge protocol [ 1 , 22 , 24 ] . Judge outputs are aggregated via log-sum-exp to retain sensitivity to severe assessments while remaining robust to individual judge idiosyncrasies. Compounded harm across dimensions is captured through additive log-risk, yielding an interpretable measure of joint failure pressure. At the model level, prompt-level risk values induce empirical distributions that are summarized by expected risk, volatility, and tail risk, supporting comparative risk profiling under worst-case considerations rather than calibrated harm estimation. We apply SHARP to eleven frontier LLMs, spanning open-weight and proprietary systems, and evaluated them on a curated corpus of 901 socially sensitive prompts derived from BEATS and related benchmarks [ 1 , 19 ] . The resulting risk profiles reveal substantial heterogeneity across models. Systems with similar average risk often differ markedly in tail exposure and volatility, indicating qualitatively distinct failure modes with divergent deployment implications. Across models, marginal dimension-wise tail behavior is strongest for bias-related harms, while epistemic and fairness risks exhibit intermediate tail severities and ethical misalignment remains consistently lower; these patterns indicate heterogeneous, model-dependent harm profiles rather than dominance by any single dimension. These findings suggest that effective mitigation requires dimension-specific, risk-aware interventions informed by distributional analysis, rather than uniform remediation guided by scalar benchmarks. SHARP is not intended to estimate real-world harm rates or provide population-level fairness guarantees. Instead, it offers a reproducible protocol for comparative tail-sensitive risk profiling under explicit measurement assumptions, complementing human-centered audits and validation. 2 Methodology Social harm in large language models is multidimensional, prompt-dependent, and driven by worst-case failures rather than average behavior. SHARP formalizes harm as a multivariate random variable over a