Aligning LLM Uncertainty with Human Disagreement in Subjectivity Analysis
Junyu Lu, Deyi Ji, Xuanyi Liu, Lanyun Zhu, Bo Xu, Liang Yang, Xian-Sheng Hua, Hongfei Lin · 2026
Read Aligning LLM Uncertainty with Human Disagreement in Subjectivity Analysis by Junyu Lu, Deyi Ji, Xuanyi Liu, Lanyun Zhu, Bo Xu, Liang Yang, Xian-Sheng Hua, Hongfei Lin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10415.txt.
Introduction
Junyu Lu and seven colleagues argue that judgment tasks need doubt, not just answers. Tasks such as mood sorting, sarcasm detection, and rudeness detection involve fuzzy edges where different humans disagree. Training on pooled labels compresses that split into one signal, hiding low-agreement doubt and breeding overconfident predictions. Their 2026 paper proposes DPUA, a split-sensing and doubt-alignment framework.
DPUA jointly models label prediction, reason text, and doubt signals. A split-perception phase uses decoupled learning to sharpen feel for split signals while preserving task performance. A doubt-alignment phase uses GRPO-based reward tuning to align the model's confidence with the human split pattern. On three judgment tasks DPUA preserved task performance while better matching model doubt to human splits, easing excess confidence on edge samples and improving generalization to new distributions.
Catalog record
| CREATOR | Junyu Lu, Deyi Ji, Xuanyi Liu, Lanyun Zhu, Bo Xu, Liang Yang, Xian-Sheng Hua, Hongfei Lin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10415
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Aligning LLM Uncertainty with Human Disagreement in Subjectivity Analysis Junyu Lu, Deyi Ji, Xuanyi Liu, Lanyun Zhu, Bo Xu, Liang Yang, Xian-Sheng Hua, Hongfei Lin Abstract Large language models for subjectivity analysis are typically trained with aggregated labels, which compress variations in human judgment into a single supervision signal. This paradigm overlooks the intrinsic uncertainty of low-agreement samples and often induces overconfident predictions, undermining reliability and generalization in complex subjective settings. In this work, we advocate uncertainty-aware subjectivity analysis, where models are expected to make predictions while expressing uncertainty that reflects human disagreement. To operationalize this perspective, we propose a two-phase D isagreement P erception and U ncertainty A lignment (DPUA) framework. Specifically, DPUA jointly models label prediction, rationale generation, and uncertainty expression under an uncertainty-aware setting. In the disagreement perception phase, adaptive decoupled learning enhances the model’s sensitivity to disagreement signals while preserving task performance. In the uncertainty alignment phase, GRPO-based reward optimization further improves uncertainty-aware reasoning and aligns the model’s confidence expression with the human disagreement distribution. Experiments on three subjectivity analysis tasks show that DPUA preserves task performance while better aligning model uncertainty with human disagreement, mitigating overconfidence on boundary samples, and improving out-of-distribution generalization. Disclaimer : The paper contains content that may be profane, vulgar, or offensive. I Introduction In recent years, large language models (LLMs) have achieved remarkable progress in natural language processing, driven by their extensive background knowledge and strong generative capabilities [ 16 , 24 , 6 ] . The dominant training paradigm typically relies on standard labels as supervision signals [ 36 ] . This paradigm has been highly effective for objective tasks such as mathematical reasoning [ 38 ] and factual question answering [ 13 ] , where correctness criteria are relatively clear and stable. However, this paradigm becomes less reliable for subjectivity analysis tasks, such as sentiment classification, sarcasm detection, and offensiveness detection. Unlike objective tasks, subjectivity analysis often involves fuzzy semantic boundaries and diverse human interpretations [ 1 , 31 ] . As a result, different humans may reasonably assign different labels to the same input. Such disagreement is not merely annotation noise; rather, it often reflects intrinsic sample uncertainty and variation in human cognition [ 3 , 2 ] . When these differences are compressed into a single aggregated label, conventional supervision overlooks the uncertainty of low-agreement samples, which may induce overly rigid decision boundaries and overconfident predictions [ 30 , 17 ] . This undermines model reliability and generalization in complex subjective scenarios [ 7 , 21 ] . Fig. 1: Illustration of uncertainty-aware subjectivity analysis in offensive language detection. High-agreement samples support confident predictions, whereas low-agreement samples require more cautious uncertainty expression due to multiple plausible interpretations. To address this limitation, we advocate uncertainty-aware subjectivity analysis. Instead of treating the aggregated label as the only learning target, this setting requires models to make task decisions while expressing uncertainty that reflects human disagreement. In other words, an ideal model should not only answer “what the label is” , but also indicate “how uncertain the case is” . Such uncertainty awareness should be grounded in task evidence and cues that may lead to human disagreement. As illustrated in Figure 1 , in offensive language detection, a model should be confident on high-agreement samples with explicit profanity or insults, while being more cautious on low-agreement samples that allow multiple plausible interpretations. This ability to align confidence with human disagreement is important for mitigating overconfidence on boundary samples and supporting more reliable decisions in subjective analysis tasks. To this end, we propose a two-phase D isagreement P erception and U ncertainty A lignment framework ( DPUA ) for subjectivity analysis. DPUA jointly generates a task label, a rationale, and a confidence score, where the rationale captures task evidence and disagreement-related cues, and the confidence score reflects the model’s uncertainty. The first phase performs disagreement perception through adaptive decoupled learning, which adjusts supervision according to human agreement and encourages the model to learn stable decision patterns from high-agreement samples while attending to disagreement signals in low-agreement cases. The second phase performs uncertainty alignment with Group Relative Policy Optimization (GRPO) [ 28 ] , further improving uncertainty-aware reasoning and aligning confidence expression with the human disagreement distribution. We conduct a systematic evaluation of DPUA on three subjectivity analysis tasks. Experimental results show that DPUA preserves core task performance while better aligning model uncertainty with human disagreement, effectively mitigating overconfidence on boundary samples. Furthermore, under out-of-distribution settings, DPUA shows stronger generalization across different subjectivity analysis tasks. The contributions of this paper are summarized as follows: • We advocate uncertainty-aware subjectivity analysis, where models are expected to predict task labels, identify disagreement-related cues, and express calibrated uncertainty beyond fitting a single aggregated label. • We propose DPUA, a two-phase Disagreement Perception and Uncertainty Alignment framework that enables LLMs to identify disagreement signals and express uncertainty in accordance with human disagreement. • Experiments on three subjectivity analysis tasks demonstrate that DPUA preserves task performance while improving uncertainty alignment, mitigating overconfidence on boundary samples, and enhancing out-of-distribution generalization. II Related Work II-A Subjectivity Analysis. Subjectivity analysis tasks pose a particular challenge for LLMs [ 21 ] , as they require models to interpret texts whose meanings are often context-dependent and open to multiple plausible readings. Such tasks involve inherently complex judgment processes and substantial human disagreement, particularly on boundary samples where semantic cues are ambiguous or socially sensitive [ 30 , 2 ] . Early studies typically collapsed such disagreement into a single supervision signal through majority voting [ 23 , 8 ] . Recently, several studies have argued that this binary classification formulation relies on an idealized assumption [ 2 , 3 , 26 ] . In response, recent studies have begun to explore how human disagreement information can be incorporated into model training [ 12 , 4 , 34 , 25 ] . However, most existing studies still focus primarily on improving predictive performance, while research on enabling LLMs to explicitly represent and align with human disagreement remains limited. II-B LLM Uncertainty Calibration. Model uncertainty in LLMs has received increasing attention, as it is closely related to the reliability and trustworthiness of model outputs [ 14 , 29 ] . Existing studies have explored various ways to estimate or express uncertainty [ 35 , 20 , 37 , 11 ] , aiming to help models better reflect the reliability of their outputs through confidence estimates. These methods have shown promising results in tasks where correctness can be more clearly defined [ 33 , 5 , 22 ] , effectively improving model reliability. Most existing work, however, is developed for objective settings and evaluates uncertainty mainly with respect to prediction correctness [ 14 , 29 ] . This formulation is less suitable for subjectivity analysis tasks, where uncertainty often stems from uncertainty in the sample and variation in human cognition rather than model error alone [ 27 , 10 ] . As a result, methods designed for objective tasks cannot be directly transferred to this setting [ 34 , 21 ] . How to model uncertainty in a way that better reflects human disagreement remains underexplored. III Methodology Fig. 2: Illustration of Disagreement Perception and