Rule-Based Moral Principles for Explaining Uncertainty in Natural Language Generation

1 st Zahra Atf, 2 nd Peter R. Lewis · 2025

Read Rule-Based Moral Principles for Explaining Uncertainty in Natural Language Generation by 1 st Zahra Atf, 2 nd Peter R. Lewis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07190.txt.

Introduction

Zahra Atf's 2025 paper, written with 1 co-author, asks how a large language model should explain that it is unsure. In high-stakes uses like medicine and law, hiding doubt can mislead people, while plain probability scores are often opaque. The authors turn instead to rule-based moral principles drawn from moral psychology and virtue ethics, the study of good character.

Rules such as precaution, deference, and responsibility guide what the system does at low, medium, and high levels of doubt. The rules run in a small Prolog engine, a logic programming tool, and each action comes with a plain-language reason. Trial scenarios check rule coverage, fairness, and whether trust is well calibrated. Cases from clinic and legal work show how moral rules could make generated text easier to trust and to follow.

Catalog record

CREATOR1 st Zahra Atf, 2 nd Peter R. Lewis
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-07190

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Rule-Based Moral Principles for Explaining Uncertainty in Natural Language Generation 1 st Zahra Atf, 2 nd Peter R. Lewis Abstract Rule-Based Moral Principles for Explaining Uncertainty in Natural Language Generation As large language models (LLMs) are increasingly used in high-stakes applications, the challenge of explaining uncertainty in natural language generation has become both a technical and moral imperative. Traditional approaches rely on probabilistic methods that are often opaque, difficult to interpret, and misaligned with human expectations of transparency and accountability. In response to these limitations, this paper introduces a novel framework based on rule-based moral principles—simple, human-inspired ethical guidelines—for responding to uncertainty in LLM-generated text. Drawing on insights from experimental moral psychology and virtue ethics, we define a set of symbolic behavioral rules such as precaution, deference, and responsibility to guide system responses under conditions of epistemic or aleatoric uncertainty. These rules are implemented declaratively and are designed to generate adaptive, context-sensitive explanations even in the absence of precise confidence metrics. The moral principles are encoded as symbolic rules within a lightweight Prolog-based engine, where each uncertainty tag (low, medium, high) activates an ethically aligned system action along with an automatically generated, plain-language rationale. We evaluate the framework through scenario-based simulations that benchmark rule coverage, assess fairness implications, and analyze trust calibration. An interpretive explanation module is integrated to reveal both the assigned uncertainty level and its underlying justification in a transparent and accessible way. We illustrate the framework through hypothetical yet plausible use cases in clinical and legal domains, demonstrating how rule-based moral reasoning can enhance user trust, promote fairness, and improve the interpretability of AI-generated language. By offering a lightweight, philosophically grounded alternative to probabilistic uncertainty modeling, our approach paves the way for more ethical, human-aligned, and socially responsible natural language generation. I Introduction Large Language Models (LLMs) have significantly advanced natural language processing by enabling the generation of coherent and contextually appropriate text across a wide range of domains [ 1 ] . Their adoption in high-stakes applications—such as healthcare diagnostics [ 2 ] , legal reasoning [ 3 , 4 ] , and financial forecasting [ 5 , 6 ] —has intensified the demand for robust uncertainty-management strategies to ensure system reliability and support informed decision-making.Explaining uncertainty entails quantifying, interpreting, and transparently conveying the confidence level of model predictions, thereby enabling more effective risk assessment and fostering user trust. [ 7 ] . Despite their impressive capabilities, current-generation LLMs such as GPT-3 and GPT-4 offer only limited access to internal signals, including token-level log-probabilities, temperature settings, and sampling distributions [ 8 , 9 ] . These proxies are often insufficient for precise and interpretable uncertainty estimation. Decades of cognitive-psychology research further show that even when reliable probabilities are available, humans systematically misinterpret them . Classic studies on heuristics and biases reveal pervasive anchoring, base-rate neglect, and miscalibration in probabilistic reasoning [ 10 , 11 ] . Gigerenzer argues that people reason far more accurately with qualitative cues or natural frequencies than with abstract percentages [ 12 ] . More recently, Sundh reviews behavioural responses to low-probability, high-impact events and reaches the same conclusion, a point echoed in contemporary popular analyses [ 13 , 14 ] . These findings motivate our shift from numeric confidence scores to discrete uncertainty categories accompanied by plain-language moral rationales. Prior efforts to address estimation limits have included ensemble methods, Bayesian neural networks, and Monte Carlo dropout techniques as external uncertainty estimators [ 15 , 16 ] . Simultaneously, explainability methods have aimed to expose model logic [ 17 ] , yet they often remain opaque, computationally expensive, or inaccessible to end-users. Beyond technical challenges, the lack of transparent uncertainty communication raises important ethical concerns. Inadequate handling of uncertainty can exacerbate algorithmic bias, leading to unfair or discriminatory outcomes that disproportionately impact marginalized populations [ 18 ] [ 19 ] . These concerns are particularly acute in high-risk domains such as medicine, where even slight variations in prompts or model settings can result in dramatically different—and potentially unsafe—recommendations [ 20 , 21 ] . As such, LLMs must not only generate plausible outputs but also signal when their confidence is low, especially in situations involving user safety and accountability [ 22 , 23 ] . Selective-classification and reject-option paradigms have been proposed to address this challenge formally [ 24 , 25 ] , but these solutions still rely heavily on opaque probabilistic models. To address these limitations, we propose a rule-based framework that incorporates human-inspired moral principles into the uncertainty-response logic of LLMs. Instead of relying on numerical probability scores, our approach classifies model outputs into three qualitative uncertainty levels— low , medium , and high —and maps each level to a symbolic ethical rule. These rules operationalize three foundational principles: precaution (acting conservatively under high uncertainty), deference (referring ambiguous cases to human experts), and responsibility (acknowledging uncertainty and the limitations of automated systems). Each moral rule is accompanied by a natural-language explanation designed to enhance interpretability and calibrate user trust. The primary aims of this research are threefold: (i) to formulate a minimal set of symbolic moral rules that guide system behavior under different uncertainty conditions; (ii) to implement these rules in a lightweight Prolog-based reasoning engine with an integrated explanation module; and (iii) to evaluate the framework through scenario-based simulations in clinical and legal domains, focusing on rule coverage, fairness implications, and trust calibration. Accordingly, we frame our study around the following research questions: • RQ1: Can a small set of moral rules serve as an effective alternative to opaque probabilistic estimates for signaling uncertainty? • RQ2: Does pairing each rule with a clear and concise natural-language explanation improve user trust and calibration? A central component of our approach is a nuanced understanding of uncertainty itself. In AI and machine learning, uncertainty is commonly categorized into two types: epistemic uncertainty , which arises from incomplete knowledge or model limitations, and aleatoric uncertainty , which reflects intrinsic randomness in the data [ 26 ] . We also consider a third category— ontological uncertainty —which stems from the fundamental unpredictability of complex real-world phenomena and may remain unknowable in principle [ 27 ] . These categories frequently overlap in practice, particularly in clinical contexts where biological variability (aleatoric) coexists with data sparsity or ambiguity (epistemic) [ 28 , 29 ] . Taken together, the foregoing discussion establishes both the practical necessity and the cognitive–ethical motivation for a symbolic, virtue-aligned response layer. The rest of the paper is organised as follows: Section 2 formalises our rule set and the underlying moral rationale; Section 3 details the Prolog-based implementation and its integration with a modern LLM; Section 4 presents scenario-based evaluations that quantify technical validity, fairness, and user-centred readability; and Section 5 concludes by reflecting on philosophical implications and outlining directions for entropy-aware tagging, cross-cultural virtue tuning, and formal verification of rule compliance. II Related Work Cole et al. show that large language models can abstain on ambiguous questions by exploiting repetition patterns in sampled outputs rather than relying on soft-max probabilities [ 30 ] . Kamath, Jia, and Liang extend this idea under domain shift and train a calibrator that answers only 56 % of questions while preserving 80 % accuracy [ 31

Read the complete text