Proof-Carrying Numbers (PCN): A Protocol for Trustworthy Numeric Answers from LLMs via Claim Verification
Aivin V. Solatorio · 2025
Read Proof-Carrying Numbers (PCN): A Protocol for Trustworthy Numeric Answers from LLMs via Claim Verification by Aivin V. Solatorio (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06902.txt.
Introduction
Numbers spoken by a language model should carry proof, proposes Aivin V. Solatorio in a solo 2025 paper. Models sometimes state figures that deviate from the data, a failure called numeric hallucination. Retrieval, citations, and uncertainty estimates improve transparency but cannot guarantee a displayed number is right.
The protocol, Proof-Carrying Numbers, works at the presentation layer. Each numeric span is emitted as a claim-bound token tied to a structured claim. A verifier in the renderer checks it against a declared policy, such as exact equality, rounding, aliases, or tolerance. Only checked numbers display as verified; everything else defaults to unverified, so the system fails closed. Solatorio formalizes the protocol and proves soundness, completeness for honest tokens, fail-closed behavior, and monotonicity as policies tighten. The design is lightweight and model-agnostic.
Catalog record
| CREATOR | Aivin V. Solatorio |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06902
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Proof-Carrying Numbers (PCN): A Protocol for Trustworthy Numeric Answers from LLMs via Claim Verification Aivin V. Solatorio Abstract Large Language Models (LLMs) as stochastic systems may generate numbers that deviate from available data, a failure known as numeric hallucination . Existing safeguards—retrieval-augmented generation, citations, and uncertainty estimation—improve transparency but cannot guarantee fidelity: fabricated or misquoted values may still be displayed as if correct. We propose Proof-Carrying Numbers (PCN) , a presentation-layer protocol that enforces numeric fidelity through mechanical verification. Under PCN, numeric spans are emitted as claim-bound tokens tied to structured claims, and a verifier checks each token under a declared policy (e.g., exact equality, rounding, aliases, or tolerance with qualifiers). Crucially, PCN places verification in the renderer , not the model: only claim-checked numbers are marked as verified, and all others default to unverified. This separation prevents spoofing and guarantees fail-closed behavior. We formalize PCN and prove soundness, completeness under honest tokens, fail-closed behavior, and monotonicity under policy refinement. PCN is lightweight and model-agnostic, integrates seamlessly into existing applications, and can be extended with cryptographic commitments. By enforcing verification as a mandatory step before display, PCN establishes a simple contract for numerically sensitive settings: trust is earned only by proof , while the absence of a mark communicates uncertainty. 1 Introduction Large Language Models (LLMs) are emerging as powerful interfaces for accessing knowledge in domains ranging from healthcare and finance to economics and international development. Their fluency makes them attractive to a wide range of users—from policymakers and researchers to clinicians, financial analysts, and the public—but their usefulness is constrained by their stochastic nature: they may generate numeric hallucinations . Even when given correct input, LLMs may still produce plausible but incorrect values—sometimes citing the right dataset while presenting the wrong figure ( Ji et al. 2023 ; Banerjee et al. 2024 ; Xu et al. 2025 ; Kalai et al. 2025 ) . For example, Wu et al. 2025a showed that when provided a perturbed drug dosage, an LLM sometimes “corrected” it to a different value. In another case, a model might state that the Philippines’ GDP growth in 2024 was 6% when the official figure published by The World Bank 2025 was 5.7%. Small deviations like these can erode trust and cascade into flawed medical guidance, misinformed policy, or reputational risks for institutions. Existing safeguards only partially address this problem. Retrieval-augmented generation ( Lewis et al. 2020 ) grounds answers in source text, while citations and attribution frameworks ( Wu et al. 2025a ; Zhang et al. 2025 ) increase transparency. However, both remain probabilistic: users often assume a cited number is faithful even when it has been misquoted or fabricated ( Wu et al. 2025b ; Hakim et al. 2025 ) . Similarly, uncertainty estimation ( Manakul et al. 2023 ) and self-verification approaches can flag suspicious values but offer no binding guarantee. PCN presentation-layer pipeline User Query q LLM Generator parse q , plan, generate Retriever resolve claims C Verifier apply policy \Pi User Interface: \checkmark verified (marked with provenance) \varnothing unverified (no mark by default) retrieve (q) claims C tokens / numbers y verified / unverified Stat DB/MCP Fin API EHR Claim-bound token <claim id="CID" policy="P">VAL</claim> Bare numbers \Rightarrow unverified by default Policies \Pi : exact, normalized, alias, proto R(t,c;\Pi)=1 \Rightarrow verified, else unverified Proof-Carrying Numbers (PCN) Protocol in LLM Applications Figure 1: PCN-compliant architecture with LLM-initiated retrieval. The LLM first parses the query and requests claims from the retriever (dashed top lane); the retriever returns the claim set C on a separate solid lane. The LLM emits claim-bound tokens (or bare numbers). The verifier checks tokens under policy \Pi , and the UI renders verified values with provenance marks; absence of a mark implies unverified by default. External structured data sources feed the retriever via parallel dashed feeders. Figure 2: Implementation of the Proof-Carrying Numbers (PCN) protocol in an LLM chat application. The LLM retrieves authoritative claims via an MCP server; the verifier applies PCN policies; and the interface renders verified numbers with explicit badges. We argue that numeric hallucination is best understood as a presentation-layer problem . Even when authoritative claims are retrieved, LLMs are unreliable at reproducing values faithfully ( Banerjee et al. 2024 ; Xu et al. 2025 ) , and user interfaces lack systematic safeguards against drift or fabrication. To address this gap, we propose Proof-Carrying Numbers (PCN) , a protocol that requires every displayed number to be bound to an authoritative claim and verified before presentation. Loosely inspired by proof-carrying code ( Necula 1997 ) , PCN embeds verifiability directly into the interface: verified numbers carry explicit provenance, while unverifiable ones are blocked, flagged, or corrected. Our contributions are threefold: 1. We reframe numeric hallucination as a presentation-layer problem , showing why existing safeguards (retrieval, citations, uncertainty estimation) cannot provide binding guarantees. 2. We design the Proof-Carrying Numbers (PCN) protocol, specifying a claim schema, token syntax, and verifier policies that enforce a fail-closed contract at display time. 3. We show how PCN wraps inherently fallible LLM outputs in a deterministic contract: numeric spans are either Verified against authoritative claims with provenance, remain Bare if unclaimed, or are Flagged when verification fails. By embedding verification into the presentation pipeline, PCN bridges the gap between LLM fluency and the trustworthiness required in high-stakes numeric applications. 2 Background and Related Work Hallucination in large language models (LLMs)—the generation of fluent but incorrect content—poses serious challenges across domains ( Ji et al. 2023 ; Banerjee et al. 2024 ; Xu et al. 2025 ) . Of particular concern is numeric hallucination , where even small deviations (e.g., reporting 6.0% instead of 5.7%) can undermine high-stakes applications in policy, healthcare, and finance ( Kim et al. 2025 ; Kang & Liu 2023 ) . One stream of work grounds model outputs in retrieved content. Retrieval-augmented generation ( Lewis et al. 2020 ) and citation frameworks ( Wu et al. 2025a ; Schreieder et al. 2025 ; Zhang et al. 2025 ) improve transparency by linking generated text to sources. However, fabricated values may still appear alongside credible references, creating the illusion of fidelity ( Wu et al. 2025b ; Hakim et al. 2025 ) . Another line of research focuses on post-hoc verification. Frameworks such as FEVER ( Thorne et al. 2018 ) , FEVEROUS ( Aly et al. 2021 ) , TabFact ( Chen et al. 2020 ) , and SciFact ( Wadden et al. 2022 ) decompose outputs into claims and check them against evidence. Recent tools like AttributionBench ( Li et al. 2024 ) and SourceCheckup ( Wu et al. 2025a ) extend this approach to LLMs. While useful for auditing, these methods are retrospective: they may flag erroneous outputs but cannot prevent unverified numbers from being displayed. Uncertainty-based methods ( Manakul et al. 2023 ) similarly attempt to detect hallucinations using entropy ( Farquhar et al. 2024 ) , calibration ( Manakul et al. 2023 ) , or self-consistency ( Kadavath et al. 2022 ) , but confident models may still produce incorrect values with low uncertainty. Structured decoding and symbolic grounding introduce additional constraints ( Geng et al. 2023 ) . Schema-constrained decoding enforces well-formed outputs, while symbolic