The strength of clinical evidence is recoverable from language model representations but not from their stated grades

Soroosh Tayebi Arasteh ∗ · 2026

Read The strength of clinical evidence is recoverable from language model representations but not from their stated grades by Soroosh Tayebi Arasteh ∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-29034.txt.

Introduction

Tayebi Arasteh tests whether language models know how strong a clinical claim's evidence is, even when they cannot say so. Models increasingly summarise medical evidence, where a claim's weight rests on its support. He compiled over forty-five thousand clinical claims from six public sources, and harmonised about twenty thousand into a four-level evidence grade, applying three independent frameworks. Twenty-two open-weight models were tested, from small to seventy billion parameters.

A simple linear estimator read the evidence grade from every model's internal representations, with middling accuracy. Decodability did not grow with model size, and reasoning models were weakest. Yet the grades models actually stated were at chance level, far below the estimator. The internal signal was largely lexical, tied to wording, and did not carry over across topics or frameworks. It was, however, distinct from factual truth, and it still flagged weakly supported claims with useful accuracy.

Catalog record

CREATORSoroosh Tayebi Arasteh ∗
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.29034

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The strength of clinical evidence is recoverable from language model representations but not from their stated grades Soroosh Tayebi Arasteh ∗ Abstract Large language models (LLMs) increasingly summarize clinical evidence, where a claim’s weight depends on how strongly it is supported. Yet these models convey confidence poorly, and properties they never state, such as truth, are often readable from their activations. Whether a clinical model registers evidence strength, distinct from truth, and states it when asked is untested, and any such signal could be lexical. We compiled 45,134 clinical claims from six public sources, harmonized 20,611 into a four-level evidence grade under three independent frameworks, and tested 22 local, open-weight LLMs from several developers (0.6–70 billion parameters; general, medical, and reasoning), with lexical, truth, and cross-framework controls. A linear estimator recovered the grade in every model (median AUROC 71.8), yet decodability did not rise with scale and was weakest in reasoning models. The grade the models stated fell to chance, 25–27 percentage points below the estimator. The recoverable signal was largely lexical and did not transfer across topics or frameworks, yet it was distinct from factual truth and still flagged weakly supported claims (AUROC 69.2). Clinical LLMs thus carry an ordered evidence-strength signal they do not express, so their stated grades fail to convey a claim’s support even when it is recoverable from their representations and text. ∗ Correspondence to: Soroosh Tayebi Arasteh () Introduction Large language models (LLMs) are moving from benchmark demonstrations into clinical practice, where they answer medical questions, draft clinical documentation, and summarize evidence for clinicians and patients [ 42 , 50 , 54 , 43 ] . In medicine the value of an assertion depends not only on whether it is correct but on how strongly it is supported: a recommendation backed by several large randomized controlled trials (RCTs) carries different weight from one resting on a single small study or on expert opinion alone. For an LLM’s output to be used safely, a reader must be able to tell which of its claims are well supported and which are not. Yet LLMs communicate confidence poorly. Their stated certainty is weakly calibrated and frequently fails to track whether an answer is correct [ 27 , 31 , 51 , 57 ] , and the explanations they offer can leave a reader more confident than the model’s own internal estimate warrants [ 45 ] . These failures are especially consequential in medicine, where current models still misjudge realistic clinical cases while expressing little hesitation [ 22 , 50 ] . A model that asserts a tentative finding as confidently as a settled one gives the reader no signal of evidentiary strength, the very signal that clinical judgment depends on. Interpretability research suggests that the missing signal might nonetheless be present inside the model. Properties that LLMs do not reliably state, including the truth of a factual claim, are often linearly decodable from their hidden activations [ 4 , 8 , 30 , 33 ] , and recent work argues that internal representations encode more about a model’s own correctness than its outputs reveal [ 37 ] . This raises a specific possibility for clinical evidence: a model might internally register that a claim is weakly supported while failing to convey it when prompted. Whether this is so has not been tested, and there are reasons for caution. The strength of clinical evidence is a graded property, formalized by systems such as the Grading of Recommendations Assessment, Development and Evaluation (GRADE) framework and the recommendation grades of the US Preventive Services Task Force (USPSTF) [ 38 , 53 ] , and it is distinct from truth: well supported claims are sometimes overturned, and reversals of established practice are common enough to make the distinction concrete [ 23 ] . At the same time, an apparent internal signal can be shallow. Recent analyses show that hidden-state readouts often capture whether the model is drawing on memorized statistical associations instead of whether a statement is true, and that such signals are driven in part by surface lexical cues and fail to generalize across datasets [ 9 , 37 ] . Any claim that a model encodes evidence strength must therefore be separated from lexical cues, from factual truth, and from the particular corpus on which it was measured. Here we ask, across 22 local, open-weight LLMs spanning general-domain families, medical domain-adapted models [ 28 ] , and reasoning-distilled models [ 20 , 11 ] and ranging from 0.6 to 70 billion parameters, whether the evidence grade of a clinical claim is recoverable from a model’s hidden states and whether the model can state it. We compile a corpus of 45,134 clinical claims entirely from publicly available biomedical sources, comprising automatically extracted RCT evidence [ 34 , 29 , 36 ] , national preventive-care recommendations, and catalogued reversals of established practice [ 23 ] , each graded for strength of evidence under one of three independent grading frameworks. Using linear estimators, with controls for lexical and surface confounds, a balanced design that decorrelates grade from factual truth, and a leave-one-framework-out test of generalization, we characterize what these models encode and what they express. We find a consistent dissociation. Evidence grade is linearly recoverable in every model, but, contrary to the expectation that larger or more specialized models hold cleaner internal structure, it decodes no better, and often worse, in larger models and in reasoning-tuned ones. The same models cannot state the grade their activations encode: verbalized grades fall to chance, opening a large and systematic gap between what is internally recoverable and what is expressed. This recoverable signal is largely lexical and does not transfer across topics or grading frameworks, and it is separable from factual truth. Finally, although a model will not report it, the signal can be read out by an external assessor to flag weakly supported claims for review. Fig. 1 summarizes the study. Figure 1: Overview of the study. a , In clinical medicine, the weight of an assertion depends on how strongly it is supported by evidence, a graded property shown here on a four-level scale ordered from high to very low support. b , The study asks whether a language model internally registers this strength in its hidden activations and whether it states the same grade in its output, that is, whether the encoded and the stated grade agree. c , A corpus of 45{,}134 clinical claims is compiled from six public biomedical sources, of which 20{,}611 are harmonized into the four-level evidence grade under three independent grading frameworks, with a subset additionally labeled for factual truth. d , The corpus is used to assess 22 open-weight language models spanning general-domain, medical domain-adapted, and reasoning-distilled families and ranging from 0.6 to 70 billion parameters. e , For each claim, the final-token hidden state of the frozen model is extracted, and a linear estimator is trained to read the evidence grade from the representation, while the model is separately prompted to state the grade, defining the central comparison between the recoverable and the stated grade. f , Further analyses examine whether the recoverable signal is lexical, whether it generalizes across clinical topics and grading frameworks,

Read the complete text