LLMs Show No Signs Of Individuated Metacognition

M. Moran Mark Whiting Pareto AI Pareto AI [email protected] [email protected] · 2026

Read LLMs Show No Signs Of Individuated Metacognition by M. Moran Mark Whiting Pareto AI Pareto AI [email protected] [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-24299.txt.

Description

Moran and Whiting ask whether large language models show individuated metacognition, judging their own capability without exercising it. Confidence-weighted routing, abstention, and ensemble weighting assume stated confidence tracks capability. Decomposing confidence judgments from 20 frontier models across six benchmarks, they find factual-recall confidence is nearly rank-one. Models share a difficulty axis and differ in thresholds. Once shared-agreement items are removed, the confidence-performance link collapses. Maths reasoning looks exceptional because models answer confidence questions by solving them. They find no evidence of it in any tested domain.

Catalog record

CREATORM. Moran Mark Whiting Pareto AI Pareto AI [email protected] [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88439
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.24299

Browse the full library · About the Tower of Babel