A Unified Representation Underlying the Judgment of Large Language Models

Yi-Long Lu, Jiajun Song, Wei Wang · 2025

Read A Unified Representation Underlying the Judgment of Large Language Models by Yi-Long Lu, Jiajun Song, Wei Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-27328.txt.

Introduction

Yi-Long Lu, Jiajun Song, and Wei Wang report evidence that language models judge along one shared axis rather than separate modules. Decodable representations for distinct concepts had suggested modular design, leaving open whether judgment systems are truly independent. Across a range of models, the team finds diverse evaluative judgments computed along a dominant dimension they call the Valence-Assent Axis.

That axis jointly encodes subjective valence, what seems good, and assent to factual claims, what seems true. Direct interventions show it acts as a control signal steering generation to build rationales consistent with its evaluative state, even at the cost of factual accuracy. The authors call this the subordination of reasoning. The mechanism offers an account of response bias and hallucination rooted in coherent judgment architecture.

Catalog record

CREATORYi-Long Lu, Jiajun Song, Wei Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE185 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-27328

Browse the full library · About the Tower of Babel