TruthFlow: Truthful LLM Generation via Representation Flow Correction
Hanyu Wang, Bochuan Cao, Yuanpu Cao, Jinghui Chen · 2025
Read TruthFlow: Truthful LLM Generation via Representation Flow Correction by Hanyu Wang, Bochuan Cao, Yuanpu Cao, Jinghui Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04556.txt.
Description
Hanyu Wang and co-authors present a method that steers language models toward truthful answers in a 2025 paper. Models often state falsehoods with confidence, a flaw called hallucination. Past fixes nudge every input with the same correction vector, which fits diverse questions poorly.
Their method, TruthFlow, learns a flow that builds a custom correction for each query. The correction moves the model's inner state from a hallucination-prone setting toward a truthful one. At answer time, the trained flow supplies that tailored nudge. On a standard truthfulness benchmark, output quality rose across several advanced models. A flow trained once also transferred well to unseen hallucination tests, which suggests the fix captures a general trait.
Catalog record
| CREATOR | Hanyu Wang, Bochuan Cao, Yuanpu Cao, Jinghui Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04556