Steer LLM Latents for Hallucination Detection

Seongheon Park, Xuefeng Du, Min-Hsuan Yeh, Haobo Wang, Yixuan Li · 2025

Read Steer LLM Latents for Hallucination Detection by Seongheon Park, Xuefeng Du, Min-Hsuan Yeh, Haobo Wang, Yixuan Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-01917.txt.

Description

Seongheon Park, Xuefeng Du, and co-authors steer tongue model states with one taught shift to flag made up facts, in a 2025 paper. Model hid states are tuned for smooth talk, not truth lines. Truth and fake thus blur in the state space of such models at test time.

A light shift vector learns on few marked cases to pull the two apart. State gaps widen in runs sans touch of model weights at all. Unmarked fresh text then joins the teach pool by a flow match step. Sure picks from that pool firm the shift for wide use. Tests hit top marks with scant marked data in hand.

Catalog record

CREATORSeongheon Park, Xuefeng Du, Min-Hsuan Yeh, Haobo Wang, Yixuan Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-01917

Browse the full library · About the Tower of Babel