Learning to Seek Evidence: A Verifiable Reasoning Agent with Causal Faithfulness Analysis

Yuhang Huang, Zekai Lin, Fan Zhong, Lei Liu · 2025

Read Learning to Seek Evidence: A Verifiable Reasoning Agent with Causal Faithfulness Analysis by Yuhang Huang, Zekai Lin, Fan Zhong, Lei Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01425.txt.

Description

Yuhang Huang, Zekai Lin, Fan Zhong, and Lei Liu build a diagnostic agent whose explanations can be checked. In high stakes fields like medicine, model explanations often cannot be verified, which undermines trust. Their agent instead explains through an auditable sequence of actions, learning when to go and fetch external visual evidence for its reasoning.

Reinforcement learning trains that evidence seeking policy, making the agent both efficient and generalizable. In experiments the interactive process improved calibrated accuracy, cutting the Brier score by about eighteen percent against a non-interactive baseline. To test whether the explanations are faithful, the authors mask the evidence the agent chose and watch performance degrade measurably, confirming the evidence genuinely drives the decisions.

Catalog record

CREATORYuhang Huang, Zekai Lin, Fan Zhong, Lei Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-01425

Browse the full library · About the Tower of Babel