NLI under the Microscope: What Atomic Hypothesis Decomposition Reveals

Neha Srikanth, Rachel Rudinger · 2025

Read NLI under the Microscope: What Atomic Hypothesis Decomposition Reveals by Neha Srikanth, Rachel Rudinger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08080.txt.

Description

Neha Srikanth and Rachel Rudinger break reasoning problems into atomic claims in a 2025 paper. Language models judge whether a sentence follows from another, but their verdicts can hide shaky logic. Splitting each claim into tiny factual pieces exposes exactly where reasoning wobbles.

The study builds atomic sub-problems for standard inference tasks and for a defeasible variant, where new facts can overturn old conclusions. Models then answer each small piece separately. Large models still showed logical inconsistency on these small steps. The team also finds which atomic pieces decide the overall label in defeasible cases. A new consistency score measures whether a model judges the same fact the same way across contexts. The method gives benchmark designers a finer lens on dataset variety.

Catalog record

CREATORNeha Srikanth, Rachel Rudinger
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-08080

Browse the full library · About the Tower of Babel