A Study of the Plausibility of Attention between RNN Encoders in Natural Language Inference Work partially funded by grant ANR-19-CE38-0011-03 from the French national research agency (ANR).

Duc Hau Nguyen, Guillaume Gravier, Pascale Sébillot · 2025

Read A Study of the Plausibility of Attention between RNN Encoders in Natural Language Inference Work partially funded by grant ANR-19-CE38-0011-03 from the French national research agency (ANR). by Duc Hau Nguyen, Guillaume Gravier, Pascale Sébillot (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13735.txt.

Description

The authors test if attention maps can plausibly explain model decisions in a 2025 paper on natural language inference. Attention weights look like explanations, since they point to words behind a verdict. Most tests of that claim use text classification, not sentence comparison, and they rest on a few examples.

The team set cross attention between two recurrent encoders against human and heuristic annotations on a large inference corpus. That route matched human judgments fairly well, which gives a cheap way to test such claims. Raw weights, though, stayed only loosely tied to plausible explanations. That tempers claims that attention alone explains these models.

Catalog record

CREATORDuc Hau Nguyen, Guillaume Gravier, Pascale Sébillot
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-13735

Browse the full library · About the Tower of Babel