A Study of the Plausibility of Attention between RNN Encoders in Natural Language Inference Work partially funded by grant ANR-19-CE38-0011-03 from the French national research agency (ANR).
Duc Hau Nguyen, Guillaume Gravier, Pascale Sébillot · 2025
Read A Study of the Plausibility of Attention between RNN Encoders in Natural Language Inference Work partially funded by grant ANR-19-CE38-0011-03 from the French national research agency (ANR). by Duc Hau Nguyen, Guillaume Gravier, Pascale Sébillot (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13735.txt.
Description
The authors test if attention maps can plausibly explain model decisions in a 2025 paper on natural language inference. Attention weights look like explanations, since they point to words behind a verdict. Most tests of that claim use text classification, not sentence comparison, and they rest on a few examples.
The team set cross attention between two recurrent encoders against human and heuristic annotations on a large inference corpus. That route matched human judgments fairly well, which gives a cheap way to test such claims. Raw weights, though, stayed only loosely tied to plausible explanations. That tempers claims that attention alone explains these models.
Catalog record
| CREATOR | Duc Hau Nguyen, Guillaume Gravier, Pascale Sébillot |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-13735