Sensivity of LLMs’ Explanations to the Training Randomness: Context, Class & Task Dependencies
Romain Loncour and Jérémie Bogaert and François-Xavier Standaert UCLouvain, Louvain-la-Neuve, Belgium · 2026
Read Sensivity of LLMs’ Explanations to the Training Randomness: Context, Class & Task Dependencies by Romain Loncour and Jérémie Bogaert and François-Xavier Standaert UCLouvain, Louvain-la-Neuve, Belgium (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08241.txt.
Description
Loncour and colleagues study how sensitive language model explanations are to training randomness. Transformer models anchor language processing, yet explaining their decisions remains hard. Recent work showed that the same model trained on the same data with different randomness can yield very different explanations. The authors test how syntactic context, the classes to be learned, and the tasks shape this sensitivity. All three matter in a statistically significant way: least for syntactic context, mid for the classes, and most for the tasks.
Catalog record
| CREATOR | Romain Loncour and Jérémie Bogaert and François-Xavier Standaert UCLouvain, Louvain-la-Neuve, Belgium |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 12390 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.08241