Challenges in interpretability of additive models
Xinyu Zhang, Julien Martinelli, S.T. John · 2025
Read Challenges in interpretability of additive models by Xinyu Zhang, Julien Martinelli, S.T. John (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10169.txt.
Description
Xinyu Zhang, Julien Martinelli, and S.T. John wrote a 2025 review on a family of models praised for being easy to understand. Additive models predict an outcome by adding up simple curves, one for each input. Newer versions use small neural networks for each curve. Their clear shape makes them tempting for high-stakes uses, such as medicine or finance.
The authors warn that the clarity can mislead. The same predictions can often be produced by many different sets of curves. When that happens, no single curve tells the true story of its input. Reading the curves as explanations is then shaky ground. The review gathers several forms of this problem and spells out what each one breaks. The authors urge restraint when calling such models interpretable or safe for critical work. Careful users, they argue, should test how stable an explanation is before trusting it.
Catalog record
| CREATOR | Xinyu Zhang, Julien Martinelli, S.T. John |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-10169