Challenges in interpretability of additive models

Xinyu Zhang, Julien Martinelli, S.T. John · 2025

Read Challenges in interpretability of additive models by Xinyu Zhang, Julien Martinelli, S.T. John (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10169.txt.

Description

Xinyu Zhang, Julien Martinelli, and S.T. John wrote a 2025 review on a family of models praised for being easy to understand. Additive models predict an outcome by adding up simple curves, one for each input. Newer versions use small neural networks for each curve. Their clear shape makes them tempting for high-stakes uses, such as medicine or finance.

The authors warn that the clarity can mislead. The same predictions can often be produced by many different sets of curves. When that happens, no single curve tells the true story of its input. Reading the curves as explanations is then shaky ground. The review gathers several forms of this problem and spells out what each one breaks. The authors urge restraint when calling such models interpretable or safe for critical work. Careful users, they argue, should test how stable an explanation is before trusting it.

Catalog record

CREATORXinyu Zhang, Julien Martinelli, S.T. John
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-10169

Browse the full library · About the Tower of Babel