Misaligned by Design: Incentive Failures in Machine Learning
David Autor, Andrew Caplin, Daniel Martin, Philip Marx · 2025
Read Misaligned by Design: Incentive Failures in Machine Learning by David Autor, Andrew Caplin, Daniel Martin, Philip Marx (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07699.txt.
Description
David Autor, Andrew Caplin, and Daniel Martin show a well-meant training habit that backfires. In high-stakes tasks, missing a real case costs far more than a false alarm, so models are often trained with lopsided losses matching human trade-offs. That standard alignment practice can still misfire.
In two focal applications, training the model as if errors cost equally, then adjusting its predictions afterward to honor the real trade-offs, beats baking the asymmetry into training. Human objectives belong at the decision stage, not always in the loss. The result reshapes how teams should align diagnostic and screening systems with expert judgment.
Catalog record
| CREATOR | David Autor, Andrew Caplin, Daniel Martin, Philip Marx |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-07699