Measuring and mitigating overreliance is necessary for building human-compatible AI
Lujain Ibrahim, Katherine M. Collins, Sunnie S. Y. Kim, Anka Reuel, Max Lamparth, Kevin Feng, Lama Ahmad, Prajna Soni, Alia El Kattan, Merlin Stein, Siddharth Swaroop, Ilia Sucholutsky, Andrew Strait, Q. Vera Liao, Umang Bhatt · 2025
Read Measuring and mitigating overreliance is necessary for building human-compatible AI by Lujain Ibrahim, Katherine M. Collins, Sunnie S. Y. Kim, Anka Reuel, Max Lamparth, Kevin Feng, Lama Ahmad, Prajna Soni, Alia El Kattan, Merlin Stein, Siddharth Swaroop, Ilia Sucholutsky, Andrew Strait, Q. Vera Liao, Umang Bhatt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08010.txt.
Description
Overreliance on language models, trusting them beyond their abilities, is measured and addressed by Lujain Ibrahim and 16 co-authors in a 2025 paper on human-compatible artificial intelligence. Models act as fluid thought partners, and people increasingly let them shape consequential choices in healthcare, advice, and other domains. Errors then carry real costs.
The authors consolidate risks at individual and societal levels, from high-stakes mistakes to governance problems, and argue that measuring overreliance should become central to research and deployment. Mitigation strategies follow from the measurement work. Keeping human judgement properly calibrated, neither dismissing models nor surrendering to them, is a design problem this paper tries to make concrete and testable.
Catalog record
| CREATOR | Lujain Ibrahim, Katherine M. Collins, Sunnie S. Y. Kim, Anka Reuel, Max Lamparth, Kevin Feng, Lama Ahmad, Prajna Soni, Alia El Kattan, Merlin Stein, Siddharth Swaroop, Ilia Sucholutsky, Andrew Strait, Q. Vera Liao, Umang Bhatt |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-08010