Measuring and mitigating overreliance is necessary for building human-compatible AI

Lujain Ibrahim, Katherine M. Collins, Sunnie S. Y. Kim, Anka Reuel, Max Lamparth, Kevin Feng, Lama Ahmad, Prajna Soni, Alia El Kattan, Merlin Stein, Siddharth Swaroop, Ilia Sucholutsky, Andrew Strait, Q. Vera Liao, Umang Bhatt · 2025

Read Measuring and mitigating overreliance is necessary for building human-compatible AI by Lujain Ibrahim, Katherine M. Collins, Sunnie S. Y. Kim, Anka Reuel, Max Lamparth, Kevin Feng, Lama Ahmad, Prajna Soni, Alia El Kattan, Merlin Stein, Siddharth Swaroop, Ilia Sucholutsky, Andrew Strait, Q. Vera Liao, Umang Bhatt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08010.txt.

Description

Overreliance on language models, trusting them beyond their abilities, is measured and addressed by Lujain Ibrahim and 16 co-authors in a 2025 paper on human-compatible artificial intelligence. Models act as fluid thought partners, and people increasingly let them shape consequential choices in healthcare, advice, and other domains. Errors then carry real costs.

The authors consolidate risks at individual and societal levels, from high-stakes mistakes to governance problems, and argue that measuring overreliance should become central to research and deployment. Mitigation strategies follow from the measurement work. Keeping human judgement properly calibrated, neither dismissing models nor surrendering to them, is a design problem this paper tries to make concrete and testable.

Catalog record

CREATORLujain Ibrahim, Katherine M. Collins, Sunnie S. Y. Kim, Anka Reuel, Max Lamparth, Kevin Feng, Lama Ahmad, Prajna Soni, Alia El Kattan, Merlin Stein, Siddharth Swaroop, Ilia Sucholutsky, Andrew Strait, Q. Vera Liao, Umang Bhatt
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-08010

Browse the full library · About the Tower of Babel