In Pursuit of Predictive Models of Human Preferences Toward AI Teammates
Ho Chit Siu, Jaime D. Peña, Yutai Zhou, Ross E. Allen · 2025
Read In Pursuit of Predictive Models of Human Preferences Toward AI Teammates by Ho Chit Siu, Jaime D. Peña, Yutai Zhou, Ross E. Allen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15516.txt.
Description
Ho Chit Siu and co-authors ask what makes an AI a good teammate in human eyes, and whether that can be predicted without running costly human trials. Their test bed is Hanabi, a cooperative card game where players see everyone's cards but their own. They first scored a stable of AI players on lab measures: game results, information measures, and strategic traits. Then 241 people played with the agents and rated their preferences.
The correlations overturned common assumptions from earlier machine learning work. The team's final score, the obvious candidate, predicted human liking worse than stranger traits. People preferred agents whose actions were varied, whose strategy dominated in AI-only play, and who teamed well with other AI. The authors suggest these lab measures could shape how future collaborative AI is trained, so machines earn trust by behaving in ways people actually value.
Catalog record
| CREATOR | Ho Chit Siu, Jaime D. Peña, Yutai Zhou, Ross E. Allen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 79 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-15516