Sphere : An Evaluation Card for Human-AI Systems
Qianou Ma, Dora Zhao, Xinran Zhao, Chenglei Si, Chenyang Yang, Ryan Louie, Ehud Reiter, Diyi Yang, Tongshuang Wu · 2025
Read Sphere : An Evaluation Card for Human-AI Systems by Qianou Ma, Dora Zhao, Xinran Zhao, Chenglei Si, Chenyang Yang, Ryan Louie, Ehud Reiter, Diyi Yang, Tongshuang Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07971.txt.
Description
Qianou Ma and co-authors offered a shared form in 2025 for judging systems where people work with artificial intelligence. As such systems spread, teams judge them in clashing ways, with key choices often left unsaid. Their card, called SPHERE, aims to make those choices plain.
The card asks five things: what is being judged, how the judging runs, who takes part, when it happens, and how the judging itself is checked. The team then used the card to review thirty-nine human-AI systems. The review shows where current practice is strong and where it is thin. Three closing tips urge teams to plan judging early, state their choices, and test the test itself.
Catalog record
| CREATOR | Qianou Ma, Dora Zhao, Xinran Zhao, Chenglei Si, Chenyang Yang, Ryan Louie, Ehud Reiter, Diyi Yang, Tongshuang Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-07971