Sphere : An Evaluation Card for Human-AI Systems

Qianou Ma, Dora Zhao, Xinran Zhao, Chenglei Si, Chenyang Yang, Ryan Louie, Ehud Reiter, Diyi Yang, Tongshuang Wu · 2025

Read Sphere : An Evaluation Card for Human-AI Systems by Qianou Ma, Dora Zhao, Xinran Zhao, Chenglei Si, Chenyang Yang, Ryan Louie, Ehud Reiter, Diyi Yang, Tongshuang Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07971.txt.

Description

Qianou Ma and co-authors offered a shared form in 2025 for judging systems where people work with artificial intelligence. As such systems spread, teams judge them in clashing ways, with key choices often left unsaid. Their card, called SPHERE, aims to make those choices plain.

The card asks five things: what is being judged, how the judging runs, who takes part, when it happens, and how the judging itself is checked. The team then used the card to review thirty-nine human-AI systems. The review shows where current practice is strong and where it is thin. Three closing tips urge teams to plan judging early, state their choices, and test the test itself.

Catalog record

CREATORQianou Ma, Dora Zhao, Xinran Zhao, Chenglei Si, Chenyang Yang, Ryan Louie, Ehud Reiter, Diyi Yang, Tongshuang Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-07971

Browse the full library · About the Tower of Babel