From Individual Experience to Collective Evidence: A Reporting-Based Framework for Identifying Systemic Harms

Jessica Dai, Paula Gradu, Inioluwa Deborah Raji, Benjamin Recht · 2025

Read From Individual Experience to Collective Evidence: A Reporting-Based Framework for Identifying Systemic Harms by Jessica Dai, Paula Gradu, Inioluwa Deborah Raji, Benjamin Recht (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08166.txt.

Description

Jessica Dai, Paula Gradu, Inioluwa Deborah Raji, and Benjamin Recht build a framework to turn lone harm reports into collective proof. Their twenty twenty-five paper starts from a gap: one person's bad experience with a system says little alone. Reports pile up over time, and the task is to spot groups hit at higher rates.

They frame the search as a sequential hypothesis test over arriving reports. Conditions on how people report are shown to suffice for sound claims about true harm gaps. Standard test tools apply, with a correction for many tests. On mortgage and vaccine side-effect data, the method found known at-risk groups from a fraction of the data first used.

Catalog record

CREATORJessica Dai, Paula Gradu, Inioluwa Deborah Raji, Benjamin Recht
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-08166

Browse the full library · About the Tower of Babel