Fair and Calibrated Toxicity Detection with Robust Training and Abstention
Mokshit Surana · 2026
Read Fair and Calibrated Toxicity Detection with Robust Training and Abstention by Mokshit Surana (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14074.txt.
Description
Surana studies fair toxicity spotting across three linked axes: ranking, calibration and abstention. Training fixes and post-hoc safety tricks cannot be judged apart, since training shapes how well later safeguards work. The paper weighs plain risk minimization, instance reweighting and Group DRO, each paired with temperature scaling, confidence-based opt-outs and per-group thresholds. One headline finding: good overall calibration can hide group harm, as one baseline looks near-perfect overall yet miscalibrates every identity group.
Catalog record
| CREATOR | Mokshit Surana |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26639 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.14074