Fair and Calibrated Toxicity Detection with Robust Training and Abstention

Mokshit Surana · 2026

Read Fair and Calibrated Toxicity Detection with Robust Training and Abstention by Mokshit Surana (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14074.txt.

Description

Surana studies fair toxicity spotting across three linked axes: ranking, calibration and abstention. Training fixes and post-hoc safety tricks cannot be judged apart, since training shapes how well later safeguards work. The paper weighs plain risk minimization, instance reweighting and Group DRO, each paired with temperature scaling, confidence-based opt-outs and per-group thresholds. One headline finding: good overall calibration can hide group harm, as one baseline looks near-perfect overall yet miscalibrates every identity group.

Catalog record

CREATORMokshit Surana
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26639
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14074

Browse the full library · About the Tower of Babel