SoftHateBench: Evaluating Moderation Models Against Reasoning-Driven, Policy-Compliant Hostility Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates
Xuanyu Su, Diana Inkpen, Nathalie Japkowicz · 2026
Read SoftHateBench: Evaluating Moderation Models Against Reasoning-Driven, Policy-Compliant Hostility Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates by Xuanyu Su, Diana Inkpen, Nathalie Japkowicz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20256.txt.
Description
Xuanyu Su, Diana Inkpen, and Nathalie Japkowicz present SoftHateBench, a benchmark for testing content moderation models against soft hate speech. Hard hate uses slurs and threats. Soft hate sounds reasonable on the surface but uses framing and value claims to steer readers toward blaming or excluding a group.
The authors test whether moderation models catch this policy-compliant hostility, which is driven by reasoning rather than insults. Many filters key on bad words, so they may pass text that is harmful in effect. A benchmark of this kind shows platforms where their tools are blind.
Catalog record
| CREATOR | Xuanyu Su, Diana Inkpen, Nathalie Japkowicz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20256