SoftHateBench: Evaluating Moderation Models Against Reasoning-Driven, Policy-Compliant Hostility Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates

Xuanyu Su, Diana Inkpen, Nathalie Japkowicz · 2026

Read SoftHateBench: Evaluating Moderation Models Against Reasoning-Driven, Policy-Compliant Hostility Conference: Proceedings of the ACM Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates Proceedings of the ACM Web Conference 2026 (WWW ’26), April 13–17, 2026, Dubai, United Arab Emirates by Xuanyu Su, Diana Inkpen, Nathalie Japkowicz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20256.txt.

Description

Xuanyu Su, Diana Inkpen, and Nathalie Japkowicz present SoftHateBench, a benchmark for testing content moderation models against soft hate speech. Hard hate uses slurs and threats. Soft hate sounds reasonable on the surface but uses framing and value claims to steer readers toward blaming or excluding a group.

The authors test whether moderation models catch this policy-compliant hostility, which is driven by reasoning rather than insults. Many filters key on bad words, so they may pass text that is harmful in effect. A benchmark of this kind shows platforms where their tools are blind.

Catalog record

CREATORXuanyu Su, Diana Inkpen, Nathalie Japkowicz
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20256

Browse the full library · About the Tower of Babel