Revealing Hidden Mechanisms of Cross-Country Content Moderation with Natural Language Processing
Neemesh Yadav, Jiarui Liu, Francesco Ortu, Roya Ensafi, Zhijing Jin, Rada Mihalcea · 2025
Read Revealing Hidden Mechanisms of Cross-Country Content Moderation with Natural Language Processing by Neemesh Yadav, Jiarui Liu, Francesco Ortu, Roya Ensafi, Zhijing Jin, Rada Mihalcea (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-05280.txt.
Description
Governments censor social media posts, but the rules behind each removal are rarely visible from outside. Neemesh Yadav and co-authors use language technology to reverse-engineer those rules across countries. They train classifiers on collections of posts sampled from the old Twitter stream and study which posts each country blocked.
The team explains the classifiers' calls with importance scores and with plain-language explanations drafted by language models. Human judges then rated how good those explanations were across three different models. Patterns emerged in what gets censored, both between countries and across time. The authors close with the limits and ethics of peering into state censorship this way. Their code and data are public for others to build on.
Catalog record
| CREATOR | Neemesh Yadav, Jiarui Liu, Francesco Ortu, Roya Ensafi, Zhijing Jin, Rada Mihalcea |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-05280