Covering Cracks in Content Moderation: Delexicalized Distant Supervision for Illicit Drug Jargon Detection

Minkyoo Song, Eugene Jang, Jaehan Kim, Seungwon Shin · 2025

Read Covering Cracks in Content Moderation: Delexicalized Distant Supervision for Illicit Drug Jargon Detection by Minkyoo Song, Eugene Jang, Jaehan Kim, Seungwon Shin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14926.txt.

Introduction

Minkyoo Song, Eugene Jang, Jaehan Kim, and Seungwon Shin present, in 2025, a framework that spots drug slang in online posts by reading context. Platforms must moderate drug sales and talk, but slang lists fail in two ways. Users swap letters to evade them, and words like pot or crack often have harmless meanings.

Their system learns from distant, weak labels and hides the slang words themselves during training, forcing it to use context. That makes it robust to new terms and coded spellings. On two hand-labeled datasets it beat word-based rivals in score and coverage. Checks also showed it handles the traps that fool list-based tools.

Catalog record

CREATORMinkyoo Song, Eugene Jang, Jaehan Kim, Seungwon Shin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-14926

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Covering Cracks in Content Moderation: Delexicalized Distant Supervision for Illicit Drug Jargon Detection Minkyoo Song, Eugene Jang, Jaehan Kim, Seungwon Shin Abstract . In light of rising drug-related concerns and the increasing role of social media, sales and discussions of illicit drugs have become commonplace online. Social media platforms hosting user-generated content must therefore perform content moderation, which is a difficult task due to the vast amount of jargon used in drug discussions. Previous works on drug jargon detection were limited to extracting a list of terms, but these approaches have fundamental problems in practical application. First, they are trivially evaded using word substitutions. Second, they cannot distinguish whether euphemistic terms ( pot , crack ) are being used as drugs or as their benign meanings. We argue that drug content moderation should be done using contexts, rather than relying on a banlist. However, manually annotated datasets for training such a task are not only expensive but also prone to becoming obsolete. We present JEDIS , a framework for detecting illicit drug jargon terms by analyzing their contexts. JEDIS utilizes a novel approach that combines distant supervision and delexicalization, which allows JEDIS to be trained without human-labeled data while being robust to new terms and euphemisms. Experiments on two manually annotated datasets show JEDIS significantly outperforms state-of-the-art word-based baselines in terms of F1-score and detection coverage in drug jargon detection. We also conduct qualitative analysis that demonstrates JEDIS is robust against pitfalls faced by existing approaches. Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1; August 3–7, 2025; Toronto, ON, Canada Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1 (KDD ’25), August 3–7, 2025, Toronto, ON, Canada DOI: 10.1145/3690624.3709183 ISBN: 979-8-4007-1245-6/25/08 CCS: Computing methodologies Artificial intelligence CCS: Information systems Information systems applications 1. Introduction Figure 1 . Content moderation procedures of word-based system and context-based system. Bolded words in Input were predicted by each system. In the Result , words detected as drug jargon are colored red , and words predicted as non-drugs are colored blue . Drug-related deaths are at record highs, with annual drug overdose deaths in the US more than doubling since 2015 ( of Health, 2022 ; for Disease Control and Prevention, 2022 ) . In March 2022, the United Nations urged governments to further regulate social media, citing a link between exposure to social media and drug abuse ( Nations, [n. d.] ) . Illicit sales and discussion of drugs have become prevalent online not only on anonymous marketplaces ( Soska and Christin, 2015 ; Branwen et al., 2015 ) but also on social media ( Qian et al., 2021 ; Zhu et al., 2021 ) . On top of illegal drugs, online discussion of legal drugs for non-medical recreational usage has also become commonplace ( Soussan and Kjellgren, 2014 ; Rönkä and Katainen, 2017 ) . Without sufficient moderation, social media can expose the general public to sales of illegal drugs ( Mackey and Kalyanam, 2017 ; Mackey et al., 2017 ) and dangerous drug misinformation ( Cone, 2006 ) . Content moderation is a difficult and labor-intensive task. Although content moderators often face psychological distress from large volumes of explicit content ( Steiger et al., 2021 ) , automating moderation of user-generated content is challenging. Even for human moderators, understanding the slang and jargon used in illegal content requires significant domain knowledge. Previous works have addressed this by discovering jargon terms ( Yang et al., 2017 ; Yuan et al., 2018 ; Zhao et al., 2016 ) , interpreting jargon terms ( Seyler et al., 2021a ; Seyler et al., 2021b ) , or both ( Zhu et al., 2021 ) . Practically, however, moderation systems relying on a banlist of jargon terms suffer from two main limitations. Figure 1 shows an example input that demonstrates the limitations of a word-based moderation system. First, word-based restrictions are easily bypassed by alternative terms for moderated words ( Magu et al., 2017 ) . This not only includes newly emerging words, but also misspellings of known banned words ( cokaine , c0caine ). Second, euphemistic jargon has benign usages that can cause false positives. While speed requires moderation when referring to amphetamines, it should not be moderated when referring to quickness. In order to effectively address such limitations, moderation systems must be trained to evaluate words within their specific context. Thus, for more practical content moderation automation, we define jargon detection as a sentence-level task of identifying if a word, within its specific context, is used as drug jargon. To the best of our knowledge, this sentence-level approach for deriving contextual information is a novel direction in drug content moderation research. We propose JEDIS (Jargon and Euphemism Detection of Illicit Substances), a novel drug jargon detection framework that performs context-aware detection of jargon instances. JEDIS utilizes distant supervision to keep up with complex and fast-evolving drug slang without depending on expensive manual annotations from domain experts. Drug jargon contexts from an unlabeled text corpus are learned by leveraging only a small list of known drug seed terms. Given an incomplete and small knowledge base for distant supervision, the model may overfit to the seed terms. To generalize detection, JEDIS employs an innovative training strategy that effectively utilizes learned contexts. Specifically, JEDIS uses two independent modules to represent contextual and lexical information separately. The delexicalized context-only module mitigates the excessive focus on the target word by extracting context information alone. The word attribute module preserves target word information to address imprecise detection caused by delexicalization. This allows JEDIS to robustly detect unrecognized terms and accurately distinguish between euphemisms. We construct two human-labeled datasets to evaluate moderation approaches on user-generated drug context sentences. Our findings suggest that word-based methods perform poorly with content in the wild due to their limitations. We find that JEDIS substantially outperforms state-of-the-art moderation approaches in F1-score across both evaluation datasets. Specifically, JEDIS successfully detects an average of 4.23 times more various drug jargon terms compared to word-based baselines. It also highlights the need for a tailored context-based method for effective drug jargon detection. Qualitative analysis shows JEDIS detects jargon in scenarios that previous approaches struggled with. Our contributions are as follows: • Propose JEDIS , a drug jargon detection framework robust to unseen words and euphemisms by effectively combining contextual and lexical information without requiring labeled training data. • Propose delexicalized distant supervision for JEDIS training, enabling generalization to new terms without overfitting to a small set of drug seed terms. • Create two datasets of forum texts annotated for drug jargon instances to evaluate drug jargon detection 1 1 1 Our code is available at https://github.com/minkyoo9/JEDIS . . • Empirically demonstrate limitations of word-based moderation in practical scenarios, which suggest the necessity of context-based moderation. • Empirically show shortcomings of recent language model with prompts in drug jargon detection, underscoring the need for a tailored detection method. 2. Background 2.1. Preliminaries We define drug jargon as words used to refer to illicit drug substances or abused legal drug substances. This can include both explicit substance names ( MDMA , ketamine ) and street names ( Molly , ket ).

Read the complete text