A Fuzzy Evaluation of Sentence Encoders on Grooming Risk Classification

Geetanjali Bihani, Julia Rayz · 2025

Read A Fuzzy Evaluation of Sentence Encoders on Grooming Risk Classification by Geetanjali Bihani, Julia Rayz (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12576.txt.

Introduction

Geetanjali Bihani and Julia Rayz test sentence encoders on grooming risk in chats, in a 2025 paper. Online grooming puts children at risk, yet predators rarely speak plainly at first. They build trust slowly and hide intent in coded, indirect words. Models tuned to spot grooming may miss those soft signals.

The authors use a fuzzy framework that maps human judgments to degrees of risk. Three groups supplied the judgments: law officers, real victims, and decoys. Fine-tuned encoders failed most where predators used indirect speech paths. Those same samples held more words outside the model's known vocabulary. The gap shows why coded language needs direct attention in safety tools.

Catalog record

CREATORGeetanjali Bihani, Julia Rayz
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-12576

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Fuzzy Evaluation of Sentence Encoders on Grooming Risk Classification Geetanjali Bihani, Julia Rayz Abstract With the advent of social media, children are becoming increasingly vulnerable to the risk of grooming in online settings. Detecting grooming instances in an online conversation poses a significant challenge as the interactions are not necessarily sexually explicit, since the predators take time to build trust and a relationship with their victim. Moreover, predators evade detection using indirect and coded language. While previous studies have fine-tuned Transformers to automatically identify grooming in chat conversations, they overlook the impact of coded and indirect language on model predictions, and how these align with human perceptions of grooming. In this paper, we address this gap and evaluate bi-encoders on the task of classifying different degrees of grooming risk in chat contexts, for three different participant groups, i.e. law enforcement officers, real victims, and decoys. Using a fuzzy-theoretic framework presented in [ 3 ] , we map human assessments of grooming behaviors to estimate the actual degree of grooming risk. Our analysis reveals that fine-tuned models fail to tag instances where the predator uses indirect speech pathways and coded language to evade detection. Further, we find that such instances are characterized by a higher presence of out-of-vocabulary (OOV) words in samples, causing the model to misclassify. Our findings highlight the need for more robust models to identify coded language from noisy chat inputs in grooming contexts. 1 Introduction Grooming refers to the insidious process where predators forge a relationship with children and build up trust with the intention of sexual exploitation ring21 . In bihanirayz24_regress , we noted that models assign much lower risk scores to high-risk chat contexts because these contexts contain implicit and coded language. In this work, we follow up on this initial investigation and evaluate Transformer-based classifiers on the task of detecting different degrees of grooming risk in online grooming conversations. We approach this task with a non-binary perspective, recognizing the necessity to differentiate between different levels of risk, because it can inform targeted preventive measures to safeguard individuals in realistic scenarios. Grooming has been described as a complex multi-stage phenomenon, with the severity of grooming varying as the chat progresses ring21 ; olson2007 . Yet, works on automated grooming detection usually frame it as a binary classification problem preub2021 ; vogt2021 , categorizing entire chat instances as either grooming or non-grooming. Existing methods for grooming detection primarily rely on decoy conversations to train and fine-tune neural language models vogt2021 . Whether decoy conversations can be used to approximate real grooming scenarios has been contested in linguistic and cyberforensic analyses of online grooming conversations chiang19 ; ring21_2 ; ring22 . This disparity in data distribution can have an impact on the generalization of such models when applied out of distribution (OOD). We aim to address these gaps in this paper by evaluating Transformer sentence encoders on the task of classifying degrees of grooming risk expressed in natural language. We evaluate these models across diverse participant groups, specifically for real victims, law enforcement officers (LEO), and decoys. To that end, we use the fuzzy-theoretic framework that maps human assessments of grooming behaviors present within chats to the severity of grooming risk, as given in bihanirayz24_regress . Our analysis reveals that fine-tuned sentence encoder classifiers show an increased rate of errors in identifying high-risk chat contexts, which is caused by the indirect speech pathways used by predators to manipulate and coerce victims. We find that Transformer classifiers fail to flag cases that contain coded language and lack sexually explicit content. Further, we find that the proportion of coded language used in grooming chats across different participant groups varies, causing the models to have different performance across populations. This finding underscores the importance of robust modeling of indirect speech acts by language models, especially those utilized by predators. Notably, to the best of our knowledge, no prior work has incorporated human assessments of risk to compare fine-tuning results, making our study unique in its comprehensive evaluation of language model performance in grooming risk classification. 2 Categorizing Grooming Risk The concept of risk, much like other subjective notions, embodies fuzziness. This fuzziness becomes apparent when considering grooming strategies, where what constitutes risky behavior and what does not is often blurry. These degrees of severity are influenced by the presence of grooming strategies within a given context ring21 . Moreover, grooming strategies employed by individuals with malicious intent, can vary widely in their subtlety and perceived harm ring21 . Similar to the concept of risk, the assessment of grooming strategies itself lacks a precise boundary, as it depends on various factors such as individual perceptions, cultural norms, and situational contexts. Figure 1: Presence of grooming strategies present within a given chat context used to create grooming risk categories In this work, we use grooming strategies present within a given text to create grooming risk categories using membership functions defined in bihanirayz24_regress . Cyberforensic analyses of grooming conversations have shown a higher presence of grooming strategies within more advanced stages of grooming ring21 . Based on these findings, we utilize human annotations for the presence of twelve grooming strategies, as described in ring21 to estimate the degree of risk in a chat context. For a given chat context c , we define the total number of observed grooming strategies o(c) as the sum of individual strategy scores s_{i} , where each s_{i}\in\{0,0.5,1\} represents the absence (0), partial presence (0.5), or full presence (1) of the i^{th} strategy. This is shown in Equation 1 , also described in prior work bihanirayz24_regress . Ideally, the maximum number of strategies assigned to a single chat line can be 12. However, we find that in our data, such cases do not occur, with the highest number of strategies used together limited to 5. This can be attributed to the limited context that the predator has to work with, where they test out different strategies during different stages of the conversation kloess2017 . For a detailed description of the grooming strategies used in this work, please refer to Table 3 in the Appendix. o(c)=\sum_{i=1}^{N}s_{i}(c) (1) \mu_{risk}(c)=\varphi\left(o(c)-m\right)\text{, where }\varphi(z)=\frac{e^{-z^{2}/2}}{\sqrt{2\pi}} (2) \mu_{mod}(c)=\mu^{0.2}_{risk}(c)\text{ for $m=0.2$} (3) \mu_{sig}(c)=\mu_{risk}(c)\text{ for $m=1$} (4) \mu_{sev}(c)=\mu^{2}_{risk}(c)\text{ for $m=2$} (5) We employ a Gaussian membership function to map the overall strategy membership (o(c)) to various degrees of grooming risk, as outlined in Equation 2 . While this equation was originally introduced in bihanirayz24_regress for fuzzy evaluation of grooming risk scoring, we leverage this framework to delineate grooming risk into three distinct severity levels, which are not necessarily mutually exclusive. These categories are defined as moderate , significant , and severe levels of grooming risk, arranged in ascending order of risk severity. The respective fuzzy membership functions for moderate, significant, and severe risk are defined in Equations 3 , 4 and 5 . Using this method, chat contexts with fewer grooming strategies are assigned higher membership values within the moderate risk category. Conversely, those with a greater number of strategies present receive higher memberships within the significant and severe grooming risk categories. For our classifier fine-tuning process, we defuzzify the risk degree using an \alpha -cut =0.5 , selecting the highest degree of risk membership exceeding

Read the complete text