Content Moderation in TV Search: Balancing Policy Compliance, Relevance, and User Experience Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Con
Adeep Hande, Kishorekumar Sundararajan, Sardar Hamidian, Ferhan Ture · 2025
Read Content Moderation in TV Search: Balancing Policy Compliance, Relevance, and User Experience Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Con by Adeep Hande, Kishorekumar Sundararajan, Sardar Hamidian, Ferhan Ture (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17207.txt.
Introduction
Adeep Hande and co-authors add a moderation layer to television search in a 2025 paper. Millions use platform search to find shows, and modern engines mix ranking with deep learning to surface results. Even so, search can return content that is off-policy or simply not what the user meant, through model quirks, bad metadata, or design gaps. Such slips erode trust.
Their fix runs large language models as a check after results are ranked. The layer flags items the user plausibly did not intend to find. Flags feed back into the retrieval system, so the base search improves over time instead of leaning on the filter forever. The authors present the layer as a quality baseline for entertainment search, aimed at a safer and more reliable experience.
Catalog record
| CREATOR | Adeep Hande, Kishorekumar Sundararajan, Sardar Hamidian, Ferhan Ture |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-17207
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Content Moderation in TV Search: Balancing Policy Compliance, Relevance, and User Experience Conference: Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval; July 13–18, 2025; Padua, Italy Proceedings of the 48th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR ’25), July 13–18, 2025, Padua, Italy DOI: 10.1145/3726302.3731962 ISBN: 979-8-4007-1592-1/2025/07 CCS: Information systems Retrieval effectiveness Adeep Hande, Kishorekumar Sundararajan, Sardar Hamidian, Ferhan Ture Abstract . Millions of people rely on search functionality to find and explore content on entertainment platforms. Modern search systems use a combination of candidate generation and ranking approaches, with advanced methods leveraging deep learning and LLM-based techniques to retrieve, generate, and categorize search results. Despite these advancements, search algorithms can still surface inappropriate or irrelevant content due to factors like model unpredictability, metadata errors, or overlooked design flaws. Such issues can misalign with product goals and user expectations, potentially harming user trust and business outcomes. In this work, we introduce an additional monitoring layer using Large Language Models (LLMs) to enhance content moderation. This additional layer flags content if the user did not intend to search for it. This approach serves as a baseline for product quality assurance, with collected feedback used to refine the initial retrieval mechanisms of the search model, ensuring a safer and more reliable user experience. 1. Introduction The rapid expansion of digital TV content and the increasing adoption of text and voice-activated searches on entertainment platforms have amplified the challenges of content moderation ( Allam and Dinana 2021 ) . Unlike traditional systems where content that is deemed to be problematic may be outright removed, entertainment platforms have to retain the complete catalog to harbor diverse user preference across the whole customer-base –even when some items contain sensitive or potentially offensive material. This issue is particularly pertinent to TV search environments, where the user has access to a broad range of programming options on TV such as TV shows, Sports, and movies. While existing filtering mechanisms such as age-based restrictions or parental control settings operate by predefined rules that block certain categories of content, our approach explores beyond static filtering by considering contextual appropriateness based on user queries and retrieved results, to flag any entity that may be deemed sexist, offensive or xenophobic concerning the user intent. Consequently, the challenge lies not in removing content altogether but in developing a system that can proactively filter search results, without altering the parent catalog, and allowing only contextually appropriate content in the search results. This delicate balance is essential to enhancing user satisfaction by retrieving the best search results relevant to the users’ queries while adhering to the content policies and guidelines ( Yum and Kim 2024 ) . In addition to the inherent challenges of context-aware filtering, the task is further exacerbated by faulty or inconsistent metadata, which can potentially lead to misclassified search results that appear relevant but are in fact, inappropriate. Furthermore, the evolving semantics of the language in user queries ( Karjus and Cuskley 2024 ) . Words and phrases that were once considered benign and appropriate may have newer connotations over time, depending on cultural and social shifts ( Rodman 2020 ; Jeresano and Carretero 2022 ) . This dynamic nature of language evolution means that having a static set of filtering rules becomes obsolete over time, underscoring the need for an adaptive system. It is worth noting that, although most existing search and retrieval approaches aim to mitigate these anomalies during model training ( Chen et al. 2023 ) and data preprocessing, certain cases remain unaddressed. This additional degree of assurance is designed to capture unavoidable experiences that the initial model failed to account for. Search Command Search Result Label Reason Church songs Documentary on church scandals ✗ Mismatch with user intent; highlights controversies instead of requested content. Women empowerment Movies depicting toxic female stereotypes or sexual orientation ✗ Contradicts the theme of the user query; reinforces negative stereotypes. Children’s shows TV series with adult themes ✗ Inappropriate for the intended audience; including content unsuitable for children. Educational shows Science documentaries for students ✓ Aligns with the user intent; provides age-appropriate and relevant educational content. Table 1. Examples of flagged results with corresponding flags and reasons. Note: The queries and results displayed here are representative of the thematic content of the flagged results and not the actual text, which is omitted to maintain user privacy and avoid potential inaccuracies or legal concerns. ✗ indicates a flagged result, while ✓ denotes acceptable results. Our framework operates in a dual-stage process. The primary stage applies structured meta-heuristic filtering, as shown in Algorithm 1 , leveraging predefined lexicons and dynamically updated sensitivity scores to flag potentially inappropriate search results - ensuring the content remains accessible while aligning with platform policies. The secondary stage incorporates a large language model (LLM) ( Grattafiori et al. 2024 ) to validate and refine real-time flagged results, ensuring adaptability to evolving user intent and language semantics. To clarify filtering decisions, sensitivity scores dynamically adjust based on real-time flagged instances, integrating historical patterns and validation feedback. In contrast to static rules, this approach continuously refines lexicons and scoring mechanisms, rather than generating entirely new lexicons. By integrating LLM validation, this framework enhances precision and accuracy, ensuring that content moderation remains scalable and policy-compliant while retaining a complete catalog of user requests. As content appropriateness is heavily influenced by user intent and context, no benchmark datasets or directly comparable models exist for evaluation. To ensure consistent and policy-compliant moderation, flagged search results undergo offline evaluation, where previous-day queries are evaluated, and all flagged instances are reviewed by an editorial team before any final action is taken. While this remains a proactive approach, the continuous feedback loop from editorial review further refines filtering over time. This framework ensures content retrieved remains aligned with platform guidelines while preserving user experience. This iterative lexicon refinement also serves as a foundation for transitioning to a smaller, distilled model, ultimately enabling real-time content moderation without on-demand LLM inference. Figure 1. System overview of the filtering pipeline. Queries and results undergo metadata extraction, heuristic filtering, and LLM validation. True positives refine moderation, while false positives update sensitivity scores. Flagged results are thematic representations; titles omitted for privacy. LLM: LLAMA-3.1-8B ( Grattafiori et al. 2024 ) 2. Methodology Input: Query Q , Results R , Metadata M , Lexicons L , Time t , Similarity Threshold T_{s} , Flagging Threshold \beta Output: Flagged Set F 1 2 Function g( x ) : 3 S_{\text{total}}\leftarrow 0 ; 4 N(x)\leftarrow|x| ; 5 foreach L_{j}\in x do 6 return \dfrac{\sum_{L_{j}\in x}S(L_{j},t)}{N(x)} ; 7 // Computes the average sensitivity score for query, result, or metadata 8 Function S(L_{j},t) : 9 return \alpha\Big(1-\dfrac{f(L_{j},0)}{\sum_{k}f(L_{k},0)}\Big)+(1-\alpha)\dfrac{f(L_{j},t)}{\sum_{k}f(L_{k},t)} ; 10 // (2) Time-adaptive lexicon scoring function 11 F\leftarrow\emptyset ; 12 13 foreach r\in R do 14 Compute embedding v_{Q}\leftarrow\text{Embed}(Q) ; 15 Compute embedding v_{r}\leftarrow\text{Embed}(r,M) ; 16 s\leftarrow\cos(v_{Q},v_{r}) ; 17 18 if s\geq T_{s} then 19 g(Q)\leftarrow\textnormal{{g}}(Q) ; 20 // Compute query score after cosine check 21 g(r)\leftarrow\textnormal{{g}}(r) // Compute score for result g(m)\leftarrow\textnormal{{g}}(m) // Compute score for metadata 22 if g(Q)<\beta and ( g(r)>\beta or g(m)>\beta ) then 23 F\leftarrow F\cup\{r\} ; 24 return F