When Rules Fall Short: Agent-Driven Discovery of Emerging Content Issues in Short Video Platforms DOI: XXXXXXX.XXXXXXX Conference: The Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Natural language processing CCS: Com
Chenghui Yu, Hongwei Wang, Junwen Chen, Zixuan Wang, Bingfeng Deng, Zhuolin Hao, Hongyu Xiong, Yang Song · 2026
Read When Rules Fall Short: Agent-Driven Discovery of Emerging Content Issues in Short Video Platforms DOI: XXXXXXX.XXXXXXX Conference: The Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Natural language processing CCS: Com by Chenghui Yu, Hongwei Wang, Junwen Chen, Zixuan Wang, Bingfeng Deng, Zhuolin Hao, Hongyu Xiong, Yang Song (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11634.txt.
Introduction
Chenghui Yu and seven coauthors hunt new content issues on short video apps. Their 2026 preprint uses agents to find what rules miss. Trends on such platforms evolve at a rapid pace. New content issues emerge daily outside policy coverage.
Human-driven discovery of those issues is too slow. Slow discovery delays updates to annotation policies. Delayed policies leave harmful content up for longer. The team builds an agent-driven discovery process instead. Agents can scan trends and flag emerging issue types. Governance then updates rules at the pace of the platform. The work targets trust and safety at web scale.
Catalog record
| CREATOR | Chenghui Yu, Hongwei Wang, Junwen Chen, Zixuan Wang, Bingfeng Deng, Zhuolin Hao, Hongyu Xiong, Yang Song |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-11634
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When Rules Fall Short: Agent-Driven Discovery of Emerging Content Issues in Short Video Platforms DOI: XXXXXXX.XXXXXXX Conference: The Web Conference 2026; April 13–17, 2026; Dubai, United Arab Emirates ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Computer vision CCS: Computing methodologies Artificial intelligence CCS: Information systems Language models Chenghui Yu, Hongwei Wang, Junwen Chen, Zixuan Wang, Bingfeng Deng, Zhuolin Hao, Hongyu Xiong, Yang Song Abstract . Trends on short-video platforms evolve at a rapid pace, with new content issues emerging every day that fall outside the coverage of existing annotation policies. However, traditional human-driven discovery of emerging issues is too slow, which leads to delayed updates of annotation policies and poses a major challenge for effective content governance. In this work, we propose an automatic issue discovery method based on multimodal LLM agents. Our approach automatically recalls short videos containing potential new issues and applies a two-stage clustering strategy to group them, with each cluster corresponding to a newly discovered issue. The agent then generates updated annotation policies from these clusters, thereby extending coverage to these emerging issues. Our agent has been deployed in the real system. Both offline and online experiments demonstrate that this agent-based method significantly improves the effectiveness of emerging-issue discovery (with an F1 score improvement of over 20%) and enhances the performance of subsequent issue governance (reducing the view count of problematic videos by approximately 15%). More importantly, compared to manual issue discovery, it greatly reduces time costs and substantially accelerates the iteration of annotation policies. (a) A variant of an existing sub-issue in Clickbait (b) A new sub-issue in Unpleasant & Disturbing Content Figure 1 . Examples of emerging content issues in short videos uploaded by users. See Section 1 for more details. Figure 2 . Illustration of the issue discovery agent. Given a short video and the annotation policies for a specific issue, the agent follows a four-phase process to categorize videos into four cases (Cases 1 – 4), and finally produces an updated version of the annotation policies. The agent can autonomously choose to invoke certain tools. See Section 4 for more details. 1. Introduction Short videos uploaded by users on TikTok may contain various content issues , such as sexually suggestive content, non-original content, clickbait, or unpleasant & disturbing content. These problematic videos may negatively impact the users’ FYF(For You feed) experience and the sustainable development of the community ( 15 ) . To address this, our platform employs governance models to detect whether videos include such issues. Typically, the platform first establishes detailed annotation policies for identifying each specific issue. These annotation policies are then used to train human annotators who label a set of videos accordingly. Finally, the labeled dataset is used to train governance models, which can automatically identify problematic videos at scale. From the perspective of content governance, the relationship between the platform and users resembles a “cat-and-mouse” dynamic. The platform strives to design broader and more detailed policies to cover more issues, while users, whether intentionally or unintentionally, upload videos that contain variants of existing issues or entirely new ones, thereby evading the scope of the policies. Figure 1 illustrates two examples: (1) As shown in Figure 1(a) , within the Clickbait issue and specifically the False Promises of Interaction sub-issue, we observe a new emerging variant: using stickers with “ #teamwork ” to induce likes or follows. However, the keyword “ teamwork ” is not included in the definition of this sub-issue. (2) As shown in Figure 1(b) , under the issue of Unpleasant & Disturbing Content , we identify a new sub-issue: AI-generated content that morphs food into human-like forms, often paired with eating sound effects and scenes of consuming the same items. Such visuals can be disturbing, but they do not fit into the definition of any existing sub-issue. Trends on TikTok evolve at an extremely rapid pace. A new video may appear today, and within just a few days, the platform can be flooded with countless imitations. Therefore, promptly identifying emerging content issues and establishing new annotation policies is a critical task for the platform. At present, the process is entirely manual : First, based on user reports and proactive screening by moderators, a set of candidate videos suspected of containing emerging issues is collected. Next, the content governance team assesses whether these videos have sufficient impact and potential harm. If so, new annotation policies are created for the new issue, or existing policies are updated to cover the identified variant. However, this manual workflow is highly time-consuming, often taking several months to complete, which leaves the platform reacting very slowly to new issues. Moreover, relying solely on human judgment introduces strong subjectivity with inconsistent criteria, resulting in suboptimal annotation policies. To overcome the limitations of the fully manual process, one promising approach is to introduce machine learning models for automatic discovery of new issues. However, a clear challenge arises: since the target is previously undefined issues, we typically have few or no labeled samples available, making supervised learning methods inapplicable. This means the models must rely largely on analyzing the content of the videos themselves and understanding annotation policies to make decisions. These constraints lead us to explore MLLM-based agents as a potential solution. MLLMs bring extensive world knowledge, and the agent framework allows them to leverage planning and reasoning capabilities for complex tasks. This paper introduces our progress in applying the agent approach to emerging issue discovery . As shown in Figure 2 , the workflow of our agent can be divided into four phases: • Recalling suspicious videos . Given a short video and the annotation policies for a specific issue, the agent first determines whether the video is likely to contain that issue by any chance. If the answer is no, the video is classified as normal and filtered out. • Assessing the coverage of existing policies . The agent then checks whether the issue present in the video is already covered by the existing annotation policies. If it is, the video is categorized as an instance of an existing sub-issue and filtered out. At this stage, the agent may also use governance models as auxiliary tools to assist in the judgment. • Determining variants vs. new issues . Here, the agent decides whether the video represents a variant of an existing sub-issue or introduces an entirely new sub-issue. To achieve this, the agent applies a two-stage clustering method to a batch of input videos, which assigns each video either to an existing cluster or to a newly created cluster. In addition, the agent may employ two tools: an embedding tool and a memory tool, to support its decision. • Evolving the policies . Once the clusters for variants and new sub-issues are formed, the agent summarizes them and generates updated policies. These updated policies are used to guide human annotators to label new data for training governance models. They can also be iteratively refined by the issue discovery agent in real-world deployment environments. We conduct offline experiments on two content issues. The results demonstrate that, compared with supervised fine-tuning based approaches, our agent-based method achieves significant improvements in the issue discovery task. Specifically, the best-performing