A Classification System Approach in Predicting Chinese Censorship New York University
Tianchu Ze, Yushen Hu, Matt Prodani · 2025
Read A Classification System Approach in Predicting Chinese Censorship New York University by Tianchu Ze, Yushen Hu, Matt Prodani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04234.txt.
Introduction
Matt Prodani, Tianchu Ze, and Yushen Hu built classifiers to predict censorship of social media posts in a 2025 study. Their data come from Weibo, a major Chinese platform, sampled from an earlier research collection. Chinese text needs its own tokenizing steps before a model can read phrases cleanly.
The team built a cleaned phrase data set marked for whether each post was censored. They trained several logistic regression models using probability based retrieval features. They also fine-tuned a transformer model for the same task. On their chosen scores, the fine-tuned transformer beat the simpler models. The work shows what signals automated censorship prediction relies on.
Catalog record
| CREATOR | Tianchu Ze, Yushen Hu, Matt Prodani |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04234
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Classification System Approach in Predicting Chinese Censorship New York University Tianchu Ze, Yushen Hu, Matt Prodani Abstract This paper is dedicated to using a classifier to predict whether a Weibo post would be censored under the Chinese internet. Through randomized sampling from Weiboscope 2021 and Chinese tokenizing strategies, we constructed a cleaned Chinese phrase dataset with binary censorship markings. Utilizing various probability-based information retrieval methods on the data, we were able to derive 4 logistic regression models for classification. Furthermore, we experimented with pre-trained transformers to perform similar classification tasks. After evaluating both the macro-F1 and ROC-AUC metrics, we concluded that the Fined-Tuned BERT model exceeds other strategies in performance. 1 Introduction Introduced around the start of the 21st Century, China’s national firewall had been acting as a means of censorship for foreign websites and sensitive information. Without any specific political message or inclination, our project is driven by a recent upgrade of “security measures” for the firewall by Beijing. In other words, more sensitive keywords are incorporated into the censorship measurement. Similar updates had been observed in history, most recently in 2012. Briefly, that historical tightening of security was due to a shift of power within the Chinese government and a rumored coup d’etat. The event happening from November through December of 2022 is not a political discourse, but more of a rise of tension within the general public due to China’s zero-tolerance restriction enforcement across the country to prevent COVID-19. Again, this paper is not intended to make a political voice, but to explore the feasibility of reverse engineering a censorship label system using NLP techniques and ML classification libraries. Therefore, the paper will look into various ways of modeling strategies to find the highest-scored system. This project will incorporate data sources from various data sources on different dimensions of the Chinese internet, but mostly from the blog website, Weibo. The platform is considered the Twitter of China and had been referenced in multiple prior pieces of research. We do acknowledge that different access times of the platform may or most likely will contain different subsets of censored keywords or queries. But, our goal is to identify such supersets that will be banned undoubtedly. For example, information in regards to the June 4th protests against Beijing. Additionally, data sources referenced within this paper mostly come from the western world and large discrepancies will persist. After all, our priority of the project is not to fully reconstruct the censorship library, but more on exploring if such a censorship annotator is feasible. 1.1 Workflow Figure 1: Team Workflow Diagram Our paper will be employing the Weiboscope 2021 API, which will be detailed in the following sections on data profiling. After splitting the test and development corpus, we will work with the development corpus and leave the testing one to the side. Before we perform any NLP methods, taking out the stop words and tokenizing each meaningful Chinese phrase is crucial. Due to the nature of the Chinese language, each character may mean something by itself or combined with its neighbors; there is no clear law in which the characters are combined. Therefore, we have employed a proven NLP library, Jieba , to perform such tokenization for us . After the split, 4 variations of information retriever inspired by a TFIDF approach from previous research will be applied to the training data from the development corpus to find feature vectors for each row Zhu et al. 2013 . Using the resulting features, a regression model will be constructed for all 4 retrievers to be evaluated. Furthermore, a model employing Bert will be considered as well for evaluation Devlin et al. 2018 . 2 Related Works Fu et al. 2013 provides an overview of censorship practices within the microblogs of Weibo. Specifically, it is a term extraction project, which showcased a list of censored topics or keywords for 2012, a period of tightening in internet censorship. This list mostly consists of political references to CCP scandals or the rumored coup d’etat, both strictly censored topics. But in terms of application to our research, this list was derived from Weiboscope 2021 . It is a data collection system built on Sina’s open API, that could track the timeline of thousands of users’ blogs and identify their removal status by repeated accessing. With over 111 million blogs collected in the year 2012, the API may serve as a great sample for the modeling of our classifier system. Zhu et al. 2013 serves as a basis for our research, as it suggests and investigates the hypothesis of the existence of a Chinese topic surveillance list. Additionally, it also employs Weiboscope 2021 along with the use of TF-IDF in topic and feature extraction. The paper concludes that the platform supports both explicit, implicit, and camouflaged filtering based on the content of each post. However, the paper mentioned their difficulties in the tokenization of Chinese text, as well as stopped at the stage of finding the list of term frequency for each word. Therefore, inspired by the paper, we continued after the TF-IDF stage and used these features to construct a logistic regression model. Lastly, the paper also mentioned how the user may play a role in censoring. If a user had been posting censored content, that account’s posts may be auto-deleted. This may be something to be noted during further research. Ahmed and Kumar M. 2021 serves as another basis for our research, as it employs pre-trained transformer models in XLNet, an auto-regressive model, to perform feature extraction as well as modeling. However, in this paper, our focus is on the evaluation scores. As their dataset is also implemented with Weiboscope 2021 and another modern library, their results may be used for comparison with others. Specifically, the authors also have implemented BERT as a part of their research for comparisons with XLNet. The highest F-1 score of their system on the validation data is 0.634, and that is our initial goal. Furthermore, the paper also influenced performing binary classification, as the result of our data processing is in a binary form. However, a classical logistic regression is chosen compared to XLNet’s regressor due to our implementation of a TF-IDF-like feature extractor along with Bert. Yang and Roberts 2021 uses a similar approach to what we are planning to use, it uses word embedding to calculate the similarity between Wikipedia and Baidu Baike, a Chinese version of Wikipedia. It identifies several target words that are mainly democratic political terms and propaganda. By calculating the cosine similarities, this paper deduces the differences in p-value and effect size of these words between Wikipedia and Baidu Baike. However, regarding our research goal, its main focus is on online encyclopedias, which are pre-written texts and lack user interactions. For our project, we are planning to apply a similar model to social media in China, in which the model provided by this paper will be helpful. In King et al. 2013 , rather than research based on the gathering of data, the author’s investigation of the censorship coverage on different Chinese sites and magnitude may be a reference for our weighting of each site’s result during evaluation. Another interesting field that