YT-30M: A multi-lingual multi-category dataset of YouTube comments Hridoy Sankar Dutta Abstract This paper introduces two large-scale multilingual comment datasets, YT-30M (and YT-100K) from YouTube. The analysis in this paper is performed on a smaller sample (YT-100K) of YT-30M. Both the datasets: YT-30M (full) and YT-100K (randomly selected 100K sample from YT-30M) are publicly released for further research. YT-30M (YT-100K) contains 32236173 32236173 ( 108694 108694 ) comments posted by YouTube channel that belong to YouTube categories. Each comment is associated with a video ID, comment ID, commentor name, commentor channel ID, comment text, upvotes, original channel ID and category of the YouTube channel (e.g., ‘News & Politics’, ‘Science & Technology’, etc.). Datasets — https://huggingface.co/datasets/hridaydutta123/YT-100K Introduction The recent popularity of video-sharing platforms such as YouTube has revolutionized how people consume and create content in the online world. With a massive number of monthly active users and a significant increase in engagement, YouTube plays a critical role in digital marketing and content consumption ( Rieder et al. 2023 ) . The creation of a multilingual dataset for YouTube is important for understanding cultural nuances and sentiment expressions that vary from one language to another. Adding the multicategory feature is additionally important for comprehending the reasons behind these nuances and expressions across different types of content. Unlike a few social media platforms such as Twitter ( Chang et al. 2023 ; Pfeffer et al. 2023 ; Shaik et al. 2023 ; Comito, Caroprese, and Zumpano 2023 ) and Facebook ( Aljabri et al. 2023 ; Perrotta et al. 2021 ; Ernala et al. 2020 ) , which have been thoroughly studied by the academic community in previous years, today YouTube accounts for a significant share of this market, as it is the second most visited website globally after Google. This paper presents the first large-scale multilingual multi-category dataset, YT-30M 1 1 1 Only preliminary analysis on YT-100K dataset is provided in this version of the paper. The analysis and use cases can be easily performed on the main dataset with high computational power. for comment classification tasks on YouTube. To the best of our knowledge, YT-30M is the largest publicly available YouTube dataset for academic research. Table 1 shows sample multilingual comments from our collected dataset for 5 different languages. YT-30M contains comments from more than 50 different languages. Figure 1 displays a sample YouTube comment from our dataset along with all the features collected for that comment. Language Text English You girls are so awesome!! French Ceci est un commentaire German Das Geräusch eurer Klingel erinnert mich an ei… Spanish jajajaj esto tiene que ser una brom Portuguese nossa senhora!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!… Table 1: Sample multilingual comments posted on YouTube in 5 different languages. ⬇ { " videoID ": " ab9fe84e2b2406efba4c23385ef9312a ", " commentID ": "488 b24557cf81ed56e75bab6cbf76fa9 ", " commentorName ": " b654822a96eae771cbac945e49e43cbd ", " commentorChannelID ": "2 f1364f249626b3ca514966e3ef3aead ", " comment ": " ich fand den Handelwecker am besten ", " votes ": 2, " originalChannelID ": " oc_2f1364f249626b3ca514966e3ef3aead ", " category ": " entertainment " } Figure 1: A YouTube comment from YT-30M Figure 2: The main plot shows the proportion of languages detected in YouTube comments. The inset plot shows the proportion of YouTube categories. Figure 3: Upvotes distribution for YouTube categories. Dataset characteristics Each entry in the dataset is related to one comment for a specific YouTube video in the related category with the following columns: videoID, commentID, commentorName, commentorChannelID, comment, votes, originalChannelID, category. Each field is explained below: 1. videoID: represents the video ID in YouTube. 2. commentID: represents the comment ID. 3. commentorName: represents the name of the commentor. 4. commentorChannelID: represents the ID of the commentor. 5. comment: represents the comment text. 6. votes: represents the upvotes received by that commment. 7. originalChannelID: represents the original channel ID who posted the video. 8. category: represents the category of the YouTube video. Table 2 details the statistics of the YT-30M dataset. We have 32,236,173 (32 million) unique YouTube comments from 178,027 videos posted by 20,568,637 (20 million) unique commentors. It is important to note that all Personally Identifiable Information (PII) has been redacted in the released dataset. Table 2: Statistics of YT-30M Field YT-30M Number of videos 178027 Number of comments 32236173 Number of commentors 20568637 Data analysis Due to computational limitations, we performed our analysis on the small dataset YT-100K. YT-100K contains a random selection of 100,000 comments from the YT-30M dataset. Figure 2 shows the proportion of different languages detected in our comment dataset, while Figure 2 (inset) illustrates the distribution of categories across the dataset. Our multilingual dataset includes comments from more than 50 languages, which were detected using the Python langdetect library. Each comment is mapped to a category corresponding to its associated YouTube channel. The category assigned to each comment helps in understanding broader societal trends present within each category. Every comment in the dataset includes the number of upvotes it has received on YouTube. Figure 3 displays the upvote distribution for YT-30M across different YouTube categories. We observe that certain categories, such as music, news, and people, which are more engaging to habitual users (subscribers/members), receive a higher number of upvotes (more than 100 votes) compared to other categories. Additionally, we notice a steep decay in the number of upvotes for each subsequent vote range (5-10, 10-50, etc.), which may be attributed to comments not meeting engagement criteria or simply going unnoticed due to the large volume of comments submitted to a video. Further analysis is presented in Figure 4 . In Figure 4 (a), we show the sentiment distribution of the comments in our dataset. The sentiment score ranges from -1 (negative) to +1 (positive), with 0 being neutral. We found that categories such as “education” and “how-to” have many comments clustered near zero, indicating less emotional engagement. In contrast, “news” appears to be the category with the broadest range of sentiment scores. Figure 4 (b) illustrates the comment length distribution from our dataset. We observe that although most comments are very short, categories like “news” and “nonprofit” tend to have longer comments compared to others. This could be due to these categories typically having more discussions than categories such as “gaming”, which often contain more reactive comments. A wordcloud depicting common words in our comment dataset is shown in Figure 4 (c). (a) Sentiment distribution of YouTube channel category. (b) Comment length distribution of YouTube channel category. (c) Wordcloud of comment text. Figure 4: Analysis of our collected dataset. Data anonymity. This work collects only publicly available YouTube comments, and all PII (personally identifiable information) are redacted for anonymity. Release and Contributions The YT-100K dataset is available on the Hugging Face platform 2 2 2 https://huggingface.co/datasets/hridaydutta123/YT-100K . The YT-30M dataset can be obtained by requesting the author of this dataset. The author encourage researchers working in the domain of Natural Language Processing and Social Network Analysis to perform various interesting analyses and modeling on this dataset.