MagnetDB: A Longitudinal Torrent Discovery Dataset with IMDb-Matched Movies and TV Shows

Scott Seidenberger, Noah Pursell, Anindya Maiti · 2025

Read MagnetDB: A Longitudinal Torrent Discovery Dataset with IMDb-Matched Movies and TV Shows by Scott Seidenberger, Noah Pursell, Anindya Maiti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-09275.txt.

Introduction

Scott Seidenberger, Noah Pursell, and Anindya Maiti share a huge data set on file-sharing torrents in a 2025 paper. Torrents drive much of the flow of copied films and shows, yet the supply side of that flow is understudied. Their set logs torrents found on the open swarm index from 2018 to 2024.

The set holds more than 28.6 million torrents and facts on more than 950 million files. Film and show entries are matched to a famed film data bank, with notes on each title. That match lets scholars trace how pirated stock shifts over years and by fan group. Legal and illegal stock both sit in the set, the team notes.

Catalog record

CREATORScott Seidenberger, Noah Pursell, Anindya Maiti
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-09275

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MagnetDB: A Longitudinal Torrent Discovery Dataset with IMDb-Matched Movies and TV Shows Scott Seidenberger, Noah Pursell, Anindya Maiti Abstract BitTorrent remains a prominent channel for illicit distribution of copyrighted material, yet the supply side of such content remains understudied. We introduce MagnetDB , a longitudinal dataset of torrents discovered through the BitTorrent DHT between 2018 and 2024, containing more than 28.6 million torrents and metadata of more than 950 million files. While our primary focus is on enabling research based on supply of pirated movies and TV shows, the dataset also encompasses other legitimate and illegitimate torrents. By applying IMDb-matching and annotation to movie and TV show torrents, MagnetDB facilitates detailed analyses of pirated content evolution in the BitTorrent network. Researchers can leverage MagnetDB to examine distribution trends, subcultural practices, and the gift economy within piracy ecosystems. Through its scale and temporal scope, MagnetDB presents a unique opportunity for investigating the broader dynamics of BitTorrent and advancing empirical knowledge on digital piracy. University of Oklahoma [email protected], [email protected], [email protected] Introduction Digital piracy has long posed a challenge to content publishers, policymakers, and internet service providers around the globe ( U.S. Chamber of Commerce 2019 ; Danaher, Smith, and Telang 2020 ) . While digital piracy can manifest through numerous channels, BitTorrent ( BitTorrent 2025 ; Pouwelse et al. 2005 ) stands out as one of the most prevalent networks used to facilitate unauthorized peer-to-peer (P2P) sharing of music, films, software, and other media ( Digital Music News 2024 ; Lifewire 2024a ; Ancell 2024 ) . Movies and television shows in particular dominate a significant portion of the pirated content ( Wang, Liu, and Xu 2010 ) , reflecting the ongoing supply and demand for entertainment multimedia. Streaming service fragmentation, where exclusive content is spread across multiple platforms, has recently led to increased piracy as consumers become frustrated with managing and affording numerous subscriptions ( Ellis 2023 ; Bode 2018 ; Lifewire 2024b ) . BitTorrent’s decentralized architecture, ease of use, and recent innovations like streaming capabilities through WebTorrent ( WebTorrent 2025 ) sustain its role as a prominent platform for unauthorized distribution, creating a fascinating sociotechnical ecosystem for studying its operation and evolution over time. In this work, we introduce MagnetDB , a large torrent database continuously capturing long-term, real-world BitTorrent activity with explicit focus on the supply side of pirated media. Our motivation aligns with the broader social media and web research communities, which can benefit from examining the cultural and social dynamics behind media consumption, distribution, and public engagement with unauthorized content. The potential applications of MagnetDB are numerous. Cultural analytics researchers can study the availability and popularity of movies or TV shows and how these patterns relate to production timelines or cultural events. Linguists and anthropologists may look at naming conventions and tagging practices within torrent metadata, examining how language usage reflects subcultural identities across different release groups and communities. For policymakers and industry practitioners, the dataset can inform anti-piracy strategies, guide legal service offerings, or provide a more accurate picture of the scope and scale of unlicensed distribution. With a focus on the supply side, MagnetDB also enables unique investigations into the motivations and behaviors of torrent creators (encoders), shedding light on “gift economy” dynamics within piracy ecosystems ( Huizing and van der Wal 2014 ) . MagnetDB spans more than five years of torrent discovery (December 2018 – September 2024), containing 28,606,694 torrents with 950,660,089 files , which total 82.87 petabytes of shared media. Although MagnetDB contains torrents across the broader BitTorrent ecosystem, our primary focus is to enable research based on the supply of pirated movies and TV shows. To achieve this, we additionally employ a metadata matching process and identified 1,562,573 movie and TV show video files covering 78,740 unique titles on IMDb ( IMDb 2024 ) , and annotated those files with corresponding IMDb identifiers within MagnetDB . By cross-referencing pirated video files with rich IMDb metadata, such as genre, release year, ratings, cast, runtime, and reviews, MagnetDB enables more granular analyses of distribution patterns, popularity trajectories, and usage behaviors that surpass what can be inferred from file-level information alone. While a significant portion of BitTorrent usage involves unauthorized file sharing, it is also important to recognize that many torrents facilitate legitimate uses, including open-source software releases, academic datasets, and other legal media distributions. Nonetheless, by encompassing both pirated and legitimate torrents, MagnetDB enables a more comprehensive exploration of file-sharing practices, usage trends, and broader distribution dynamics in the BitTorrent network. The Scene Often referred to as “The Scene,” this loosely knit yet highly organized network of groups and individuals has played a pivotal role in the distribution of pirated content since the days of dial-up bulletin board systems. Historically, The Scene has been most closely identified with the so-called “warez” community, which initially focused on cracking and distributing software. Over time, their activities expanded to music, films, television episodes, e-books, and other digital media. Although The Scene’s structure can appear disjointed from the outside, most participants adhere to an implicit code of conduct and a federated organizational structure designed to promote a sense of community among its affiliates and produce quality warez ( Goldman 2005 ; McCandless 1997 ) . Key Players and Motivations. Scene groups typically occupy specialized roles in the supply chain: “release groups” focus on sourcing and preparing new content (e.g., by obtaining pre-release copies of software or media), while “couriers” and other intermediaries distribute the files across private platforms, racing to achieve “zero-day” status, making content available on or before the official commercial release. In this environment, prestige is closely tied to speed: the faster a group can acquire and release a highly anticipated title, the more its reputation grows within the community ( Goldman 2005 ) . As MagnetDB provides comprehensive data on the torrent supply, it can provide significant insight into the output of the release groups. It is important to note some key taxonomic definitions, as there is an important distinction within the release groups. The groups or individuals that create the torrent are the “encoders”, and the groups that distribute the torrent information are the “sites” (websites). MagnetDB makes a distinction between these two entities in the dataset. This subculture operates largely as a gift economy, where members thrive on recognition and status rather than monetary gain ( Hétu, Morselli, and Leman-Langlois 2012 ; Rehn 2004 ) . For many participants, the act of collecting and sharing files is itself the reward, having a full library of releases is a point of pride, irrespective of whether those files are ever personally used or consumed. Cultural Underpinnings: Gift Economy and Reputation. Unlike purely profit-driven piracy rings, The Scene is upheld by a tradition of reciprocity and social capital accumulation. Members who consistently supply high-quality or hard-to-find releases gain respect and clout, which can lead to better access to private servers, exclusive pre-releases, and membership in elite groups. This gift economy ethos is driven by a combination of altruistic sharing norms, social bonding, and competitive one-upmanship. In essence, Scene participants work to cultivate an identity not just as savvy digital sharers, but also as gatekeepers who uphold community standards—particularly regarding file quality, completeness, and timeliness.

Read the complete text