How Hyper-Datafication Impacts the Sustainability Costs in Frontier AI CCS: Computing methodologies Artificial intelligence CCS: Hardware Impact on the environment

Sophia N. Wilson, Sebastian Mair, Mophat Okinyi, Erik B Dam, Janin Koch, Raghavendra Selvan · 2026

Read How Hyper-Datafication Impacts the Sustainability Costs in Frontier AI CCS: Computing methodologies Artificial intelligence CCS: Hardware Impact on the environment by Sophia N. Wilson, Sebastian Mair, Mophat Okinyi, Erik B Dam, Janin Koch, Raghavendra Selvan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-00056.txt.

Introduction

Sophia N. Wilson and coauthors trace the sustainability costs of the shift from gathering data to making data for frontier AI, a turn they call hyper datafication. They study about 550000 data sets on the Hugging Face Hub for growth, storage energy, carbon, and language coverage. They add views from data workers in Kenya on pay, jobs, and graphic content. The pattern they find is stark: environmental costs climb while labor risks and representation harms fall on workers and groups far from the firms that gain.

Catalog record

CREATORSophia N. Wilson, Sebastian Mair, Mophat Okinyi, Erik B Dam, Janin Koch, Raghavendra Selvan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66072
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.00056

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

How Hyper-Datafication Impacts the Sustainability Costs in Frontier AI CCS: Computing methodologies Artificial intelligence CCS: Hardware Impact on the environment Sophia N. Wilson, Sebastian Mair, Mophat Okinyi, Erik B Dam, Janin Koch, Raghavendra Selvan Abstract . Large-scale data has fuelled the success of frontier artificial intelligence (AI) models over the past decade. This expansion has relied on sustained efforts by large technology corporations to aggregate and curate internet-scale datasets. In this work, we examine the environmental, social, and economic costs of large-scale data in AI through a sustainability lens. We argue that the field is shifting from building models from data to actively creating data for building models . We characterise this transition as hyper-datafication , which marks a critical juncture for the future of frontier AI and its societal impacts. To quantify and contextualise data-related costs, we analyse approximately 550,000 datasets from the Hugging Face Hub, focusing on dataset growth, storage-related energy consumption and carbon footprint, and societal representation using language data. We complement this analysis with qualitative responses from data workers in Kenya to examine the labour involved, including direct employment by big tech corporations and exposure to graphic content. We further draw on external data sources to substantiate our findings by illustrating the global disparity in data centre infrastructure. Our analyses reveal that hyper-datafication does not merely increase resource consumption but systematically redistributes environmental burdens, labour risks, and representational harms toward the Global South, precarious data workers, and under-represented cultures. Thus, we propose Data PROOFS recommendations spanning provenance, resource awareness, ownership, openness, frugality, and standards to mitigate these costs. Our work aims to make visible the often-overlooked costs of data that underpin frontier AI and to stimulate broader debate within the research community and beyond. 1 1 1 Source code used to extract metadata from datasets hosted on the Hugging Face Hub is available at: https://github.com/saintslab/costs-of-hyperdatafication . 1. Introduction The recent advancements in artificial intelligence (AI) have enabled automation that was widely considered decades away. AI systems now deliver breakthroughs across scientific discovery, language understanding, and generative modelling, addressing long-standing research challenges while opening new applications ( 80 ; 10 ; 9 ; 45 ; 52 ; 51 ) . This progress is driven primarily by deep learning methods ( 54 ; 75 ) , including large language models (LLMs), multimodal generative models, and reasoning models ( 69 ; 10 ; 87 ; 29 ; 32 ) . While algorithmic and hardware improvements have played an important role, scale has acted as the dominant catalyst ( 47 ; 36 ; 78 ) . Frontier AI development now relies on unprecedented levels of resources: models with hundreds of billions of parameters, hyper-scale data centre infrastructure, electricity consumption comparable to that of entire towns, and financial investments that exceed the gross domestic product of several countries ( 77 ) . These investments would be futile without access to another critical resource: data . Contemporary frontier AI models train on datasets containing tens of trillions of data points, often scraped at scale from the internet. For example, one of the largest publicly available tokenised datasets DCLM-Pool , contains more than 240 trillion tokens ( 55 ) . Figure 1 illustrates the rapid growth of datasets and data volume using the datasets available on the Hugging Face Hub 2 2 2 https://huggingface.co/datasets , a platform for hosting AI models and datasets (see Section 3 ). Figure 1. Growth of datasets and data volume over time and download concentration on the Hugging Face Hub. Left: Monthly counts of newly created datasets (100% of datasets included). Centre: Monthly data volume added (91% of datasets included). The bars are coloured by modality. For multimodal datasets, each modality contributes proportionally to the colouring. Right: Download concentration. The plot shows total downloads (solid line) and downloads in November 2025 – which is 30 days preceding metadata extraction – (dashed line) against dataset rank sorted by total downloads on a logarithmic scale. The shaded region highlights the top 1% of datasets (5,543 repositories). Dataset growth and usage on the Hugging Face Hub. The figure illustrates rapid expansion in the number and volume of datasets, where text datasets contribute the largest share, alongside a highly skewed distribution of downloads, where a small share of datasets receives by far the most usage. Growing concern about the sustainability of AI has prompted an expanding body of work ( 94 ; 101 ; 77 ) . However, existing discussions largely centre on model training and deployment. The sustainability of data itself remains comparatively under-examined, despite the fact that collecting and using internet-scale datasets for frontier AI is highly resource-intensive and can generate substantial environmental, social, and economic costs. As a result, current sustainability discussions overlook data as a central driver of AI’s broader impacts. In this work, we take a comprehensive look at the sustainability of data for AI. Building on existing critiques of the sustainability of AI ( 94 ; 101 ; 100 ) , we focus explicitly on the environmental, social, and economic costs of large-scale data practices. This perspective becomes increasingly urgent as frontier AI research pursues ever more ambitious goals, including artificial general intelligence (AGI), intensifying the demand for data at scale. We argue that the field is undergoing a structural shift in how data is produced and used. First, frontier AI systems increasingly rely on large-scale synthetic data. For example, the Phi-4 model was pretrained on approximately 10 trillion tokens, of which around 40% were synthetically generated and curated using other AI models ( 2 ) . Second, and more fundamentally, AI development is driving the active creation of new data sources designed explicitly for model training. A prominent example is the Ego4D dataset, which consists of 3,670 hours of egocentric video collected from 923 participants across 74 locations, recorded specifically to support AI systems ( 30 ) . Such datasets would not exist outside the demands of model development. We use the term hyper-datafication to characterise this convergence, which we define formally below. While the term has appeared sporadically in prior work, it has been used narrowly to describe the large-scale expansion and aggregation of existing data sources ( 72 ) . We extend this usage by explicitly incorporating two additional, increasingly central dimensions: the algorithmic generation of synthetic data and the creation of data whose primary purpose is to serve as training material for AI models rather than to support direct human activities. Hyper-datafication refers to the industrialised production and accumulation of data for AI model development across three coupled processes: (i) the large-scale scaling and recombination of existing data sources, (ii) the use of AI systems to generate synthetic data, and (iii) the creation of purpose-built data whose primary function is to serve as training input for AI systems rather than direct human use. We analyse the costs of hyper-datafication across the different sustainability dimensions. To support this analysis, we draw on multiple empirical sources. First, we conduct a large-scale metadata study of approximately 550,000 datasets hosted on the Hugging Face Hub, documenting growth in dataset scale, size, and scope. Using this metadata, we estimate storage-related energy consumption and associated carbon footprints on both the provider and user side, providing indicators of broader

Read the complete text