Fairshare Data Pricing via Data Valuation for Large Language Models
Luyang Zhang *, Cathy Jiao *, Beibei Li †, Chenyan Xiong † · 2025
Read Fairshare Data Pricing via Data Valuation for Large Language Models by Luyang Zhang *, Cathy Jiao *, Beibei Li †, Chenyan Xiong † (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-00198.txt.
Introduction
Luyang Zhang and co-authors design fairer pay for training data in a 2025 paper. Language models feed on human labeled data, yet markets often underpay the labelers, especially marginalized groups. The authors model this market game between model builders who buy data and annotators who sell it.
Their analysis shows stingy pricing drives top sellers out, which rots data quality and long run model skill. Their fairshare scheme prices each item by its measured contribution to the model. Theory says it keeps sellers in and suits both sides. In training tests on math, medical, and physics tasks, sellers earned more, supply stayed stable, and buyers got better value per dollar.
Catalog record
| CREATOR | Luyang Zhang *, Cathy Jiao *, Beibei Li †, Chenyan Xiong † |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 103 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-00198
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fairshare Data Pricing via Data Valuation for Large Language Models Luyang Zhang *, Cathy Jiao *, Beibei Li †, Chenyan Xiong † Abstract Training data is the backbone of large language models (LLMs), yet today’s data markets often operate under exploitative pricing – sourcing data from marginalized groups with little pay or recognition. This paper introduces a theoretical framework for LLM data markets, modeling the strategic interactions between buyers (LLM builders) and sellers (human annotators). We begin with theoretical and empirical analysis showing how exploitative pricing drives high-quality sellers out of the market, degrading data quality and long-term model performance. Then we introduce fairshare , a pricing mechanism grounded in data valuation that quantifies each data’s contribution. It aligns incentives by sustaining seller participation and optimizing utility for both buyers and sellers. Theoretically, we show that fairshare yields mutually optimal outcomes: maximizing long-term buyer utility and seller profit while sustaining market participation. Empirically when training open-source LLMs on complex NLP tasks, including math problems, medical diagnosis, and physical reasoning, fairshare boosts seller earnings and ensures a stable supply of high-quality data, while improving buyers’ performance-per-dollar and long-term welfare. Our findings offer a concrete path toward fair, transparent, and economically sustainable data markets for LLM. 1 Introduction High-quality training data is foundational to building effective and reliable large language models (LLMs). As LLMs take on increasingly complex tasks today – such as coding [ 17 ] , reasoning [ 83 ] , and AI4Science [ 72 ] – they rely heavily on carefully curated, human-annotated data. This growing demand has triggered a "generative data gold rush", with major tech companies racing to acquire training data, fueling the rise of a nascent AI data market [ 63 ] . In this market, AI firms create networks of short-term contract workers to generate data labels, resembling an Uber-like gig economy for data [ 63 ] . However, the current AI data market operates with limited oversight and is widely criticized for a lack of transparency and fairness in pricing [ 58 , 89 , 56 , 4 ] . Data prices are largely low and fail to reflect the quality or effort involved, threatening the sustainability and quality of data supply [ 54 , 33 , 14 ] . In particular, for data sellers, such as human annotators or content creators, the prevailing market routinely undervalues their labor, offering compensation that neglects the skill, effort, and downstream value of their contributions. These harms are especially concentrated in low-wage labor markets, where annotators often face overwork, underpayment, and exclusion from decision-making [ 74 ] . This reflects a broader ethical concern known as “AI parachuting”, where developers extract data from marginalized communities [ 43 , 11 , 19 ] , tieing to wider debates on epistemic injustice and data colonialism [ 59 , 64 , 31 ] . As one civil rights advocate noted on 60 Minutes, ‘‘They don’t pay well… they could pay whatever, and have whatever working conditions.’’ 1 1 1 CBS, 60 Minutes Motivated by these issues, we present a fair pricing framework for the LLM training data market to promote equitable and sustainable generative AI ecosystems. Economic theory suggests that prices should reflect the value delivered to the buyer – signaling quality and alignment [ 68 ] . Guided by this, our framework introduces fairshare pricing based on established data valuation techniques for LLMs [ 61 , 47 , 86 , 88 ] , which quantify each dataset’s contribution to model performance. Buyers and sellers both have access to data valuation scores, which guide decision-making on both sides: buyers use them to select datasets under budget constraints to maximize utility (i.e., a standard measure of welfare or satisfaction [ 53 , 78 ] ), while sellers use them to set prices based on the anticipated demand from buyers. This shared access – enabled by our assumption of information transparency – supports procedural fairness [ 45 ] , improves seller participation, and enhances overall data quality. Our theoretical and empirical findings show that fairshare pricing offers clear advantages compared to existing methods. First, we show that existing exploitative pricing leads to a lose-lose outcome for the data market. For data buyers, underpaying data sellers might cut costs in the short term – but it comes at a cost of drive sellers away, shrinking the supply of high-quality training data. This weakens the data pipeline and limits model improvement, even as investments grow. In contrast, we show theoretically that fairshare pricing leads to a win-win outcome: sellers maximize profit while remaining engaged, and buyers secure long-term utility by maintaining access to high-quality data. Second, we empirically validate our approach through simulations of buyer-seller interactions in data markets. We focus on training open-source LLMs on complex NLP tasks, including math problems [ 6 ] , medical diagnosis [ 42 ] , and physical reasoning [ 12 ] . Analyzing both pricing and valuation outcomes, we find that under fairshare pricing, buyers achieve higher model performance per dollar spent, making it particularly beneficial for those with limited budgets. In addition, our simulations of long-term market dynamics demonstrate that fairshare pricing encourages sustained seller participation, resulting in a stable and sufficient supply of training data over time compared to exploitative pricing. These findings show that our framework’s data-valuation-based pricing not only improves short-term training efficiency, but also ensures the long-term viability of the data market. Finally, to evaluate the robustness and method-agnostic applicability of our framework, we conduct an ablation study using a diverse set of data valuation methods (including BM25 [ 76 ] , \text{Infl}_{\text{IP}} [ 86 ] , and Datainf [ 47 ] ) – selected for their scalability and efficiency in LLM tasks. Across all variants, our fairshare pricing framework consistently delivers mutually beneficial results for both buyers and sellers in the LLM data market, confirming that its performance is not tied to any specific data valuation technique. This analysis underscores a key strength of our approach: buyers and sellers can flexibly choose valuation methods tailored to their downstream needs without compromising the incentive-aligned structure of the market, and demonstrates the broad applicability of our solution. To summarize our contributions are as follows: 1. We present a novel theoretical framework to model the LLM training data market utilizing data valuation, economics of market, and game theory. 2. We propose a fairshare pricing mechanism that captures the strategic interplay between buyers and sellers. Both theory and empirical analyses show that exploitative pricing results in lose-lose outcomes, while fairshare promotes long-term stability and mutual benefits. 3. Our proposed pricing framework is highly generalizable across LLM models and tasks, and robust to the data valuation methods and utility measures used by market participants. Our results demonstrate the versatility of our approach in data markets by aligning incentives, sustaining data quality, and maximizing long-term value. This highlights our fairshare mechanism as a guide for designing sustainable data procurement practices in public and private sectors. 2 Related Work Data Market Design and Exploitative Pricing. Recent studies on ML data markets focus on platform-based pricing and allocation mechanisms such as auctions and personalized pricing [ 2 , 16 , 15 , 87 , 90 ] . These frameworks