Learning from Biased and Costly Data Sources: Minimax-optimal Data Collection under a Budget
Michael O. Harding, Vikas Singh, Kirthevasan Kandasamy · 2026
Read Learning from Biased and Costly Data Sources: Minimax-optimal Data Collection under a Budget by Michael O. Harding, Vikas Singh, Kirthevasan Kandasamy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-17894.txt.
Description
Michael Harding and team study learning from biased and costly data sources, seeking minimax-optimal data collection under a budget. Data collection anchors modern machine learning pipelines, when data must come from multiple mixed sources to study a target population. Sources differ in sampling costs. Group composition varies among source populations and between sources and the target, as in medical or polling studies.
The paper focuses on estimation of population and group means under a budget. Naive strategies such as matching the target distribution, or standard estimators such as the sample mean, can prove suboptimal. Instead, the authors develop a plan maximizing sample size: total sample size divided by a chi-squared divergence term plus one. They pair it with a post-stratification estimator, bounding its risk. Matching lower bounds establish minimax optimal risk. Techniques extend to prediction problems, giving an approach to multi-source learning with costly data.
Catalog record
| CREATOR | Michael O. Harding, Vikas Singh, Kirthevasan Kandasamy |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-17894