Learning from Biased and Costly Data Sources: Minimax-optimal Data Collection under a Budget

Michael O. Harding, Vikas Singh, Kirthevasan Kandasamy · 2026

Read Learning from Biased and Costly Data Sources: Minimax-optimal Data Collection under a Budget by Michael O. Harding, Vikas Singh, Kirthevasan Kandasamy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-17894.txt.

Description

Michael Harding and team study learning from biased and costly data sources, seeking minimax-optimal data collection under a budget. Data collection anchors modern machine learning pipelines, when data must come from multiple mixed sources to study a target population. Sources differ in sampling costs. Group composition varies among source populations and between sources and the target, as in medical or polling studies.

The paper focuses on estimation of population and group means under a budget. Naive strategies such as matching the target distribution, or standard estimators such as the sample mean, can prove suboptimal. Instead, the authors develop a plan maximizing sample size: total sample size divided by a chi-squared divergence term plus one. They pair it with a post-stratification estimator, bounding its risk. Matching lower bounds establish minimax optimal risk. Techniques extend to prediction problems, giving an approach to multi-source learning with costly data.

Catalog record

CREATORMichael O. Harding, Vikas Singh, Kirthevasan Kandasamy
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE94 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-17894

Browse the full library · About the Tower of Babel