Predicting data value before collection: A coefficient for prioritizing sources under random distribution shift

Ivy Zhang, Dominik Rothenhäusler · 2025

Read Predicting data value before collection: A coefficient for prioritizing sources under random distribution shift by Ivy Zhang, Dominik Rothenhäusler (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-06570.txt.

Description

Ivy Zhang and Dominik Rothenhäusler propose a way to judge data value before any data are collected, in work from 2025. Researchers often must choose among sources that differ in quality, cost and fit to a target group. Their Data Usefulness Coefficient predicts how much a new dataset will cut prediction error, using only covariate summary data and no outcomes.

Under a random distribution shift model, the authors prove that covariate gaps between sources carry real signal about outcome prediction. Tests on synthetic and real data show that picks based on the coefficient beat other strategies. The method gives clear rankings and works for ordinal, categorical and continuous data alike.

Catalog record

CREATORIvy Zhang, Dominik Rothenhäusler
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE96 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-06570

Browse the full library · About the Tower of Babel