Kairos : Scalable Model-Agnostic Data Valuation

Jiongli Zhu *, Parjanya Prajakta Prashant *, Alex Cloninger, Babak Salimi · 2025

Read Kairos : Scalable Model-Agnostic Data Valuation by Jiongli Zhu *, Parjanya Prajakta Prashant *, Alex Cloninger, Babak Salimi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23799.txt.

Description

Jiongli Zhu and co-authors present a fast way to value training data in a 2025 paper. Each example in a training set helps or hurts a model, and knowing its worth matters for quality, compliance, and pricing AI assets. Older scores depend on one fitted model and inherit its biases. Shapley-style scores need costly retraining, which fails at web scale.

Their framework, KAIROS, scores each example by how it shifts the gap between the training data and a clean reference set. The gap measure they use has a closed-form score that tracks the true leave-one-out ranking closely, with no retraining. Scores update fast when new data arrive, up to fifty times faster in their tests. On noise, mislabel, and poisoning tests, KAIROS beat model-based, Shapley, and rival baselines in both accuracy and speed.

Catalog record

CREATORJiongli Zhu *, Parjanya Prajakta Prashant *, Alex Cloninger, Babak Salimi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-23799

Browse the full library · About the Tower of Babel