A Modern Theory of Cross-Validation through the Lens of Stability

Jing Lei · 2025

Read A Modern Theory of Cross-Validation through the Lens of Stability by Jing Lei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23592.txt.

Introduction

Jing Lei wrote a review in twenty twenty-five of cross-validation seen through the lens of stability. It is the field's default tool to gauge prediction error and to pick models. Yet its theory lagged far behind modern black-box use. The key idea is stability. An estimator that barely shifts when data shift a bit will act in a way you can foresee. That holds when data are drawn again and again.

Lei surveys new results. They give guarantees for the tool when stability is assumed. They cover both error gauging and the pick of a model. He then asks how to add uncertainty claims to the risk numbers the tool gives. The piece sets the tool in a wider family of post-hoc randomization methods. The family holds permutation tests, bootstrap, and conformal inference. Those need few assumptions. Uses on current problems round out the whole.

Catalog record

CREATORJing Lei
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE280 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-23592

Browse the full library · About the Tower of Babel