A Modern Theory of Cross-Validation through the Lens of Stability
Jing Lei · 2025
Read A Modern Theory of Cross-Validation through the Lens of Stability by Jing Lei (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23592.txt.
Introduction
Jing Lei wrote a review in twenty twenty-five of cross-validation seen through the lens of stability. It is the field's default tool to gauge prediction error and to pick models. Yet its theory lagged far behind modern black-box use. The key idea is stability. An estimator that barely shifts when data shift a bit will act in a way you can foresee. That holds when data are drawn again and again.
Lei surveys new results. They give guarantees for the tool when stability is assumed. They cover both error gauging and the pick of a model. He then asks how to add uncertainty claims to the risk numbers the tool gives. The piece sets the tool in a wider family of post-hoc randomization methods. The family holds permutation tests, bootstrap, and conformal inference. Those need few assumptions. Uses on current problems round out the whole.
Catalog record
| CREATOR | Jing Lei |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 280 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-23592