Efficient Adaptive Data Analysis over Dense Distributions

Joon Suk Huh · 2026

Read Efficient Adaptive Data Analysis over Dense Distributions by Joon Suk Huh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07732.txt.

Description

Adaptive data analysis reuses one dataset for many rounds of questions, but each round risks overfitting the next answer. Joon Suk Huh examines the tension between fast algorithms, which usually need many more samples, and sample-efficient algorithms, which are often too slow to run.

He identifies a natural setting, distributions that are dense relative to a known prior, where both goals can be met at once. His efficient mechanism reaches the best possible sample growth, logarithmic in the number of rounds, for that class, which includes feature-label data from distribution-specific learning. Statisticians and machine-learning theorists get a concrete case where efficiency and statistical optimality stop fighting each other.

Catalog record

CREATORJoon Suk Huh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07732

Browse the full library · About the Tower of Babel