Model Agreement via Anchoring

Eric Eaton, Surbhi Goel, Marcel Hussing, Michael Kearns, Aaron Roth, Sikata Sengupta, Jessica Sorrell · 2026

Read Model Agreement via Anchoring by Eric Eaton, Surbhi Goel, Marcel Hussing, Michael Kearns, Aaron Roth, Sikata Sengupta, Jessica Sorrell (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23360.txt.

Description

Eric Eaton and six co-authors study model disagreement, how far apart two machine learning models' predictions fall, and show how to drive it to zero. They use a standard notion: the expected squared difference in predictions between two models trained on independent samples, with uncoordinated training runs. The goal is to control disagreement through natural parameters of the training procedure, with analyses for existing methods.

The core technique is anchoring: proving bounds by anchoring to the average of the two models within the analysis. Applied to four algorithms, disagreement falls to zero as one parameter grows. Those parameters are the stacked-model count, the iteration count, the architecture size, and the tree depth, for stacked aggregation, gradient boosting, architecture search, and fixed-depth trees in turn. Bounds start in one-dimensional regression with squared error loss, then generalize to multi-dimensional regression with any strongly convex loss.

Catalog record

CREATOREric Eaton, Surbhi Goel, Marcel Hussing, Michael Kearns, Aaron Roth, Sikata Sengupta, Jessica Sorrell
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE98 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-23360

Browse the full library · About the Tower of Babel