Model Agreement via Anchoring
Eric Eaton, Surbhi Goel, Marcel Hussing, Michael Kearns, Aaron Roth, Sikata Sengupta, Jessica Sorrell · 2026
Read Model Agreement via Anchoring by Eric Eaton, Surbhi Goel, Marcel Hussing, Michael Kearns, Aaron Roth, Sikata Sengupta, Jessica Sorrell (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23360.txt.
Description
Eric Eaton and six co-authors study model disagreement, how far apart two machine learning models' predictions fall, and show how to drive it to zero. They use a standard notion: the expected squared difference in predictions between two models trained on independent samples, with uncoordinated training runs. The goal is to control disagreement through natural parameters of the training procedure, with analyses for existing methods.
The core technique is anchoring: proving bounds by anchoring to the average of the two models within the analysis. Applied to four algorithms, disagreement falls to zero as one parameter grows. Those parameters are the stacked-model count, the iteration count, the architecture size, and the tree depth, for stacked aggregation, gradient boosting, architecture search, and fixed-depth trees in turn. Bounds start in one-dimensional regression with squared error loss, then generalize to multi-dimensional regression with any strongly convex loss.
Catalog record
| CREATOR | Eric Eaton, Surbhi Goel, Marcel Hussing, Michael Kearns, Aaron Roth, Sikata Sengupta, Jessica Sorrell |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 98 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-23360