Towards a Unified Analysis of Neural Networks in Nonparametric Instrumental Variable Regression: Optimization and Generalization
Zonghao Chen, Atsushi Nitanda, Arthur Gretton, Taiji Suzuki · 2025
Read Towards a Unified Analysis of Neural Networks in Nonparametric Instrumental Variable Regression: Optimization and Generalization by Zonghao Chen, Atsushi Nitanda, Arthur Gretton, Taiji Suzuki (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14710.txt.
Introduction
Zonghao Chen, Atsushi Nitanda, and two co-authors prove the first global convergence result for neural networks used in instrumental variable regression. That regression style untangles cause from correlation when a hidden factor spoils direct fitting, and its standard two-stage least squares method becomes a two-level optimization once networks do the fitting. Two-level problems are hard to train and harder to certify.
The team views training through mean-field Langevin dynamics and turns the two-level problem into a single Lagrangian one. The resulting fully first-order algorithm comes with both a convergence bound and a generalization bound. The analysis exposes a trade-off in one key weight between training speed and statistical safety.
Catalog record
| CREATOR | Zonghao Chen, Atsushi Nitanda, Arthur Gretton, Taiji Suzuki |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 275 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-14710