Interactive Learning of Single-Index Models via Stochastic Gradient Descent
Nived Rajaraman, Yanjun Han · 2026
Read Interactive Learning of Single-Index Models via Stochastic Gradient Descent by Nived Rajaraman, Yanjun Han (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-17876.txt.
Description
Nived Rajaraman and Yanjun Han study interactive learning of single-index models via stochastic gradient descent. Stochastic gradient descent is a cornerstone method for high-dimensional optimization, famed for empirical success. Recent theory explains how it enables feature learning in high-dimensional nonlinear models, above all the single-index model with independent, identically distributed data.
The sequential learning task examined here concerns single-index models, a setting likewise called generalized linear bandits or ridge bandits. There, stochastic gradient descent is simple and natural, yet its learning motion stays largely unexplored. Like the optimal interactive learner, it passes through a distinct burn-in phase before entering the learning phase. When the learning rate schedule is picked suitably, one procedure alone delivers sample complexity and regret guarantees close to optimal in both phases, across a broad class of link functions. It thus stays highly competitive under adaptive data.
Catalog record
| CREATOR | Nived Rajaraman, Yanjun Han |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-17876