Neural collapse in the orthoplex regime
James Alcala, Rayna Andreeva, Vladimir A. Kobzar, Dustin G. Mixon, Sanghoon Na, Shashank Sule, Yangxinyu Xie · 2026
Read Neural collapse in the orthoplex regime by James Alcala, Rayna Andreeva, Vladimir A. Kobzar, Dustin G. Mixon, Sanghoon Na, Shashank Sule, Yangxinyu Xie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20587.txt.
Description
Alcala and co-authors study neural collapse when class counts pass feature size. In the classic case, class features settle at simplex corners. That case needs at most one more class than the feature dimension. Language models live far past that limit. The team maps the shapes that form in the orthoplex regime. This range runs from two past the dimension up to twice it. Their proofs rest on Radon's theorem and convexity.
Catalog record
| CREATOR | James Alcala, Rayna Andreeva, Vladimir A. Kobzar, Dustin G. Mixon, Sanghoon Na, Shashank Sule, Yangxinyu Xie |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32293 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20587