Neural collapse in the orthoplex regime

James Alcala, Rayna Andreeva, Vladimir A. Kobzar, Dustin G. Mixon, Sanghoon Na, Shashank Sule, Yangxinyu Xie · 2026

Read Neural collapse in the orthoplex regime by James Alcala, Rayna Andreeva, Vladimir A. Kobzar, Dustin G. Mixon, Sanghoon Na, Shashank Sule, Yangxinyu Xie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20587.txt.

Description

Alcala and co-authors study neural collapse when class counts pass feature size. In the classic case, class features settle at simplex corners. That case needs at most one more class than the feature dimension. Language models live far past that limit. The team maps the shapes that form in the orthoplex regime. This range runs from two past the dimension up to twice it. Their proofs rest on Radon's theorem and convexity.

Catalog record

CREATORJames Alcala, Rayna Andreeva, Vladimir A. Kobzar, Dustin G. Mixon, Sanghoon Na, Shashank Sule, Yangxinyu Xie
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32293
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.20587

Browse the full library · About the Tower of Babel