Learning on the Manifold: Unlocking Standard Diffusion Transformers with Representation Encoders
Amandeep Kumar, Vishal M. Patel · 2026
Read Learning on the Manifold: Unlocking Standard Diffusion Transformers with Representation Encoders by Amandeep Kumar, Vishal M. Patel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-10099.txt.
Description
Representation encoders offer efficient, high-quality generation, yet standard diffusion transformers fail to settle on their representations at all. A 2026 paper by Amandeep Kumar and Vishal M. Patel traces the failure to shape, not capacity. Standard Euclidean flow matching pushes probability paths through the sparse interior of the encoders' hyperspherical feature space instead of hugging the manifold surface.
The authors call that failure Geometric Interference and answer with Riemannian Flow Matching plus Jacobi Regularization. Holding generation to manifold geodesics and fixing curvature-driven error lets standard architectures settle without costly width scaling. A standard mid-size model then settles nicely, reaching a strong image quality score where prior methods failed to settle at all.
Catalog record
| CREATOR | Amandeep Kumar, Vishal M. Patel |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-10099