Learning on the Manifold: Unlocking Standard Diffusion Transformers with Representation Encoders

Amandeep Kumar, Vishal M. Patel · 2026

Read Learning on the Manifold: Unlocking Standard Diffusion Transformers with Representation Encoders by Amandeep Kumar, Vishal M. Patel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-10099.txt.

Description

Representation encoders offer efficient, high-quality generation, yet standard diffusion transformers fail to settle on their representations at all. A 2026 paper by Amandeep Kumar and Vishal M. Patel traces the failure to shape, not capacity. Standard Euclidean flow matching pushes probability paths through the sparse interior of the encoders' hyperspherical feature space instead of hugging the manifold surface.

The authors call that failure Geometric Interference and answer with Riemannian Flow Matching plus Jacobi Regularization. Holding generation to manifold geodesics and fixing curvature-driven error lets standard architectures settle without costly width scaling. A standard mid-size model then settles nicely, reaching a strong image quality score where prior methods failed to settle at all.

Catalog record

CREATORAmandeep Kumar, Vishal M. Patel
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-10099

Browse the full library · About the Tower of Babel