When Gradient Optimization Is Not Enough: † \dagger Dispersive and Anchoring Geometric Regularizer for Multimodal Learning

Zixuan Xia, Hao Wang, Pengcheng Weng, Yanyu Qian, Yangxin Xu, William Dan, Fei Wang · 2026

Read When Gradient Optimization Is Not Enough: † \dagger Dispersive and Anchoring Geometric Regularizer for Multimodal Learning by Zixuan Xia, Hao Wang, Pengcheng Weng, Yanyu Qian, Yangxin Xu, William Dan, Fei Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21670.txt.

Description

Zixuan Xia, Hao Wang, and five co-authors add geometric regularizers to multimodal learning. Joining data types like image, text, and sound should give richer models. Strong optimization alone, though, does not guarantee well-shaped representations.

Even with careful balancing, multimodal models often suffer two flaws. Features inside one modality can collapse together, and paired samples can drift apart across modalities. The authors add dispersive and anchoring terms to fight both flaws directly. Healthier geometry should make each single-modality skill sturdier and the fusion between them more faithful. It should also help when one input stream is noisy or missing at test time. The paper treats the shape of these learned spaces as a problem in its own right, not a side effect of training.

Catalog record

CREATORZixuan Xia, Hao Wang, Pengcheng Weng, Yanyu Qian, Yangxin Xu, William Dan, Fei Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21670

Browse the full library · About the Tower of Babel