Latent Temporal Discrepancy as Motion Prior: A Loss-Weighting Strategy for Dynamic Fidelity in T2V

Meiqi Wu 1,4 \sthanks Equal contribution \sthanks Work done during the internship at AMAP, Alibaba Group., Bingze Song 2 , Ruimin Lin 2 , Chen Zhu 3 , Xiaokun Feng 1,4 , Jiahong Wu 2 \sthanks Corresponding author., Xiangxiang Chu 2 , Kaiqi Huang 1,4 · 2026

Read Latent Temporal Discrepancy as Motion Prior: A Loss-Weighting Strategy for Dynamic Fidelity in T2V by Meiqi Wu 1,4 \sthanks Equal contribution \sthanks Work done during the internship at AMAP, Alibaba Group., Bingze Song 2 , Ruimin Lin 2 , Chen Zhu 3 , Xiaokun Feng 1,4 , Jiahong Wu 2 \sthanks Corresponding author., Xiangxiang Chu 2 , Kaiqi Huang 1,4 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20504.txt.

Description

Meiqi Wu and seven colleagues work on a weak spot of text-to-video models: motion. These models have made clear progress on still-looking scenes. But when a scene changes fast and hard, the quality of the motion drops. Noise breaks the flow of time in the clip, and the parts that move most are the hardest to learn.

The authors use latent temporal discrepancy, the gap between frames inside the model's latent space, as a motion prior. It guides a loss-weighting strategy that makes training pay more heed to moving regions. Video tools are judged on motion above all, so teaching a model where motion lives could lift the whole field.

Catalog record

CREATORMeiqi Wu 1,4 \sthanks Equal contribution \sthanks Work done during the internship at AMAP, Alibaba Group., Bingze Song 2 , Ruimin Lin 2 , Chen Zhu 3 , Xiaokun Feng 1,4 , Jiahong Wu 2 \sthanks Corresponding author., Xiangxiang Chu 2 , Kaiqi Huang 1,4
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20504

Browse the full library · About the Tower of Babel