Unified Multimodal Visual Tracking with Dual Mixture-of-Experts

Lingyi Hong, Jinglun Li, Xinyu Zhou, Kaixun Jiang, Pinxue Guo, Zhaoyu Chen, Runze Li, Xingdong Sheng, Wenqiang Zhang · 2026

Read Unified Multimodal Visual Tracking with Dual Mixture-of-Experts by Lingyi Hong, Jinglun Li, Xinyu Zhou, Kaixun Jiang, Pinxue Guo, Zhaoyu Chen, Runze Li, Xingdong Sheng, Wenqiang Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03716.txt.

Description

Lingyi Hong and eight co-authors introduce OneTrackerV2, a unified framework for multimodal visual object tracking. A target must be followed through video, using color images alone or combined with extra sensing channels. Existing methods often train separate models per modality or adapt pre-trained ones, limiting efficiency and scalability. OneTrackerV2 trains end to end for any modality in one architecture.

A Meta Merger embeds multimodal information into a unified space, supporting flexible fusion and robustness when a modality is missing. A Dual Mixture-of-Experts design separates spatio-temporal tracking relations from multimodal knowledge, reducing feature conflicts. The system reaches state-of-the-art results across five tracking tasks and twelve benchmarks while staying fast.

Catalog record

CREATORLingyi Hong, Jinglun Li, Xinyu Zhou, Kaixun Jiang, Pinxue Guo, Zhaoyu Chen, Runze Li, Xingdong Sheng, Wenqiang Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.03716

Browse the full library · About the Tower of Babel