Unified Multimodal Visual Tracking with Dual Mixture-of-Experts
Lingyi Hong, Jinglun Li, Xinyu Zhou, Kaixun Jiang, Pinxue Guo, Zhaoyu Chen, Runze Li, Xingdong Sheng, Wenqiang Zhang · 2026
Read Unified Multimodal Visual Tracking with Dual Mixture-of-Experts by Lingyi Hong, Jinglun Li, Xinyu Zhou, Kaixun Jiang, Pinxue Guo, Zhaoyu Chen, Runze Li, Xingdong Sheng, Wenqiang Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03716.txt.
Description
Lingyi Hong and eight co-authors introduce OneTrackerV2, a unified framework for multimodal visual object tracking. A target must be followed through video, using color images alone or combined with extra sensing channels. Existing methods often train separate models per modality or adapt pre-trained ones, limiting efficiency and scalability. OneTrackerV2 trains end to end for any modality in one architecture.
A Meta Merger embeds multimodal information into a unified space, supporting flexible fusion and robustness when a modality is missing. A Dual Mixture-of-Experts design separates spatio-temporal tracking relations from multimodal knowledge, reducing feature conflicts. The system reaches state-of-the-art results across five tracking tasks and twelve benchmarks while staying fast.
Catalog record
| CREATOR | Lingyi Hong, Jinglun Li, Xinyu Zhou, Kaixun Jiang, Pinxue Guo, Zhaoyu Chen, Runze Li, Xingdong Sheng, Wenqiang Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.03716