Bridging Pixels and Words: Mask-Aware Local Semantic Fusion for Multimodal Media Verification
Zizhao Chen, Ping Wei, Ziyang Ren, Huan Li, Xiangru YinState Key Laboratory of Human-Machine Hybrid Augmented Intelligence,Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University [email protected], [email protected] · 2026
Read Bridging Pixels and Words: Mask-Aware Local Semantic Fusion for Multimodal Media Verification by Zizhao Chen, Ping Wei, Ziyang Ren, Huan Li, Xiangru YinState Key Laboratory of Human-Machine Hybrid Augmented Intelligence,Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University [email protected], [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26052.txt.
Description
Chen and co-authors present MaLSF, a framework for verifying multimodal media by checking local details. Global fusion can wash out small clashes between image and text. MaLSF instead uses mask-label pairs as anchors between pixels and words. A two-way module lets text query the image and the image query the text. This cross-checking pinpoints the exact conflicts. A second module gathers those signals for the final call. The authors report top scores on the DGM4 and fake news tasks.
Catalog record
| CREATOR | Zizhao Chen, Ping Wei, Ziyang Ren, Huan Li, Xiangru YinState Key Laboratory of Human-Machine Hybrid Augmented Intelligence,Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University [email protected], [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43024 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.26052