Bridging Pixels and Words: Mask-Aware Local Semantic Fusion for Multimodal Media Verification

Zizhao Chen, Ping Wei, Ziyang Ren, Huan Li, Xiangru YinState Key Laboratory of Human-Machine Hybrid Augmented Intelligence,Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University [email protected], [email protected] · 2026

Read Bridging Pixels and Words: Mask-Aware Local Semantic Fusion for Multimodal Media Verification by Zizhao Chen, Ping Wei, Ziyang Ren, Huan Li, Xiangru YinState Key Laboratory of Human-Machine Hybrid Augmented Intelligence,Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University [email protected], [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26052.txt.

Description

Chen and co-authors present MaLSF, a framework for verifying multimodal media by checking local details. Global fusion can wash out small clashes between image and text. MaLSF instead uses mask-label pairs as anchors between pixels and words. A two-way module lets text query the image and the image query the text. This cross-checking pinpoints the exact conflicts. A second module gathers those signals for the final call. The authors report top scores on the DGM4 and fake news tasks.

Catalog record

CREATORZizhao Chen, Ping Wei, Ziyang Ren, Huan Li, Xiangru YinState Key Laboratory of Human-Machine Hybrid Augmented Intelligence,Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University [email protected], [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43024
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.26052

Browse the full library · About the Tower of Babel