NAU-QMUL: Utilizing BERT and CLIP for Multi-modal AI-Generated Image Detection

Xiaoyu Guo, Arkaitz Zubiaga · 2026

Read NAU-QMUL: Utilizing BERT and CLIP for Multi-modal AI-Generated Image Detection by Xiaoyu Guo, Arkaitz Zubiaga (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-23863.txt.

Description

Xiaoyu Guo and Arkaitz Zubiaga present a multi-modal, multi-task model for spotting AI-generated images and naming the generator behind them. The 2026 paper pairs a BERT text encoder with a CLIP vision encoder, fuses features across modalities, and trains with a tailored multi-task loss.

A pseudo-labeling step expands training data with high-confidence samples, which helps the model learn from more examples than its labeled set alone. In a competition on AI-generated image detection, the model placed fifth on both tasks, with stronger scores for detection than for generator identification. The authors present the design as a practical step toward reliable detection of synthetic images in real-world settings. Knowing the source model matters as much as knowing an image is fake.

Catalog record

CREATORXiaoyu Guo, Arkaitz Zubiaga
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE15 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-23863

Browse the full library · About the Tower of Babel