AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Models

Jintao Lin, Bowen Dong, Weikang Shi, Chenyang Lei, Suiyun Zhang, Rui Liu, Xihui Liu · 2026

Read AEGIS: Exploring the Limit of World Knowledge Capabilities for Unified Mulitmodal Models by Jintao Lin, Bowen Dong, Weikang Shi, Chenyang Lei, Suiyun Zhang, Rui Liu, Xihui Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00561.txt.

Description

Jintao Lin and colleagues benchmark how well unified multimodal models, systems that understand and generate both images and text, can apply world knowledge across tasks. Existing tests usually probe one task at a time, which limits what they reveal. Their benchmark, AEGIS, covers visual understanding, generation, editing, and interleaved generation in a single suite.

AEGIS contains one thousand fifty hand-annotated questions across twenty-one topics, from science and humanities to daily life, and six reasoning types. To avoid fuzzy scoring, the team also proposes a checklist protocol that replaces open-ended judging with atomic yes-or-no checks. The combination is meant to show concretely where a model's world knowledge holds up across different kinds of multimodal work.

Catalog record

CREATORJintao Lin, Bowen Dong, Weikang Shi, Chenyang Lei, Suiyun Zhang, Rui Liu, Xihui Liu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-00561

Browse the full library · About the Tower of Babel