MSEarth: A Benchmark for Multimodal Scientific Comprehension of Earth Science

Xiangyu Zhao, Wanghan Xu, Bo LIU, Yuhao Zhou, Fenghua Ling, Ben Fei, Xiaoyu Yue, Lei Bai, Wenlong Zhang ✉, Xiao-Ming Wu · 2025

Read MSEarth: A Benchmark for Multimodal Scientific Comprehension of Earth Science by Xiangyu Zhao, Wanghan Xu, Bo LIU, Yuhao Zhou, Fenghua Ling, Ben Fei, Xiaoyu Yue, Lei Bai, Wenlong Zhang ✉, Xiao-Ming Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20740.txt.

Description

Xiangyu Zhao and co-authors build MSEarth, a test set for how well large models that read text and images can do Earth science. Graduate-level work in this field needs close reading of figures, not just simple captions. Few existing test sets capture that depth.

MSEarth draws on open research papers across the air, ice, water, rock, and living parts of Earth. It holds a very large set of figures with fuller captions and context from the source papers. Tasks cover caption writing, choice questions, and open reasoning, giving builders a harder and more faithful way to test science models.

Catalog record

CREATORXiangyu Zhao, Wanghan Xu, Bo LIU, Yuhao Zhou, Fenghua Ling, Ben Fei, Xiaoyu Yue, Lei Bai, Wenlong Zhang ✉, Xiao-Ming Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20740

Browse the full library · About the Tower of Babel