MSEarth: A Benchmark for Multimodal Scientific Comprehension of Earth Science
Xiangyu Zhao, Wanghan Xu, Bo LIU, Yuhao Zhou, Fenghua Ling, Ben Fei, Xiaoyu Yue, Lei Bai, Wenlong Zhang ✉, Xiao-Ming Wu · 2025
Read MSEarth: A Benchmark for Multimodal Scientific Comprehension of Earth Science by Xiangyu Zhao, Wanghan Xu, Bo LIU, Yuhao Zhou, Fenghua Ling, Ben Fei, Xiaoyu Yue, Lei Bai, Wenlong Zhang ✉, Xiao-Ming Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20740.txt.
Description
Xiangyu Zhao and co-authors build MSEarth, a test set for how well large models that read text and images can do Earth science. Graduate-level work in this field needs close reading of figures, not just simple captions. Few existing test sets capture that depth.
MSEarth draws on open research papers across the air, ice, water, rock, and living parts of Earth. It holds a very large set of figures with fuller captions and context from the source papers. Tasks cover caption writing, choice questions, and open reasoning, giving builders a harder and more faithful way to test science models.
Catalog record
| CREATOR | Xiangyu Zhao, Wanghan Xu, Bo LIU, Yuhao Zhou, Fenghua Ling, Ben Fei, Xiaoyu Yue, Lei Bai, Wenlong Zhang ✉, Xiao-Ming Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-20740