SciMDR : Benchmarking and Advancing Scientific Multimodal Document Reasoning

Ziyu Chen C \hskip 1.00006pt{}^{{\color[rgb]{0.5,0,0}\boldsymbol{C}}}, Yilun Zhao Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, Chengye Wang Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, Rilyn Han Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, Arman Cohan Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, 𝑪 \hskip 1.00006pt{}^{{\color[rgb]{0.5,0,0}\boldsymbol{C}}} University of Chicago, 𝑻 \hskip 1.00006pt{}^{{\color[rgb]{0.0039,0.4922,0.7813}\boldsymbol{T}}} TCS Research · 2026

Read SciMDR : Benchmarking and Advancing Scientific Multimodal Document Reasoning by Ziyu Chen C \hskip 1.00006pt{}^{{\color[rgb]{0.5,0,0}\boldsymbol{C}}}, Yilun Zhao Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, Chengye Wang Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, Rilyn Han Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, Arman Cohan Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, 𝑪 \hskip 1.00006pt{}^{{\color[rgb]{0.5,0,0}\boldsymbol{C}}} University of Chicago, 𝑻 \hskip 1.00006pt{}^{{\color[rgb]{0.0039,0.4922,0.7813}\boldsymbol{T}}} TCS Research (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12249.txt.

Description

Chen, Zhao, Wang, Han, Patwardhan, and Cohan build SciMDR, a training set for scientific document reasoning across modes. Dataset builders face a trade-off among scale, faithfulness, and realism in such data. Their synthesize-and-reground frame works in two stages to ease that trade-off. Claim-centric synthesis first makes faithful QA pairs on focused segments of papers. Programmatic regrounding then embeds those pairs into full-document tasks with realistic complexity. Models fine-tuned on the 300K pairs improve on several scientific QA benchmarks.

Catalog record

CREATORZiyu Chen C \hskip 1.00006pt{}^{{\color[rgb]{0.5,0,0}\boldsymbol{C}}}, Yilun Zhao Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, Chengye Wang Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, Rilyn Han Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, Arman Cohan Y \hskip 1.00006pt{}^{{\color[rgb]{0,0.207,0.418}\boldsymbol{Y}}}, 𝑪 \hskip 1.00006pt{}^{{\color[rgb]{0.5,0,0}\boldsymbol{C}}} University of Chicago, 𝑻 \hskip 1.00006pt{}^{{\color[rgb]{0.0039,0.4922,0.7813}\boldsymbol{T}}} TCS Research
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62208
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.12249

Browse the full library · About the Tower of Babel