SpecX: A Large-Scale Benchmark for Multi-Modal Spectroscopy and Cross-Paradigm Evaluation
Chengrui Xiang Tengfei Ma † Yujie Chen Tong Wang † Haowen Chen † Xiangxiang Zeng College of Computer Science and Technology, Hunan University Changsha, China {mmtd, tfma, xzeng, wangtong}@hnu.edu.cn · 2026
Read SpecX: A Large-Scale Benchmark for Multi-Modal Spectroscopy and Cross-Paradigm Evaluation by Chengrui Xiang Tengfei Ma † Yujie Chen Tong Wang † Haowen Chen † Xiangxiang Zeng College of Computer Science and Technology, Hunan University Changsha, China {mmtd, tfma, xzeng, wangtong}@hnu.edu.cn (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18791.txt.
Introduction
Chengrui Xiang and five colleagues build SpecX, a large benchmark for spectroscopy across model types. Older spectral benchmarks stay small, poorly matched across types, or narrow in scope. SpecX gathers about one point seven million molecules across six spectral types. It supports tasks such as finding molecules and reading spectra, and tests show specialist models lead on signals while language models lead on high-level reasoning.
Catalog record
| CREATOR | Chengrui Xiang Tengfei Ma † Yujie Chen Tong Wang † Haowen Chen † Xiangxiang Zeng College of Computer Science and Technology, Hunan University Changsha, China {mmtd, tfma, xzeng, wangtong}@hnu.edu.cn |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77546 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18791
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SpecX: A Large-Scale Benchmark for Multi-Modal Spectroscopy and Cross-Paradigm Evaluation Chengrui Xiang Tengfei Ma † Yujie Chen Tong Wang † Haowen Chen † Xiangxiang Zeng College of Computer Science and Technology, Hunan University Changsha, China {mmtd, tfma, xzeng, wangtong}@hnu.edu.cn Abstract Existing spectral benchmarks are limited in scale, modality alignment, and evaluation scope, and typically focus on either specialized models or multimodal language models (MLLMs). We introduce SpecX, a large-scale benchmark for multi-modal spectroscopy with cross-paradigm evaluation. SpecX contains 1.7M molecules with diverse spectral modalities, including NMR (¹H, ¹³C, HSQC), IR, MS,UV,Raman and FL, and is organized into three tiers: a large-scale dataset for pretraining, an aligned multi-spectral subset for benchmarking, and a high-quality experimental subset for evaluation. SpecX supports a range of tasks such as molecular elucidation, spectrum simulation, and spectral understanding, and enables unified evaluation across both specialized spectral models and MLLMs. Experiments show that specialized models excel at signal-level modeling, while MLLMs exhibit strengths in high-level reasoning but lack precise spectral grounding. SpecX establishes a unified benchmark for spectral intelligence and highlights the need for spectrum-native foundation models. 1 Introduction Spectroscopic techniques are fundamental tools for determining molecular structure and properties. Different modalities—including Nuclear Magnetic Resonance (NMR), Infrared (IR), Mass Spectrometry (MS), Raman, Ultraviolet-Visible (UV), and Fluorescence (FL)—each reveal complementary aspects of molecular architecture. Just as an experienced chemist integrates multimodal spectral information to identify an unknown compound, automated structure elucidation (ASE) requires the same integrative reasoning. However, achieving robust ASE across diverse chemical spaces remains a significant challenge. Recent advances in AI have begun to transform computational spectroscopy. Notably, the Multimodal Spectroscopic dataset [ 1 ] introduced simulated spectra across five modalities for approximately 790k molecules, supporting structure elucidation, spectrum simulation, and functional group prediction. Despite this progress, three critical limitations remain. First, insufficient scale and modality coverage. Existing datasets remain below one million molecules and omit several practically important modalities. UV-Vis, fluorescence, and Raman spectroscopy are widely used in chemical analysis but largely absent from large-scale benchmarks. Scale also constrains the training of spectral foundation models with robust generalization. Second, lack of experimentally grounded evaluation. Existing large-scale datasets rely entirely on simulated spectra, which systematically differ from experimental ones due to solvent effects, instrument response, and temperature broadening. No existing benchmark provides a systematically aligned experimental subset. SpecX introduces this tier to provide a foundation for future research investigating the simulation-to-reality gap. Third, fragmented evaluation across model paradigms. As shown in Table 1 , existing benchmarks fall into two categories: specialized model benchmarks [ 1 ] (e.g., Multimodal Spec, MassSpecGym, NMRNet) focus on signal-level precision but omit MLLMs, while MLLM-oriented benchmarks [ 2 ] (e.g., SpectrumBench, MolPuzzle) evaluate high-level reasoning but lack signal-level protocols. A unified benchmark enabling side-by-side comparison remains absent. To address these gaps, we introduce SpecX , a large-scale multimodal spectroscopic benchmark for cross-paradigm evaluation. SpecX contains 1.7 million molecules spanning eight modalities: 1 H-NMR, 13 C-NMR, HSQC-NMR, IR, MS, UV, FL, and Raman, organized into three tiers: a large-scale simulated dataset (Large subset) for pretraining, a modality-aligned multispectral subset (Small subset) for multimodal QA, and a high-quality experimental subset (Exp subset) for real-world generalization. Tasks (1)–(3) are evaluated on the Large subset; Task (4) on both the Small and Exp subsets. All experiments apply random and scaffold splits to assess interpolation and generalization across chemical space.Fluorescence spectra are included in the full dataset but are not part of the current Large/Small benchmark splits (see Table 11 ). For presentation, we also refer to six modality groups by merging the three NMR sub-modalities ( 1 H, 13 C, and HSQC) into a single NMR category (Figure 1 ). SpecX supports four evaluation tasks: structure elucidation, spectrum simulation, functional group QA, and Spectrum-SMILES cross-modal QA, integrated at larger scale and broader modality coverage than prior work. Experiments reveal complementary strengths: specialized models excel at signal-level modeling, while MLLMs demonstrate strong high-level reasoning but lack precise spectral grounding. SpecX establishes a unified benchmark for spectral intelligence and highlights the need for spectrum-native foundation models. Benchmark Scale Multi-Spec Experimental Tasks (Elucidation/Simulation) Model Coverage NovoBench small ✗ ✗ limited MLLM MolPuzzle small ✗ ✗ Elucidation MLLM Multimodal Spec medium ✓(partial) partial Elucidation + Simulation ML MassSpecGym medium ✗ ✓ Elucidation + Simulation ML NMRNet medium ✗ ✓ Elucidation ML SpectrumBench medium ✓ ✗ All MLLM SpecX (Ours) 1.7M ✓(aligned) ✓ All (MLLM + ML) Table 1: Comparison with existing spectral benchmarks. SpecX provides large-scale, aligned multi-spectral data with experimental validation, and uniquely supports unified evaluation across both specialized spectral models and multimodal language models. 2 Related Work Spectral Datasets and Benchmarks: Spectroscopic datasets form the foundation for learning-based molecular analysis. Early single-modality datasets, such as nmrshiftdb2 and the NIST IR database, support tasks including peak prediction and functional group identification, but are limited in modality coverage and do not support cross-modal reasoning. The Multimodal Spectroscopic dataset advances this by providing simulated spectra across 1 H-NMR, 13 C-NMR, HSQC, IR, and MS for approximately 790k molecules, enabling joint modeling and structure elucidation. However, it omits UV, fluorescence, and Raman spectroscopy, and its reliance on simulated spectra introduces a deployment gap. Beyond chemistry, large-scale multimodal datasets like LAION-5B [ 3 ] demonstrate the importance of scale, modality alignment, and task diversity—principles not yet fully realized in spectroscopic benchmarks. Learning from Spectral Data: Machine learning for spectroscopy has traditionally focused on single-modality tasks. In NMR, prior work [ 4 , 5 ] has explored structure elucidation via probabilistic and transformer-based models. In IR spectroscopy [ 6 , 7 ] and mass spectrometry [ 8 ] , deep learning has been applied to functional group prediction and compound identification. More recently, multimodal fusion of IR, UV–Vis, fluorescence, and Raman spectra has improved predictive performance in biomedical applications [ 9 , 10 ] , highlighting the potential of cross-modal spectral learning. Nevertheless, existing methods remain largely task-specific and evaluated on isolated datasets, limiting progress toward unified spectral intelligence. Multimodal Learning and Evaluation: Multimodal learning has advanced rapidly, with large-scale benchmarks confirming that integrating diverse modalities boosts downstream performance. However, recent studies reveal that models often exploit intra-modality shortcuts rather than achieving genuine cross-modal reasoning [ 11 , 12 ] . In molecular spectroscopy, this challenge is particularly pronounced: specialized models such as XGBoost and 1D-CNNs excel at signal-level prediction via domain-specific inductive biases, while MLLMs demonstrate stronger capacity for high-level reasoning and cross-modal question answering. Existing benchmarks evaluate only one paradigm, precluding standardized comparison. A unified framework that jointly assesses signal-level fidelity and structural reasoning across modalities remains an open frontier, and bridging this gap is essential for developing chemical AI capable of deep, bidirectional spectral understanding. Figure 1: Overview of the SpecX framework. 3 Dataset Spectroscopic characterization is central to organic chemistry, whether for reaction monitoring or post-synthesis structural elucidation. Interpreting data across multiple modalities is crucial for accurate structure identification, as each technique provides complementary information to resolve ambiguities. A dataset for evaluating multimodal spectral learning must therefore span a realistic and diverse chemical space to ensure models generalize well to real-world analytical challenges. To this end, SpecX integrates molecules from multiple public repositories, including QME14S [ 13 ] , ViBench [ 14 ] , ChEMBL [ 15 ] ,