NMIRacle: Multi-modal Generative Molecular Elucidation from IR and NMR Spectra
Federico Ottomano, Yingzhen Li, Alex M. Ganose · 2025
Read NMIRacle: Multi-modal Generative Molecular Elucidation from IR and NMR Spectra by Federico Ottomano, Yingzhen Li, Alex M. Ganose (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-19733.txt.
Introduction
Federico Ottomano, Yingzhen Li, and Alex Ganose introduce NMIRacle, a generative system that works backward from spectra to molecular structure. Chemists normally read infrared and nuclear magnetic resonance spectra by expert interpretation, a slow craft skill. NMIRacle splits the problem into two stages, first learning how molecules assemble from fragments, then learning to read spectra.
Stage one trains a generator to rebuild structures from count-aware fragment descriptions, recording both which fragments appear and how often. Stage two adds a spectral encoder that maps infrared, proton NMR, and carbon-13 NMR inputs into the same latent space, fine-tuning the generator for direct spectra-to-molecule prediction. In tests it beat existing baselines at structure elucidation and held up as molecules grew more complex.
Catalog record
| CREATOR | Federico Ottomano, Yingzhen Li, Alex M. Ganose |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-19733
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NMIRacle: Multi-modal Generative Molecular Elucidation from IR and NMR Spectra Federico Ottomano, Yingzhen Li, Alex M. Ganose Abstract Molecular structure elucidation from spectroscopic data is a long-standing challenge in Chemistry, traditionally requiring expert interpretation. We introduce NMIRacle, a two-stage generative framework that builds upon recent paradigms in AI-driven spectroscopy with minimal assumptions. In the first stage, NMIRacle learns to reconstruct molecular structures from count-aware fragment encodings, which capture both fragment identities and their occurrences. In the second stage, a spectral encoder maps input spectroscopic measurements (IR, 1 H-NMR, 13 C-NMR) into a latent embedding that conditions the pre-trained generator. This formulation bridges fragment-level chemical modeling with spectral evidence, yielding accurate molecular predictions. Empirical results show that NMIRacle outperforms existing baselines on molecular elucidation, while maintaining robust performance across increasing levels of molecular complexity. NMIRacle code is publicly available at https://github.com/fedeotto/nmiracle . 1 Introduction Determining the molecular structure of an unknown compound through spectroscopy is a fundamental problem in Chemistry, central to drug discovery, metabolomics, and materials design. This task is challenging due to the combinatorial explosion of possible atomic arrangements: even for molecules with fewer than 36 heavy atoms, the size of drug-like chemical space could exceed \sim 10^{33} ( 23 ) . Techniques including infrared (IR) spectroscopy, nuclear magnetic resonance (NMR) spectroscopy and mass spectrometry (MS) provide complementary yet indirect evidence of the molecular structure, and interpreting them requires integrating heterogeneous and often noisy signals. Traditionally, structure elucidation relies on expert-driven spectral interpretation or database matching. These strategies are limited by subjectivity, the need for extensive chemical expertise, and the inability to identify molecules absent from reference libraries. Recent advances in deep learning have opened new directions for automated elucidation, including (i) cross-modal retrieval systems that learn shared embeddings of spectra and molecular structures ( 32 ; 12 ; 21 ) , and (ii) de novo generative frameworks that direcly predict molecular graphs or sequences from spectroscopic evidence ( 3 ; 17 ; 8 ; 31 ) . While retrieval-based methods leverage existing databases to identify the closest-matching structures, de novo generative approaches do not depend on pre-existing molecular libraries, making them inherently more flexible and capable of proposing novel compounds. However, this fully generative formulation poses substantial challenges: the model must integrate multiple spectral modalities with distinct noise characteristics and resolution biases, and learn a high-dimensional, multimodal mapping from continuous spectra to discrete molecular representations. Despite the availability of new datasets and benchmarks ( 4 ; 8 ) , current spectra-to-molecule generative methods typically exhibit one or more limitations: (i) reliance on a single spectral modality, which neglects complementary patterns ( 17 ; 3 ; 4 ) ; (ii) dependence on extensive pre-processing (e.g., peak extraction, multiplet assignment) to convert spectra into symbolic or text-based inputs ( 2 ; 33 ; 12 ) ; (iii) assumptions of strong prior information, such as chemical formula or molecular scaffold ( 1 ; 29 ) , which are rarely available under realistic experimental conditions; iv) limited benchmarking settings, restricted to molecules composed of only a few chemical species (typically C, N, O) and fewer than 20 heavy (non-hydrogen) atoms ( 9 ) . In this work, we tackle the most challenging formulation of molecular structure elucidation: direct generation of molecular structures from raw, multi-spectral data. We build upon previous established paradigms in data-driven molecular elucidation from spectroscopy with minimal assumptions ( 9 ) . We introduce NMR-IR oracle ( NMIRacle ), a generative framework that learns from spectroscopic intensity arrays, the same data produced by experimental instruments, without relying on symbolic pre-processing or handcrafted features. This setup is intentionally difficult, as the model must infer structural constraints from noisy, high-dimensional inputs, but it enables greater realism and generalization across multiple acquisition settings. We evaluate NMIRacle on a multimodal spectroscopic dataset comprising molecules with up to 35 heavy atoms and diverse chemical compositions ( 1 ) . Our framework consistently obtains strong molecular elucidation performance across a broad range of molecular sizes and structural complexities. We summarize the main contributions of this work below: • We propose NMIRacle, a generative framework for molecular structure elucidation from spectroscopy, operating directly on combined raw IR, 1 H-NMR, and 13 C-NMR spectra. • We replace established binary representations of molecular fragments with count-aware fragment encodings, demonstrating that this prior significantly improves accuracy in the context of spectra-guided molecular elucidation. • We design a multi-spectral encoder that fuses raw IR, 1 H-NMR, and 13 C-NMR signals through intra- and inter-spectral attention. • We demonstrate strong performance on molecular elucidation and robust generalization to complex molecules, under minimal input assumptions. 2 Related work Data-driven molecular elucidation from spectroscopy Molecular structure elucidation has recently emerged as a benchmark for multimodal AI, with several works addressing the task under diverse settings. 8 introduced MolPuzzle, a zero-shot benchmark framing structure elucidation as a multi-step reasoning task integrating spectral analysis, property inference, and functional groups assembly. MassSpecGym ( 4 ) provides standardized metrics and curated datasets for molecular de novo generation and retrieval from mass spectra. 1 present a large-scale multimodal dataset of \sim 790k molecules paired with simulated spectroscopic data, providing a unified benchmark for multimodal structure elucidation. 21 align spectral and molecular embeddings via contrastive learning for cross-modal retrieval, further employing a genetic algorithm to introduce novelty among retrieved molecular candidates. DiffNMR ( 31 ) employs a conditional discrete diffusion model to perform de novo molecular structure elucidation from NMR spectra, iteratively refining the molecular graph structure and using a two-stage pre-training for enhanced spectra-molecule alignment. Spec2Mol ( 17 ) reconstructs molecular SMILES via a gated recurrent unit (GRU)–based autoencoder, then aligns a convolution-based spectral encoder to the molecular latent space, enabling direct reconstruction from mass spectra. DiffMS ( 3 ) introduces a discrete diffusion framework for molecular graph generation, in which a graph transformer denoises adjacency matrices conditioned on molecular fingerprints predicted from mass spectra. NMR2Struct ( 9 ) employs an autoregressive multi-task setup in which a fragment-based generative model is reused for joint SMILES generation and fingerprint prediction conditioned on input spectra. DiffSpectra ( 28 ) introduces a diffusion-based framework for elucidating 3D molecules from Ultraviolet-visible (UV-Vis), IR, and Raman spectra, employing an SE(3)-equivariant architecture to jointly infer the 2D topology and 3D geometry of the molecule. ( ) Despite these advances, most AI-driven molecular elucidation methods remain single-modality, reliant on pre-processed inputs unavailable from experimental data, and evaluated on small molecules, falling short of realistic, multi-spectral elucidation scenarios. Conditional generative models for molecules Conditional molecular generation represents a central paradigm in AI-driven Chemistry, enabling the targeted design under textual, structural or multi-modal constraints. Text-driven inverse design via large language models ( 6 ; 7 ; 5 ; 22 ) , graph-based conditional diffusion models ( 18 ) , and multimodal molecular pipelines integrating images, text, and graphs ( 34 ; 14 ; 19 ) have significantly broadened the range of conditioning modalities. However, these methods rarely incorporate experimental observables. Spectroscopic signals provide physically grounded, high-dimensional evidence of molecular structure, but exhibit instrument-dependent noise and distributions that challenge generic multimodal architectures ( 8 ) . Fragment-based molecular generative modeling Motif-level modeling represents a flexible inductive bias for molecular generation, operating over chemically-meaningful molecular fragments rather than individual