QuantumCanvas: A Multimodal Benchmark for Visual Learning of Atomic Interactions

Can Polat Texas A&M University [email protected] Erchin Serpedin Texas A&M University [email protected] Mustafa Kurban Ankara University Texas A&M University at Qatar [email protected] Hasan Kurban Hamad Bin Khalifa University [email protected] · 2025

Read QuantumCanvas: A Multimodal Benchmark for Visual Learning of Atomic Interactions by Can Polat Texas A&M University [email protected] Erchin Serpedin Texas A&M University [email protected] Mustafa Kurban Ankara University Texas A&M University at Qatar [email protected] Hasan Kurban Hamad Bin Khalifa University [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-01519.txt.

Introduction

Can Polat and Erchin Serpedin build a test for how models learn atomic forces. Most models fit whole molecules or crystals at once. They learn links, not the true pair forces. Yet bonds, charge shifts, and coupling all stem from pairs of atoms.

Their test, QuantumCanvas, shows atomic scenes in visual form. Models must learn pair forces from those scenes. Pair-level skill should move better to new materials. The test gives the field a shared yardstick for a skill that whole-molecule fits often hide. Visual scenes make the test open to teams outside physics coding, since the input looks like data a vision model already knows.

Catalog record

CREATORCan Polat Texas A&M University [email protected] Erchin Serpedin Texas A&M University [email protected] Mustafa Kurban Ankara University Texas A&M University at Qatar [email protected] Hasan Kurban Hamad Bin Khalifa University [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-01519

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

QuantumCanvas: A Multimodal Benchmark for Visual Learning of Atomic Interactions Can Polat Texas A&M University [email protected] Erchin Serpedin Texas A&M University [email protected] Mustafa Kurban Ankara University Texas A&M University at Qatar [email protected] Hasan Kurban Hamad Bin Khalifa University [email protected] Abstract Despite rapid advances in molecular and materials machine learning, most models lack physical transferability: they fit correlations across whole molecules or crystals rather than learning the quantum interactions between atomic pairs. Yet bonding, charge redistribution, orbital hybridization, and electronic coupling all emerge from these two-body interactions that define local quantum fields in many-body systems. We introduce QuantumCanvas , a large-scale multimodal benchmark that treats two-body quantum systems as foundational units of matter. The dataset spans 2,850 element–element pairs, each annotated with 18 electronic, thermodynamic, and geometric properties and paired with ten-channel image representations derived from l l - and m m -resolved orbital densities, angular field transforms, co-occupancy maps, and charge-density projections. These physically grounded images encode spatial, angular, and electrostatic symmetries without explicit coordinates, providing an interpretable visual modality for quantum learning. Benchmarking eight architectures across 18 targets, we report MAEs of 0.201 eV on energy gap with GATv2, 0.265 eV on HOMO, and 0.274 eV on LUMO with EGNN; for energy-related quantities DimeNet attains 2.27 eV total-energy MAE and 0.132 eV repulsive-energy MAE, while a multimodal fusion model achieves a 2.15 eV Mermin free-energy MAE. Pretraining on QuantumCanvas further improves convergence stability and generalization when fine-tuned on larger dataset such as QM9 , MD17 , and CrysMTM . By unifying orbital physics with vision-based representation learning, QuantumCanvas provides a principled and interpretable basis for learning transferable quantum interactions through coupled visual and numerical modalities. Dataset and model implementations can be found at https://github.com/KurbanIntelligenceLab/QuantumCanvas . 1 Introduction Materials science underpins modern advances in semiconductors, energy conversion, catalysis, and quantum technologies 13 . A central challenge lies in understanding how atomic arrangements translate into measurable electronic, thermodynamic, and structural properties 32 . While data-driven models trained on large molecular and crystalline repositories have accelerated discovery, most remain statistical surrogates rather than physically grounded learners of interaction 12 . State-of-the-art architectures such as SchNet 58 , DimeNet++ 29 , PaiNN 59 , GemNet 28 , Equiformer 39 , NequIP 8 , Pure2DopeNet 49 , Allegro 45 , and GotenNet 5 achieve impressive accuracy through geometric message passing and equivariant tensor updates. However, they encode atomic interactions implicitly, capturing correlations across full structures rather than the fundamental quantum mechanisms through which atoms exchange charge, form bonds, and couple orbitals 65 . As a result, their generalization often deteriorates for unseen elements, charge states, or coordination motifs, revealing a limited understanding of transferable physical principles 55 . At the most fundamental level, bonding, charge redistribution, energy exchange, and orbital hybridization emerge from two-body quantum interactions 46 . These interactions define the local potential landscape on which all many-body effects are built. Explicitly learning them offers a direct route to physics-aware representations that are not tied to any specific geometry or composition 9 . Despite their foundational importance, large-scale datasets systematically targeting two-body quantum systems remain scarce, leaving this essential regime largely unexplored in machine learning. To address this gap, we introduce QuantumCanvas , a large-scale multimodal benchmark that redefines two-body quantum systems as the elemental building blocks of matter. The dataset enumerates all 2,850 element–element combinations across 75 elements and provides eighteen complementary descriptors covering energetic, electronic, thermodynamic, and geometric properties. Each pair is also represented by a ten-channel image tensor derived from l - and m -resolved orbital densities 66 , angular field transforms such as GAF and MTF 70 ; 68 , co-occupancy maps 63 , and charge-density projections 43 ; 6 ; 42 . These physically grounded images encode spatial, angular, and electrostatic symmetries without explicit coordinates, creating a visually interpretable modality that complements graph-based representations. All diatomics are computed under a consistent Kohn–Sham framework 10 ; 24 at fixed electronic temperature using Mermin’s finite-temperature formalism 61 , with identical grids, smearing, and dispersion settings, ensuring that energies, orbital levels, and charge distributions remain statistically comparable across pairs. The benchmark evaluates eight representative architectures across eighteen targets using mean absolute error under both random and composition-held-out splits, averaged over three seeds with uniform hyperparameter budgets. Pretraining on QuantumCanvas yields transferable embeddings that improve accuracy, convergence, and robustness when fine-tuned on established molecular and crystalline benchmarks such as QM9 52 , MD17 16 , and CrysMTM 50 . These results demonstrate that representations learned from two-body quantum interactions provide a physically meaningful foundation for generalizing across molecular, dynamical, and solid-state regimes. The main contributions of this work are: (1) a comprehensive dataset of 2,850 diatomic systems covering 75 elements with 18 quantum-mechanical descriptors; (2) a ten-channel coordinate-free image representation derived from orbital populations and charge features that encodes symmetry for vision and multimodal learning; (3) a unified benchmark of eight architectures across eighteen targets under matched budgets, revealing modality-specific inductive biases and a well-defined difficulty gradient; and (4) experimental evidence that two-body pretraining improves accuracy, convergence, and generalization on QM9 , MD17 , and CrysMTM . Figure summarizes the elemental coverage and per-channel statistics that motivate this multimodal design. 2 Related Work Modeling atomic interactions. In quantum mechanics, all molecular and material phenomena originate from interactions between atoms 38 . The two-body problem forms the foundation of quantum chemistry, governing the potential energy and charge distribution between a pair of nuclei and their electrons 4 . Classical models such as the Lennard–Jones and Morse potentials approximate these interactions parametrically 36 ; 67 , while first-principles approaches like density functional theory (DFT) resolve them directly from the electronic structure 41 . In condensed-matter physics, pair potentials remain indispensable for modeling cohesive energies, lattice stability, and defect formation 40 . Despite their universality, explicit representations of two-body quantum behavior are largely absent from modern machine learning frameworks 53 . Most architectures encode atomic neighborhoods as high-dimensional embeddings with limited physical interpretability 21 . Capturing two-body interactions explicitly is critical for achieving transferability, as these interactions form a universal basis that generalizes across molecular, crystalline, and amorphous systems 1 ; 71 . Existing datasets in molecular and materials machine learning. The rapid progress of materials informatics has been enabled by large-scale quantum datasets. Benchmarks such as QM7-X 33 and MD22 17 capture molecular geometries and DFT-level electronic properties for diverse organic systems, while the Materials Project, OQMD 56 , NOMAD 23 , and Matbench 25 provide millions of crystalline and surface calculations. These resources have catalyzed the development of graph-based and equivariant models that enable data-driven discovery of materials and molecules 20 . However, they primarily describe fully realized molecular or bulk systems, where pairwise interactions are entangled with many-body effects, polarization, and geometry-dependent coupling 34 . As a result, they do not isolate the primitive two-body quantum observables that underpin all higher-order material behavior 2 . Two-body datasets and their limitations. Only a few specialized efforts have targeted atomic pair interactions, often in the context of potential fitting and spectroscopy 47 . Frameworks such as ANI 60 and MACE 7 incorporate pairwise contributions through local energy decomposition but lack explicit two-body reference data. Experimental and ab initio diatomic datasets (e.g., NIST diatomic constants)

Read the complete text