QERNEL: a Scalable Large Electron Model

Khachatur Nazaryan, Liang Fu · 2026

Read QERNEL: a Scalable Large Electron Model by Khachatur Nazaryan, Liang Fu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26018.txt.

Introduction

Nazaryan and Fu present QERNEL, a base neural wavefunction for tunable many-electron Hamiltonians. It solves whole sets and captures their ground states in one model. FiLM conditioning joins mixture of experts and grouped-query attention, lifting expressivity at low cost. Applied to electrons in semiconductor moiré heterobilayers, one weight-shared model handles up to 150 electrons. Conditioned on moiré potential depth, QERNEL captures quantum liquid and crystal states. It finds the sharp transition between them, marked by abrupt shifts in interaction energy and charge density.

Catalog record

CREATORKhachatur Nazaryan, Liang Fu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20023
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.26018

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

QERNEL: a Scalable Large Electron Model Khachatur Nazaryan, Liang Fu Abstract We introduce QERNEL, a foundational neural wavefunction that variationally solves families of parameterized many-electron Hamiltonians and captures their ground states throughout parameter space within a single model. QERNEL combines FiLM-based parameter conditioning with scale-efficient architectural elements — mixture of experts and grouped-query attention, substantially improving expressivity at low computational cost. We apply QERNEL to interacting electrons in semiconductor moiré heterobilayers, training a single weight-shared model for systems of up to 150 electrons. By solving the many-electron Schrödinger equation conditioned on moiré potential depth, QERNEL captures both quantum liquid and crystal states and discovers the sharp phase transition between them, marked by abrupt changes in interaction energy and charge density. Our work establishes a foundation model for moiré quantum materials and a scalable architecture toward a Large Electron Model for solids. I Introduction Representing many-body wavefunctions with neural networks has become a powerful variational method for solving interacting quantum systems in continuous space. In this framework, the neural network itself defines the variational ansatz: its weights and biases parameterize the wavefunction, and are optimized by minimizing the Monte Carlo estimate of the energy. In recent years, this approach has delivered highly accurate ground states for atoms and molecules 16 ; 7 ; 22 ; 9 , the uniform electron gas 2 ; 23 ; 11 ; 8 ; 20 ; 15 , moiré semiconductors 10 ; 12 ; 6 , and fractional quantum Hall liquids 21 ; 17 ; 13 . Much of this progress has been achieved with determinant-based architectures, which strictly enforce fermionic antisymmetry. As shown recently, a linear combination of Slater determinants multiplied by symmetric functions can approximate any continuous Fermi wavefunctions to arbitrary accuracy 4 ; 5 . This universal representational power is realized in neural networks through the attention mechanism 6 , which builds many-body correlations between particles. Yet despite this success, the framework still mostly uses neural network in a pointwise way: one chooses a Hamiltonian, optimizes a neural wavefunction for that instance, and repeats the optimization when the parameters change. From the perspective of numerical many-body physics this is natural, since the goal is to solve each problem as accurately as possible. From the perspective of modern AI, however, it is a limited use of neural networks. There the aim is not merely to solve one task, but to learn an underlying pattern that generalizes across a family of related tasks. This raises a natural question for quantum many-body physics: can one train a single neural wavefunction that generalizes across an entire family of Hamiltonians? Figure 1: Architecture of QERNEL. (a) Overall conditional wavefunction pipeline: electron features are embedded into electronic streams, processed by stacked equivariant blocks, projected to generalized orbitals, and combined into determinants. The Hamiltonian context is threaded alongside the electron streams and repeatedly injected throughout the depth of the network. (b) Mixture-of-experts block with a router and an shared expert. (c) Grouped-query attention, where multiple query heads share key and value heads for improved efficiency. (d) FiLM conditioning, which injects the context into the electronic streams through channel-wise shifts and rescalings. Recent work has begun to explore this direction. A unified neural ansatz for multiple Hamiltonians in lattice systems has been developed 18 . In quantum chemistry, neural wavefunction optimization can be amortized across molecules and geometries 3 . Recently, a foundation model based on universal Fermi network 5 has been introduced to solve many-electron Schrodinger equation across multiple Hamiltonian parameters and particle numbers and predict ground states for unseen instances 25 ; 24 . This “large electron model” points toward a paradigm shift from single-instance wavefunction solvers to foundation models that learn generalizable wavefunctions. As the ambition for quantum foundation models grows, a limitation becomes increasingly severe: compute. To attain accurate results often require models with parameter counts approaching or exceeding 10^{6} even for systems of only \sim 20 particles 6 . This makes the methodology powerful, but not always accessible to the broader community. If foundational neural wavefunctions are to become practical, the architecture itself must become more efficient, more stable, and more explicitly designed for generalization. Figure 2: Benchmarking the efficiency of QERNEL. (a) final variational energy per electron versus parameter count for 18- and 24-electron systems. QERNEL reaches the same accuracy regime as the PsiFormer baseline 6 with roughly 6 – 7\times fewer parameters. For sake of presentation, the 24e data was shifted down by 0.08meV (b),(c) Training curves of QERNEL vs baseline. (b) at comparable parameter count, QERNEL converges about 6\times faster and with improved stability than the baseline. (c) a 240 K-parameter QERNEL converges to a slightly lower energy as a 1.1 M-parameter baseline. Figure 3: Inferred real space densities for a 150-electron system obtained with QERNEL in a fixed-context, non-foundational setting. (a) Fermi-liquid regime, \lambda=0.7 . (b) Generalized Wigner-crystal regime, \lambda=1.5 . The isolated minor defects in the density profile are a computational artifact and are not interpreted as a physical excitation. In this work we solve these issues by introducing QERNEL: Q uantum E xpert- R outed Ne ural L earner. QERNEL is a large electron model designed to solve entire families of ground states within a single conditional neural wavefunction. Architecturally, it moves away from the plain Transformer (as in GPT-2) and toward the design of modern large language models. Concretely, we introduce grouped-query attention (GQA) 1 to capture inter-electron correlations, mixture-of-experts (MoE) 19 routing to allocate capacity effectively, feature-wise linear (FiLM-style) context modulation 14 to adapt the network across Hamiltonian parameter space, custom power-law tailed activation functions for stable training and efficient transfer learning across system size. Together, these innovations enable far fewer network parameters and much faster and more stable training. Once trained, the context conditioning allows Hamiltonian parameter sweeps to be performed by inference and short fine tuning, rather than by full retraining at every point. We apply QERNEL to interacting electrons in semiconductor moiré heterobilayers with periodic boundary conditions and study the ground state across Hamiltonian parameter space within a single conditional model. Our study uncovers a sharp quantum phase transition between the Fermi liquid state and the generalized Wigner crystal. Such behavior is a stringent test of a foundational ansatz: the model must represent both phases within one shared wavefunction family and still resolve their abrupt reorganization, rather than smoothing them into a single interpolation. We show that QERNEL succeeds in doing so, demonstrating that a context-aware foundational model can capture the sharp transition that emerges in a quantum many-body phase diagram. Owing to the efficiency of the architecture, this can be done for substantially larger systems than would otherwise be accessible, reaching up to 96 electrons in the foundational setting. To further illustrate scalability beyond the conditional setting, we also perform fixed-context calculations at selected parameter values for systems of up to 150 electrons, where the two phases remain clearly distinguishable in real space. A broader objective of this work is to make the quantum foundation model more computationally accessible to the wider condensed-matter community. QERNEL is designed not only to improve variational accuracy, but to do so on modest hardware. All calculations reported in this work were carried out on only two NVIDIA V100

Read the complete text