A Unified Frequency Principle for Quantum and Classical Machine Learning
Rundi Lu, Ruiqi Zhang, Weikang Li, Zhaohui Wei, Dong-Ling Deng, Zhengwei Liu · 2026
Read A Unified Frequency Principle for Quantum and Classical Machine Learning by Rundi Lu, Ruiqi Zhang, Weikang Li, Zhaohui Wei, Dong-Ling Deng, Zhengwei Liu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03169.txt.
Introduction
Rundi Lu and five co-authors give a unified account of the frequency principle, the observed tendency of neural networks to learn low-frequency patterns before high-frequency detail. The principle was known for classical networks; this work builds one framework covering both classical and quantum neural networks. Within it, the authors prove that quantum networks also show a spectral bias toward low-frequency components of the target function.
They then analyze noise: when single-qubit noise acts after the encoding rotations as a matching Pauli channel, each Fourier component shrinks by a factor that grows harsher with frequency. High-frequency terms fade exponentially while low-frequency structure stays learnable, and the noisy circuits remain efficiently simulable classically on average. Numerical experiments confirm that quantum networks learn low-frequency features first and stay robust in the predicted way.
Catalog record
| CREATOR | Rundi Lu, Ruiqi Zhang, Weikang Li, Zhaohui Wei, Dong-Ling Deng, Zhengwei Liu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-03169
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Unified Frequency Principle for Quantum and Classical Machine Learning Rundi Lu, Ruiqi Zhang, Weikang Li, Zhaohui Wei, Dong-Ling Deng, Zhengwei Liu Abstract Quantum neural networks constitute a key class of near-term quantum learning models, yet their training dynamics remain not fully understood. Here, we present a unified theoretical framework for the frequency principle (F-principle) that characterizes the training dynamics of both classical and quantum neural networks. Within this framework, we prove that quantum neural networks exhibit a spectral bias toward learning low-frequency components of target functions, mirroring the behavior observed in classical deep networks. We further analyze the impact of noise and show that, when single-qubit noise is applied after encoding-layer rotations and modeled as a Pauli channel aligned with the rotation axis, the Fourier component labeled by 𝝎 \bm{\omega} is suppressed by a factor ( 1 − 2 γ ) ‖ 𝝎 ‖ 1 (1-2\gamma)^{\|\bm{\omega}\|_{1}} . This leads to exponential attenuation of high-frequency terms while preserving the learnability of low-frequency structure. In the same setting, we establish that the resulting noisy circuits admit efficient classical simulation up to average-case error. Numerical experiments corroborate our theoretical predictions: Quantum neural networks primarily learn low-frequency features during early optimization and maintain robustness against dephasing and depolarizing noise acting on the encoding layer. Our results provide a frequency-domain lens that unifies classical and quantum learning dynamics, clarifies the role of noise in shaping trainability, and guides the design of noise-resilient quantum neural networks. I Introduction Deep neural networks (DNNs) are hierarchical computational models whose layered structures learn increasingly abstract representations through gradient-based optimization Schmidhuber 2015 ; LeCun et al. 2015 ; Goodfellow et al. 2016 . Their capacity to extract multi-scale features has driven major advances in image and speech recognition, natural language processing, and scientific computing Carleo and Troyer 2017 ; Gu et al. 2018 ; Khan et al. 2020 ; Jordan and Mitchell 2015 ; Vaswani et al. 2017 ; Luo and Clark 2019 ; Sharir et al. 2020 ; Goodfellow et al. 2020 ; Hermann et al. 2020 ; Jiang et al. 2022 ; Jumper et al. 2021 ; Zhang et al. 2025 . Motivated by these developments and by the pursuit of practical quantum advantages, a wide range of quantum machine-learning approaches have been proposed Schuld et al. 2015 ; Biamonte et al. 2017 ; Das Sarma et al. 2019 ; Lu et al. 2020 ; Lloyd et al. 2013 ; Dunjko et al. 2016 ; Biamonte et al. 2017 ; Abbas et al. 2021 ; Liu et al. 2021 ; Gao et al. 2022 ; Gyurik and Dunjko 2023 ; Zhao and Deng 2025 ; Zhang et al. 2024a ; Ye et al. 2025 , among which quantum neural networks (QNNs) serve as an important paradigm. QNNs train parameterized quantum circuits on classical or quantum data, enabling expressive quantum models that are compatible with near-term hardware. They have been explored for supervised learning, generative modeling, and quantum many-body applications Du et al. 2025 . Despite significant methodological advances, a central problem lies in understanding the optimization dynamics that govern how these models learn. On the classical side, extensive studies have characterized the behavior of DNNs during training, revealing properties of their loss landscapes, uncovering phenomena such as saddle points Dauphin et al. 2014 , the geometry of local minima Keskar et al. 2016 , and the implicit regularization effects of gradient-based optimizers Choromanska et al. 2015 ; Soudry et al. 2018 . These insights have helped explain why large, overparameterized models generalize well despite their expressive power. On the quantum side, QNNs face optimization challenges that stem from the structure of parameterized quantum circuits themselves. Highly expressive circuits can approximate unitary designs, leading to a concentration of measure in high-dimensional Hilbert spaces and consequently to barren plateaus, where gradients vanish exponentially with system size McClean et al. 2018 ; Cerezo et al. 2021 . This phenomenon further contributes to intricate trade-offs between expressibility and trainability Holmes et al. 2022 ; Arrasmith et al. 2022 . Recent analyses of overparameterized quantum models have provided valuable insights into the training dynamics Liu et al. 2023 ; Shirai et al. 2024 ; Liu et al. 2022 , but these remain tied to specific architectures, cost functions, or noise assumptions. This motivates a central question: does a common principle underlie the training dynamics of both classical and quantum neural networks? In this work, we establish a unified theoretical framework demonstrating that the frequency principle (F-principle) governs early-stage training dynamics in both classical and quantum neural networks. Although previous empirical and numerical studies have suggested that the F-principle may serve as a common organizing perspective Luo et al. 2019 ; Xu et al. 2019 ; Zhang et al. 2021 ; Xu et al. 2024 , its status has remained largely phenomenological: gradient-based learners tend to capture the low-frequency components of a target function before fitting its high-frequency structure. This spectral bias was first identified in classical deep networks Jacot et al. 2018 ; Lee et al. 2019 ; John Xu et al. 2020 ; Rahaman et al. 2019 ; Cao et al. 2019 and has since been linked to their generalization behavior in highly overparameterized regimes Zhang et al. 2021 . More recently, numerical evidence indicates that quantum models exhibit analogous low-frequency preference Xu and Zhang 2024 ; Duffy and Jastrzebski 2025 , suggesting that the F-principle may reflect a deeper, architecture-independent feature of gradient-driven optimization. Here, we rigorously prove that under gradient-flow dynamics, low-frequency modes are learned substantially faster than high-frequency ones, establishing the F-principle as a rigorous and model-agnostic law. To bridge classical and quantum learning within a single mathematical formulation, we represent classical data over \mathbb{R}^{d} (or \mathbb{T}^{d} after encoding) and quantum pure states over the complex projective space \mathbb{CP}^{d-1} , showing that both settings share the same fundamental spectral bias within this unified smooth-manifold framework. Noise analysis —While our first result establishes a unified F-principle for noiseless training dynamics, practical quantum devices inevitably operate in the presence of noise Wang et al. 2021 ; Sun et al. 2024 ; Shao et al. 2024 ; Aharonov et al. 2023 ; Fontana et al. 2025 . Prior work has shown that specific circuit architectures under dephasing noise exhibit attenuation of high-frequency spectral components Fontana et al. 2025 . We further broaden this picture by analyzing a general class of parameterized quantum circuits in which noise is inserted after each rotation gate as a single-term Pauli channel aligned with the gate’s rotation axis. In this setting, we prove that such noise universally induces exponential suppression of high-frequency Fourier components, while leaving low-frequency components comparatively intact. As a consequence, the gradients associated with smooth, low-frequency structure remain stable, implying that noisy QNNs continue to learn low-frequency features effectively during the early stages of optimization. We further verify that the time derivative of the low-frequency loss still dominates that of the full loss under this noise model, so the unified F-principle persists in the noisy regime. Classical simulation —Using the same Pauli path-integral representation, this noise-induced spectral suppression provides a new perspective on the classical simulability of noisy parameterized quantum circuits. Since the contribution of Fourier modes with higher Fourier frequencies decay