Quantum Neural Networks for Cloud Cover Parameterizations in Climate Models Lorenzo Pastori, Arthur Grundner, Veronika Eyring, Mierk Schwabe Abstract Long-term climate projections require running global Earth system models on timescales of hundreds of years and have relatively coarse resolution (from 40 to 160 km in the horizontal) due to their high computational costs. Unresolved subgrid-scale processes, such as clouds, are described in a semi-empirical manner by so called parameterizations, which are a major source of uncertainty in climate projections. Machine learning models trained on short high-resolution climate simulations are promising candidates to replace conventional parameterizations. In this work, we take a step further and explore the potential of quantum machine learning, and in particular quantum neural networks (QNNs), to develop cloud cover parameterizations. QNNs differ from their classical counterparts, and their potentially high expressivity turns them into promising tools for accurate data-driven schemes to be used in climate models. Here we perform an extensive comparative analysis between several QNNs and classical neural networks (NNs), by training both ansatzes on data coming from high-resolution simulations with the ICOsahedral Non-hydrostatic weather and climate model (ICON). Our results show that the overall performance of the investigated QNNs is comparable to that of classical NNs of similar size, i.e., with the same number of trainable parameters, with both ansatzes outperforming standard parameterizations used in climate models. Our study also includes an analysis of the generalization ability of the models as well as the geometrical properties of their optimization landscape. We furthermore investigate the effects of finite sampling noise, and show that the training and the predictions of the QNNs are stable even in this noisy setting. These results demonstrate the applicability of quantum machine learning models to learn meaningful patterns in climate data, and are thus relevant for a broad range of problems within the climate modeling community. keywords Quantum machine learning, Quantum neural networks, Climate modeling, Parameterizations, Cloud cover 1 Introduction One of the requirements for improving mitigation and adaption strategies against climate change is the ability to perform reliable long-term climate projections using climate models. Climate models are numerical models that simulate the evolution of the various components of the Earth system ( Jacobson 2005 ; Gettelman and Rood 2016 ) . In a climate model, the equations governing the dynamics of the atmosphere are discretized on a grid with horizontal extension on the order of tens of kilometers, to enable ensembles of climate projections over several decades. Due to this relatively coarse horizontal resolution, current climate models are still affected by systematic biases compared to observations, despite continuous improvements ( Sherwood et al. 2014 ; Bock et al. 2020 ) . At these horizontal resolutions, important physical processes such as clouds, convection or turbulence cannot be resolved, and their effect must be re-introduced in the climate model in an approximate manner by so-called parameterizations ( Stensrud 2007 ; McFarlane 2011 ; Christensen and Zanna 2022 ) . The structural and parametric uncertainties in conventional parameterization schemes are a source of the aforementioned remaining biases ( Randall et al. 2003 ; Sherwood et al. 2014 ; Schneider et al. 2017 ; Eyring et al. 2021 ) . Machine learning (ML) models are promising candidates to replace conventional parameterizations ( Gentine et al. 2021 ; Eyring et al. 2021 ; Eyring et al. 2024 ; Eyring et al. 2024 ) . Several uses of ML for parameterizations have been proposed in the literature, with prominent applications to radiation ( Chevallier et al. 1998 ; Krasnopolsky et al. 2005 ; Lagerquist et al. 2021 ; Hafner et al. 2024 ) , convection ( Krasnopolsky et al. 2013 ; Rasp et al. 2018 ; Gentine et al. 2018 ; Brenowitz and Bretherton 2019 ; Yuval and O’Gorman 2020 ; Heuer et al. 2024 ) and cloud cover ( Grundner et al. 2022 ; Grundner et al. 2024 ) . One of the strategies in employing ML is to develop data-driven schemes trained on coarse-grained data coming from high-resolution climate simulations, where convection and clouds are more explicitly resolved. While enabling numerous improvements, the use of ML also introduces several requirements, such as the need of complex yet trainable models to encompass various physical scenarios, the need of large amounts of training data, and the ability to generalize to unseen climate regimes ( Eyring et al. 2024 ) . In this work, we explore the potential of quantum machine learning (QML) ( Perdomo-Ortiz et al. 2018 ; Benedetti et al. 2019 ; Cerezo et al. 2022 ) , and in particular quantum neural networks (QNNs) ( Farhi and Neven 2018 ) , to develop parameterizations for climate models, specifically focusing on the case of cloud cover. QNNs constitute a different type of ansatz compared to classical neural networks (NNs), and several theoretical works have highlighted their good generalization capability ( Caro et al. 2021 ; Banchi et al. 2021 ; Caro et al. 2022 ; Haug and Kim 2024 ) , their higher expressivity for certain tasks ( Du et al. 2020 ; Yu et al. 2023 ) , as well as provided hints to their well-behaved optimization landscape which may result in a good trainability in certain regimes ( Abbas et al. 2021 ) . Motivated by these insights, we perform a thorough comparative analysis between several QNNs and classical NNs models, to understand whether this type of QML models can help addressing the aforementioned challenges. The field of QML expands in several directions, including supervised learning for regression and classification ( Farhi and Neven 2018 ) , generative modeling ( Amin et al. 2018 ; Dallaire-Demers and Killoran 2018 ; Coyle et al. 2020 ; Gao et al. 2022 ) and kernel methods ( Havlíček et al. 2019 ; Schuld and Killoran 2019 ) . The number of QML applications to classical problems and datasets is rapidly growing (see Chen et al. 2022 ; Hur et al. 2022 ; Shen et al. 2024 ; Belis et al. 2024 ; Corli et al. 2024 ; Duneau et al. 2024 ; Aizpurua et al. 2024 ; Sünkel et al. 2023 ; Sakhnenko et al. 2024 ; Slabbert et al. 2024 , to name a few), thus potentially increasing its scope beyond purely quantum-related problems. Not surprisingly, there is also growing interest in the application of quantum computing and QML in the context of weather and climate science ( Tennie and Palmer 2023 ; Lachure et al. 2023 ; Nivelkar et al. 2023 ; Otgonbaatar and Kranzlmüller 2023 ; Nammouchi et al. 2023 ; Rahman et al. 2024 ; Jaderberg et al. 2024 ; Matsuta and Furue 2024 ; Ho et al. 2024 ; Bazgir and Zhang 2024 ; Schwabe et al. 2024 ) . The application of QML to classical data is still in its infancy, also due to the noise and limited size of current noisy intermediate-scale quantum (NISQ) devices. The tests reported in the literature provide an empirical standpoint of the field, and it is still unclear how much quantum advantage can be distilled from QML in the long run ( Kölle et al. 2024 ; Cerezo et al. 2024 ; Bowles et al. 2024 ; Gil-Fuster et al. 2024 ; Bermejo et al. 2024 ) . Nevertheless, it is worth to investigate whether QML models lend themselves to learning patterns in climate-specific data, and whether they can do so better than classical architectures, for potentially bringing quantum or quantum-inspired enhancements into climate projections. Here, we conduct such an investigation in the context of climate model parameterizations. Specifically, we perform numerical simulations training and evaluating both QNN and classical NN ansatzes on coarse-grained data coming from high-resolution simulations with the ICOsahedral Non-hydrostatic weather and climate model (ICON) ( Giorgetta et al. 2018 ) , which were part of the DYnamics of the Atmospheric general circulation Modeled On Non‐hydrostatic Domains (DYAMOND) project ( Stevens et al. 2019 ; Duras et al. 2021 ) . Both ansatzes are constructed to take as input the state variables in the climate model’s cell, such as humidity, temperature and pressure, and to output the cloud cover, i.e., the fraction of the cell that is occupied by clouds. The models developed here are trained and evaluated offline, i.e., without coupling them with the dynamical core of the climate model. These quantum and classical models are compared on several aspects. First, we focus on the prediction accuracy of the two types of ansatzes, and show that both achieve comparable accuracy when the number of trainable parameters is kept the same, while outperforming the conventional cloud cover scheme used in ICON. We then compare the generalization capabilities of the two ansatzes, in terms of the number of training data required to achieve a certain prediction accuracy, and the trainability, i.e., the number of training epochs required for the network (classical or quantum) to reach its optimal configuration. The average prediction performance of quantum and classical models is comparable also w.r.t. these two aspects, despite quantum models having better behaved geometrical properties captured by the Fisher information matrix. Finally, in view of a practical implementation on quantum devices, we investigate the effects of finite sampling noise on the training and the predictions of QNNs. We show that our QNNs can train stably even in presence of shot noise, and that the costs of training and inference in terms of number of measurement shots can be further minimized using recently introduced variance regularization techniques ( Kreplin and Roth 2024 ) . Our study thus highlights an important and timely use case of QML while also discussing its potential limitations. The paper is organized as follows. In Section 2 we describe the training data used. In Section 3 we describe our design choices for the QNNs used, and provide details on our data encoding strategy as well as on the training of these models. In Section 4 we present our results in the noiseless regime, focusing on the aspects of prediction accuracy, generalization and trainability, and including the comparisons with classical NNs. In Section 5 we present the analysis of our QNNs in presence of finite sampling noise. We finally conclude in Section 6 . 2 The training data Figure 1: Schematics of our approach for developing a QNN-based parameterization. We coarse-grain high-resolution data to the target resolution, and construct a training dataset with coarse-grained state variables \boldsymbol{x} as inputs and the corresponding coarse-grained cloud cover \mathrm{clc}(\boldsymbol{x}) as output. The dataset is used to train a QNN, i.e., to optimize the parameters \boldsymbol{\theta} so that the QNN output f_{\boldsymbol{\theta}}(\boldsymbol{x}) approximates \mathrm{clc}(\boldsymbol{x}) . The training data used in this work is obtained from global high-resolution ICON simulations, from the DYAMOND project ( Stevens et al. 2019 ; Duras et al. 2021 ; Stephan et al. 2022 ) . These simulations offer an improved representation of clouds and convection compared to simulations at climate model resolutions ( Stevens et al. 2020 ) . They consist of 40 simulated days starting on the 1st August 2016, and 40 simulated days starting on the 20th January 2020, with a resolution of approximately 2.5 km in the horizontal. In both cases, the first 10 days have been discarded as spin-up time of the simulation, to have training and testing datasets more closely representing physically realistic conditions. Following Giorgetta et al. 2022 we define a high-resolution grid cell to be cloudy (cloud cover =1 ) whenever a meaningful cloud condensate (cloud water or cloud ice) amount is detected (i.e., when specific cloud condensate content exceeds 10^{-6} kg/kg) and to otherwise be cloud-free (cloud cover =0 ). Such a binary setting of cloud cover is much more sensible at the high horizontal and vertical resolution of the storm-resolving model simulations than at coarse climate model resolutions. The data is then coarse-grained to a horizontal resolution of approximately 80 km (corresponding to an R2B5 ICON grid), and vertically from 58 to 27 model levels below an altitude of 21 km, following Grundner et al. 2022 ; Grundner et al. 2024 . After coarse-graining, cloud cover in a given cell can take any value between 0 and 1, representing the fraction of the cell that is occupied by clouds. Given that cloud cover cannot exist in the absence of cloud condensate, we remove from the dataset all the cells where the total amount of cloud condensate is zero. This results in a dataset which is more balanced, i.e., where the cloud-free samples are less over-represented. 3 Quantum neural networks as parameterization models Figure 2: Schematics of our QNN architecture. The data \boldsymbol{x} is uploaded n_{\mathrm{enc}} times as angles of single-qubit rotations (blue boxes). In our implementation, each input feature is uploaded to the same qubit each time. These re-uploading gates are interleaved with variational blocks \hat{V}(\boldsymbol{\vartheta}^{(k)}) containing entangling gates and trainable parameters \boldsymbol{\vartheta}^{(k)} ( k=1,\dots,n_{\mathrm{enc}} ). Afterwards, a sequence of n_{\mathrm{var}} variational blocks \hat{W}(\boldsymbol{\varphi}^{(\ell)}) ( \ell=1,\dots,n_{\mathrm{var}} ) are applied. In the end, the expectation values of \hat{\sigma}^{z} on all qubits are measured, and a weighted average of those is performed, with trainable weights \boldsymbol{w} and a bias term b . The result f_{\boldsymbol{\theta}}(\boldsymbol{x}) should approximate \mathrm{clc}(\boldsymbol{x}) after training the parameters \boldsymbol{\theta}=\{\{\boldsymbol{\vartheta}^{(k)}\}_{k},\{\boldsymbol{\varphi}^{(\ell)}\}_{\ell},\boldsymbol{w},b\} . The approach we use to construct our QNN-based parameterization for cloud cover is summarized in Fig. 1 . The data resulting from the coarse-graining procedure described above constitute the training dataset \mathcal{D}=\{\boldsymbol{x}_{i},y_{i}\}_{i} , where \boldsymbol{x}_{i}\in\mathbb{R}^{N} denotes the selected coarse-grained state variables used as inputs and y_{i}\in\mathbb{R} the output corresponding to the coarse-grained cloud cover \mathrm{clc}(\boldsymbol{x}_{i}) , for the i -th model cell (at a specific spatial location and point in time). These data are used for training our QNNs, which are based on a parameterized quantum circuit realizing the unitary operator \hat{U}_{\boldsymbol{\theta}}(\boldsymbol{x}) , depending on the inputs \boldsymbol{x} and on the union of all sets of trainable parameters \boldsymbol{\theta}\in\mathbb{R}^{D} . During optimization, all parameters in \boldsymbol{\theta} are adjusted so that the distance between the QNN output f_{\boldsymbol{\theta}}(\boldsymbol{x}) and \mathrm{clc}(\boldsymbol{x}) for all \boldsymbol{x}\in\{\boldsymbol{x}_{i}\}_{i} is minimized. In the following, we discuss the details of our implementations of \hat{U}_{\boldsymbol{\theta}}(\boldsymbol{x}) and how the QNN output f_{\boldsymbol{\theta}}(\boldsymbol{x}) is constructed. 3.1 Architecture choice A schematic visualization of the parameterized quantum circuit (PQC) forming the backbone of our QNNs is shown in Fig. 2 . The qubit register is initialized in the |0\rangle state. To encode the input features (i.e., the components of the vector \boldsymbol{x} ), we adopt the data re-uploading technique ( Pérez-Salinas et al. 2020 ; Schuld et al. 2021 ) , to increase the number of Fourier frequencies that our model can capture ( Schuld et al. 2021 ; Casas and Cervera-Lierta 2023 ) . Specifically, we encode the input features multiple times as angles of single-qubit rotations, which results in the encoding layer \hat{S}(\boldsymbol{x})=\prod_{n=1}^{N}\mathrm{e}^{-\mathrm{i}\frac{x_{n}}{2}\hat{\sigma}^{\alpha}_{n}}\equiv\hat{R}_{\alpha}(\boldsymbol{x})\,\,, (1) where x_{n} is the n -th component of \boldsymbol{x} and \alpha=x,y,z denotes the rotation axis, depending on the specific ansatz. In this construction, the number of qubits is therefore equal to the number of input features N . Subsequent applications of \hat{S}(\boldsymbol{x}) are interleaved with variational blocks \hat{V}(\boldsymbol{\vartheta}^{(k)}) (with k=1,...,n_{\mathrm{enc}} ), which depend on trainable parameters \boldsymbol{\vartheta}^{(k)} and also contain entangling operations. The specific form of these blocks is specified later on in this section. After this stage, amounting to n_{\mathrm{enc}} data re-uploads, additional n_{\mathrm{var}} variational blocks \hat{W}(\boldsymbol{\varphi}^{(\ell)}) (with \ell=1,...,n_{\mathrm{var}} ) are applied to increase the number of trainable parameters. These blocks depend on trainable parameters \boldsymbol{\varphi}^{(\ell)} and also contain entangling operations. The resulting unitary operator describing the PQC reads as \hat{U}_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}(\boldsymbol{x})=\prod_{\ell=1}^{n_{\mathrm{var}}}\hat{W}(\boldsymbol{\varphi}^{(\ell)})\prod_{k=1}^{n_{\mathrm{enc}}}\Big(\hat{V}(\boldsymbol{\vartheta}^{(k)})\hat{S}(\boldsymbol{x})\Big)\,\,, (2) where the subscripts \boldsymbol{\vartheta},\boldsymbol{\varphi} denote the dependences on the sets \boldsymbol{\vartheta}=\{\boldsymbol{\vartheta}^{(k)}\}_{k} and \boldsymbol{\varphi}=\{\boldsymbol{\varphi}^{(\ell)}\}_{\ell} . After the PQC computation, the expectation values \langle\hat{\sigma}_{n}^{z}\rangle_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}(\boldsymbol{x})=\langle 0|\hat{U}^{\dagger}_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}(\boldsymbol{x})\,\hat{\sigma}_{n}^{z}\,\hat{U}_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}(\boldsymbol{x})|0\rangle are measured on the output state, and their weighted average with trainable weights \boldsymbol{w} is computed, finally yielding the QNN prediction as f_{\boldsymbol{\theta}}(\boldsymbol{x})=b+\sum_{n=1}^{N}w_{n}\,\langle\hat{\sigma}_{n}^{z}\rangle_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}(\boldsymbol{x})\,\,, (3) with w_{n} being the n -th component of \boldsymbol{w} , b an additional trainable parameter (bias), and \boldsymbol{\theta} summarizing all the parameters \boldsymbol{\vartheta} , \boldsymbol{\varphi} , \boldsymbol{w} , and b . In this work, we focus on two ansatzes for the encoding and variational blocks in \hat{U}_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}(\boldsymbol{x}) . We label the resulting QNN architectures with XYZ and ZZXY. In both architectures, the encoding layer is implemented as \hat{S}(\boldsymbol{x})=\hat{R}_{x}(\boldsymbol{x}) . For the XYZ circuit ansatz, the encoding blocks take the following form \begin{split}\hat{V}_{\mathrm{XYZ}}(\boldsymbol{\vartheta})=\,&\hat{R}_{yy}(\boldsymbol{\vartheta}_{(2N-1)\to(3N-3)})\,\hat{R}_{xx}(\boldsymbol{\vartheta}_{N\to(2N-2)})\times\\ &\hat{R}_{zz}(\boldsymbol{\vartheta}_{1\to(N-1)})\,\,,\end{split} where \hat{R}_{\alpha\alpha}(\boldsymbol{\vartheta})=\prod_{n=1}^{N-1}\mathrm{e}^{-\mathrm{i}\frac{\vartheta_{n}}{2}\hat{\sigma}^{\alpha}_{n}\hat{\sigma}^{\alpha}_{n+1}} , with \alpha=x,y,z , and \boldsymbol{\vartheta}_{i\to j} denoting the slice of \boldsymbol{\vartheta} from the i -th to j -th component. The variational blocks for XYZ read as \begin{split}\hat{W}_{\mathrm{XYZ}}(\boldsymbol{\varphi})=\,&\hat{R}_{x}(\boldsymbol{\varphi}_{(3N-2)\to(4N-3)})\times\\ &\hat{R}_{yy}(\boldsymbol{\varphi}_{(2N-1)\to(3N-3)})\times\\ &\hat{R}_{xx}(\boldsymbol{\varphi}_{N\to(2N-2)})\,\hat{R}_{zz}(\boldsymbol{\varphi}_{1\to(N-1)})\,\,.\end{split} For the ZZXY ansatz the encoding and variational blocks take the following form \hat{V}_{\mathrm{ZZXY}}(\boldsymbol{\vartheta})=\hat{R}_{y}(\boldsymbol{\vartheta}_{N\to(2N-1)})\,\hat{R}_{zz}(\boldsymbol{\vartheta}_{1\to(N-1)})\,\,, and \begin{split}\hat{W}_{\mathrm{ZZXY}}(\boldsymbol{\varphi})=\,&\hat{R}_{y}(\boldsymbol{\varphi}_{2N\to(3N-1)})\,\hat{R}_{zz}(\boldsymbol{\varphi}_{(N+1)\to(2N-1)})\times\\ &\hat{R}_{x}(\boldsymbol{\varphi}_{1\to N})\,\,.\end{split} We refer the reader to Appendix 7 for a comparison with other investigated types of QNNs. In this work, the investigated QNNs are numerically simulated in Python using the Pennylane library ( Bergholm et al. 2022 ) and optimized with JAX ( jax accessed 2024 ) . 3.2 Input features and pre-processing The components of the input vector \boldsymbol{x} are the coarse-grained state variables chosen as predictors for the cloud cover in the corresponding model cell. These are chosen among the following state variables • q_{\mathrm{v}} [kg/kg]: specific humidity, • q_{\mathrm{c}} [kg/kg]: specific cloud water content, • q_{\mathrm{i}} [kg/kg]: specific cloud ice content, • T [K]: air temperature, • p [Pa]: pressure, • h_{\mathrm{w}}=\sqrt{u^{2}+v^{2}} [m/s]: magnitude of horizontal wind component (with u and v being the zonal and meridional components, respectively), • z_{\mathrm{g}} [m]: geometric height at full level, • \phi [rad]: latitude. The selection of these variables is based on previous works on ML-based cloud cover parameterizations ( Grundner et al. 2022 ; Grundner et al. 2024 ) . Given the different magnitudes and distributions of these input features, it is necessary to suitably transform and re-scale them so that they can be encoded as angles in our PQCs. For the features T , p and z_{\mathrm{g}} we found it sufficient to perform a min-max (linear) re-scaling within the interval [0,\pi] . For the features q_{\mathrm{v}} , q_{\mathrm{c}} , q_{\mathrm{i}} and h_{\mathrm{w}} the situation is slightly more complex, since their distribution is sharply peaked at 0 and contains long decaying tails, in particular for q_{\mathrm{c}} , q_{\mathrm{i}} . For these features we perform a non-linear transformation specifically constructed to (i) make the input feature distribution more uniform, so as to better distinguish from each other the values close to 0 , and (ii) retain the input feature variability in the tails, which can be associated with physical scenarios we are interested in capturing. In Appendix 8 we provide the details on the transformations we constructed keeping these objectives in mind. The transformed features q_{\mathrm{v}} , q_{\mathrm{c}} , q_{\mathrm{i}} and h_{\mathrm{w}} are also approximately distributed in the interval [0,\pi] , so that they can be used as angles in the PQCs. To enable a proper comparison between quantum and classical NNs, the same input transformations are used in both cases. As an additional pre-processing step further enhancing the performance of our networks, it is beneficial to learn a transformed version of cloud cover, i.e., to set the outputs y_{i} in the training set to y_{i}=g(\mathrm{clc}(\boldsymbol{x}_{i})) , with g denoting a suitable transformation function. The transformation function g is constructed to have the training outputs y_{i} approximately uniformly distributed in the interval [0,1] . An explicit expression of this transformation is given in Appendix 8 . 3.3 Training QNNs In an actual implementation of QNNs on quantum devices, the training of the parameters \boldsymbol{\theta} is achieved via a quantum-classical feedback loop ( McClean et al. 2016 ; Cerezo et al. 2021 ) . At each iteration of this loop the QNN is run on the quantum device for given parameters \boldsymbol{\theta} and the cost function is computed, and its value is used to propose new parameters to be used in the QNN at the next iteration. In our case, the computations of the QNN which would take place on a quantum device are simulated numerically. The cost function we minimize for training is the mean squared error (MSE) over the training dataset \mathcal{D} of size N_{\mathrm{train}}=|\mathcal{D}| , computed as \mathrm{MSE}_{\mathcal{D}}(\boldsymbol{\theta})=\frac{1}{N_{\mathrm{train}}}\sum_{i=1}^{N_{\mathrm{train}}}\Big(f_{\boldsymbol{\theta}}(\boldsymbol{x}_{i})-y_{i})\Big)^{2}\,\,, (4) with y_{i}=g(\mathrm{clc}(\boldsymbol{x}_{i})) . The parameters \boldsymbol{\theta} are updated using gradient descent methods. Specifically, we use the Adam optimizer ( Kingma and Ba 2017 ) . This requires the ability of calculating the gradients of the cost function with respect to the parameters efficiently, which for QNNs can be done using the parameter-shift rule ( Mitarai et al. 2018 ; Schuld et al. 2019 ) . In our case all the gate generators are (one half times) Pauli operators multiplied by the variational parameters, and we can use the following form for the parameter-shift rule \frac{\partial\langle\hat{O}\rangle_{\boldsymbol{\vartheta}}}{\partial\phi_{j}}=\frac{1}{2}\Big(\langle\hat{O}\rangle_{\boldsymbol{\vartheta}+\frac{\pi}{2}\boldsymbol{e}_{j}}-\langle\hat{O}\rangle_{\boldsymbol{\vartheta}-\frac{\pi}{2}\boldsymbol{e}_{j}}\Big)\,\,, (5) with \langle\hat{O}\rangle_{\boldsymbol{\vartheta}}=\langle 0|\hat{U}^{\dagger}_{\boldsymbol{\vartheta}}\,\hat{O}\,\hat{U}_{\boldsymbol{\vartheta}}|0\rangle , where \hat{O} is a generic observable and \hat{U}_{\boldsymbol{\vartheta}} is the unitary corresponding to the PQC with parameters \boldsymbol{\vartheta} (analogous rules for the derivatives w.r.t. \boldsymbol{\varphi} apply), where we dropped the possible dependence on the inputs \boldsymbol{x} . Applying this formula to our instances of PQCs, we obtain the gradients of the expectation values \langle\hat{\sigma}_{n}^{z}\rangle_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}(\boldsymbol{x}) and use them for computing the derivatives of Eq. ( 4 ). 4 Results in the noiseless regime QNN N n_{\mathrm{enc}} n_{\mathrm{var}} D Input features \mathrm{XXY}^{8}_{5,3} 8 5 3 201 \{q_{\mathrm{v}},q_{\mathrm{c}},q_{\mathrm{i}},T,p,z_{\mathrm{g}},h_{\mathrm{w}},\phi\} \mathrm{ZZXY}^{8}_{2,7} 8 2 7 200 \{q_{\mathrm{v}},q_{\mathrm{c}},q_{\mathrm{i}},T,p,z_{\mathrm{g}},h_{\mathrm{w}},\phi\} \mathrm{XXY}^{6}_{4,2} 6 4 2 109 \{q_{\mathrm{v}},q_{\mathrm{c}},q_{\mathrm{i}},T,p,h_{\mathrm{w}}\} \mathrm{ZZXY}^{6}_{2,5} 6 2 5 114 \{q_{\mathrm{v}},q_{\mathrm{c}},q_{\mathrm{i}},T,p,h_{\mathrm{w}}\} NN Hidden layers D Input features \mathrm{NN}^{8}_{12,6,2} 12\to 6\to 2 203 \{q_{\mathrm{v}},q_{\mathrm{c}},q_{\mathrm{i}},T,p,z_{\mathrm{g}},h_{\mathrm{w}},\phi\} \mathrm{NN}^{6}_{8,3,7} 8\to 3\to 7 119 \{q_{\mathrm{v}},q_{\mathrm{c}},q_{\mathrm{i}},T,p,h_{\mathrm{w}}\} Table 1: Summary of the quantum (upper table) and classical (lower table) architectures used in the main text. For the quantum models, N refers to the number of qubits, corresponding to the number of features, and n_{\mathrm{enc}} and n_{\mathrm{var}} to the number of encoding and variational blocks in the PQC, respectively. For the classical models, the number of nodes in the hidden NN layers is shown (the first ‘visible’ layer is the input layer with N input nodes, and the last layer is the output layer with one node). Both classical NNs use tanh activations. D is the number of trainable parameters. In this section we present the results from our QNNs in the absence of sampling noise, i.e., with the expectation values \langle\hat{\sigma}_{n}^{z}\rangle_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}(\boldsymbol{x}) evaluated to numerical precision. This allows us to more directly assess the learning and representational capabilities of our networks in the context of cloud cover parameterizations, and to make a better comparison with other existing classical schemes. 4.1 Evaluation of QNN predictions and comparison with classical schemes Figure 3: Evaluation of quantum neural networks (QNNs) compared to a classical NN and the Xu-Randall scheme. (a) and (b) show the vertical profiles of the mean cloud cover (i.e., the horizontally averaged cloud cover for each model layer) for the XYZ (blue) and ZZXY (orange) QNNs, respectively. These are compared with the predictions from a classical NN (grey), and from the Xu-Randall scheme (brown). The insets show the corresponding vertically resolved R^{2} coefficients. The shaded areas correspond to the spread (minimum to maximum) over an ensemble of 20 training instances (i.e., training the model on the same data but starting from different random initial parameters). Panels (c), (d), (e) and (f) show global maps of the difference between the predicted and the true vertically averaged cloud cover for a specific simulated day (29 February 2020, 15:00 UTC+00:00), for predictions from the XYZ QNN, ZZXY QNN, the classical NN and the Xu-Randall scheme, respectively. All networks are trained for 200 epochs with N_{\mathrm{train}}=2\times 10^{5} training data. Remark: the \mathrm{MSE} and R^{2} shown here are calculated on the non-transformed output, i.e., after applying the inverse output transform \mathrm{clc}=g^{-1}(f) . We start by presenting the results of our QNNs trained and evaluated on the DYAMOND dataset, comparing them with classical methods such as classical feed-forward NNs and a traditionally used cloud cover parameterization scheme. To enable a fair comparison between the representational capability of QNNs and classical NNs, we restrict the architectures of the latter to a number of trainable parameters (approximately) equal to that of our QNNs. The specific details of the QNN and NN architectures are given in Table 1 (with further details on the classical architectures in Appendix 9 ). For quantum and classical NNs, these design choices are optimized for reaching the best performance for a fixed number of trainable parameters. All compared models are given the same input features and are trained with the same number of training data for the same number of epochs. The influence of the number of training data on the performance of the networks and the analysis of the training dynamics is analyzed in the next sections, while here we focus on the evaluation of the predictions of the trained quantum and classical networks. The quantum and classical network architectures presented in this section use the eight input features \{q_{\mathrm{v}},q_{\mathrm{c}},q_{\mathrm{i}},T,p,z_{\mathrm{g}},h_{\mathrm{w}},\phi\} (corresponding to the \mathrm{XXY}^{8}_{5,3} , \mathrm{ZZXY}^{8}_{2,7} , and \mathrm{NN}^{8}_{12,6,2} models in Table 1 ). All networks are trained for 200 epochs on N_{\mathrm{train}}=2\times 10^{5} training data from the DYAMOND dataset. After training, we evaluate the networks on a testing dataset \mathcal{D}_{\mathrm{test}} , also extracted from the DYAMOND dataset. As for the training set, the testing samples are extracted at random locations in space and time (with care taken in not making them overlap with the training samples). Besides the MSE defined in Eq. ( 4 ), another metric we use to evaluate the performance of our networks is the R^{2} coefficient of determination defined as: R^{2}=1-\frac{\mathrm{MSE}_{\mathcal{D}_{\mathrm{test}}}}{\mathrm{Var}_{\mathcal{D}_{\mathrm{test}}}(\mathrm{clc})}\,\,, (6) where \mathrm{Var}_{\mathcal{D}_{\mathrm{test}}}(\mathrm{clc}) denotes the variance of the true cloud cover value over the testing dataset. Further evaluation metrics for our networks are discussed in Appendix 10 . For a better assessment of the performance of our XYZ and ZZXY QNNs, we also compare their predictions to a simplified version of the parameterization scheme developed by Xu and Randall ( Xu and Randall 1996 ; Wang et al. 2023 ) , which is a semi-empirical scheme and defined by: \mathrm{clc}_{\mathrm{XR}}=\mathrm{min}\big\{1,\,\mathrm{RH}(q_{\mathrm{v}},p,T)^{\beta}(1-\mathrm{e}^{-\alpha(q_{\mathrm{c}}+q_{\mathrm{i}})})\big\}\,\,, (7) where \alpha=4.034\times 10^{4} and \beta=0.9942 are parameters whose values we optimized (via standard MSE minimization) to reach the best performance over our training dataset. In the above equation, \mathrm{RH} denotes the relative humidity which is calculated as: \mathrm{RH}(q_{\mathrm{v}},p,T)=\frac{p_{\mathrm{v}}(q_{\mathrm{v}},p)}{p_{\mathrm{s}}(T)}=\frac{p}{p_{\mathrm{s}}(T)}\,\frac{q_{\mathrm{v}}}{0.622+0.378\,q_{\mathrm{v}}}\,, (8) where p_{\mathrm{v}}(q_{\mathrm{v}},p) is the water vapor pressure and p_{\mathrm{s}}(T) is the saturation vapor pressure (calculated according to Murray 1967 ). The QNN and NN predictions and their comparison with the Xu-Randall scheme are shown in Fig. 3 . Looking at the vertical mean cloud cover profiles, we see that the quantum and classical NNs accurately predict the true profile (denoted by the dashed black line), while the Xu-Randall scheme exhibits visible biases throughout the whole vertical extent up to approximately 17 km, where the amount of condensate is so low that no cloud cover is diagnosed. Furthermore, quantum and classical networks are comparable also in terms of the prediction spread over the 20 training instances performed (where each instance corresponds to a training run starting from a randomly initialized parameter set). To better address the differences between the accuracy of QNNs and of classical NNs, we consider the vertically resolved R^{2} coefficient in the insets. There we can see that, while both types of ansatz achieve a good prediction performance, the classical NN has a slightly better performance with a higher R^{2} value of approximately 0.01 throughout the whole vertical extent. The drop in R^{2} value for all architectures for altitudes above 15 km is due to the fact that at such high altitudes there is very low probability of observing clouds, meaning that the variance of cloud cover over the testing set at those altitudes is close to zero. Similar conclusions can be drawn the the global bias maps shown in panels (c), (d), (e) and (f) of Fig. 3 . As before, we see that the Xu-Randall scheme has the strongest prediction biases, whereas XYZ, ZZXY and NNs all achieve similar performances. In particular, we observe that all these networks show similar spatial distributions of the biases, with NNs achieving slightly lower MSE compared to the quantum architectures. We do not have a conclusive explanation for the slightly better performance of classical NNs over our QNNs for our task. However, we find it plausible that the NNs used here as comparison (which are the best performing ones on our task — see Appendix 9 for details on them) may be slightly better suited for our task, in terms of the functional properties they can access (i.e., a moderate inductive bias). In future work, one could attempt to change the type of data encoding in the QNNs, e.g., along the lines of Williams et al. 2023 , to potentially yield better performance. Overall, our QNNs show very similar performance to the classical networks with both achieving a high prediction accuracy and moderate cloud cover biases, thus demonstrating that QML can yield suitable models to predict patterns in climate data. In the next sections, we compare our QNNs with classical NNs on further aspects beyond the standard performance metrics. 4.2 Generalization in quantum and classical NNs Figure 4: Scaling of network performance with size of the training set N_{\mathrm{train}} . The grey points correspond to the tested classical NNs (the six architectures with six input features discussed in Appendix 9 ), with one point corresponding to a specific training instance for the given N_{\mathrm{train}} , starting from randomly initialized parameters. The blue and the orange data correspond to the XYZ and the ZZXY QNNs, respectively. We plot 10 training instances per N_{\mathrm{train}} value and architecture. For the QNNs, the dots indicate the mean over the training instances for a given N_{\mathrm{train}} , while the shading denotes the spread (minimum to maximum). The main panel shows the R^{2} score, the inset the \mathrm{MSE} , both calculated over a test set of size 10^{5} . Remark: the \mathrm{MSE} and R^{2} shown here are calculated on the non-transformed output, i.e., after applying the inverse output transform \mathrm{clc}=g^{-1}(f) . In this section, we address the in-distribution generalization ability of our QNNs and compare it to that of classical NNs. To this end, for both types of networks, we compute the scaling of the performance metrics ( R^{2} and \mathrm{MSE} ) with the size N_{\mathrm{train}} of the training dataset, where the metrics are computed on a testing dataset \mathcal{D}_{\mathrm{test}} of size 2\times 10^{5} following the same distribution as the training set. Here, we use slightly smaller networks compared to the previous section, to reduce the training runtime of the QNNs for gathering sufficient statistics for our training instances. Specifically, we use the architectures reported in Table 1 with six input features. In the comparison, both R^{2} and the \mathrm{MSE} (Fig. 4 ) show a scaling with N_{\mathrm{train}} that is very similar for the classical and quantum networks. The degradation of the prediction performance happens approximately at the same value of N_{\mathrm{train}} , and furthermore no significant difference between our XYZ and ZZXY models can be seen. The \mathrm{MSE} loss on the testing dataset follows approximately a 1/\sqrt{N_{\mathrm{train}}} scaling for N_{\mathrm{train}}\geq D until saturation due to model deficiency starts to occur, which is consistent with the scaling laws reported in the works on generalization in QML ( Banchi et al. 2021 ; Caro et al. 2022 ) . Classical and quantum NNs follow approximately the same scaling with the same pre-factors, and, consistently with the observations in the previous section, we see that for large values of N_{\mathrm{train}} the classical NNs achieve a slightly better prediction performance. 4.3 Trainability from the perspective of information geometry Figure 5: (a) Spectra of normalized FIM for classical NN (grey), and the XYZ (blue) and ZZXY (orange) QNNs. The dots correspond to the mean value over the 200 random parameter initializations, while the shading denotes the spread (minimum to maximum). To estimate the FIM we use 9\times 10^{6} input data. The normalized effective dimension \hat{d}_{\mathrm{eff}} is also reported in the legend. (b) Training curves for 200 training instances for classical NN (grey), XYZ (blue) and ZZXY (orange) QNNs. Here, N_{\mathrm{train}}=10^{5} . In this section, we analyze the training dynamics of our QNNs and NNs, and try to establish a connection with the geometrical properties of their optimization landscape, along the lines of Abbas et al. 2021 . The authors of Abbas et al. 2021 use tools from information geometry, in particular the Fisher information matrix (FIM), setting them in relation with the trainability of a model, and introduce a quantity called “effective dimension”, which they use to prove generalization bounds. They conduct numerical experiments comparing classical and quantum NNs, and empirically show that QNNs have a better behaved (i.e., more evenly spread) FIM spectrum and a higher effective dimension, which in their experiments results in a faster and more stable training compared to classical networks. Motivated by these empirical observations, here we conduct a similar experiment. Specifically, for each quantum and classical network tested, we draw an ensemble of random parameters configurations (here consisting of 200 samples), and use it for constructing an ensemble of training instances on the one hand, and to calculate the FIM and the models effective dimension on the other hand. Before presenting the results, we briefly recap the definition and meaning of the FIM and effective dimension. The FIM describes the geometrical properties of the parameter space of a parameterized model ( ichi Amari 1985 ) . It is a central tool in the field of information geometry, as it defines a metric in the model space, i.e., the space of functions a parameterized model can represent ( ichi Amari 1985 ; ichi Amari 1997 ; Pascanu and Bengio 2014 ) . While the FIM is typically defined for probabilistic models, its definition can be extended to the regression models studied here (see Pennington and Worah 2018 ; Karakida et al. 2020 and Appendix 11 for details). In this case, the elements of the FIM are computed as follows \begin{split}F_{j,k}(\boldsymbol{\theta})&=\mathbb{E}_{\boldsymbol{x}}\bigg[\frac{\partial f_{\boldsymbol{\theta}}(\boldsymbol{x})}{\partial\theta_{j}}\frac{\partial f_{\boldsymbol{\theta}}(\boldsymbol{x})}{\partial\theta_{k}}\bigg]\\ &\approx\frac{1}{|\mathcal{D}|}\sum_{\boldsymbol{x}\in\mathcal{D}}\frac{\partial f_{\boldsymbol{\theta}}(\boldsymbol{x})}{\partial\theta_{j}}\frac{\partial f_{\boldsymbol{\theta}}(\boldsymbol{x})}{\partial\theta_{k}}\,\,,\end{split} (9) with \mathbb{E}_{\boldsymbol{x}} denoting the expected value over the input distribution, which is empirically approximated by averaging over the (training) dataset \mathcal{D} . The FIM F is a D\times D positive semi-definite matrix. Giving rise to a metric in model space, the FIM encodes information on which directions in the parameter space lead to appreciable changes in the outputs of the model, and which directions are instead less influential or redundant. This information is reflected in the spectrum of the FIM: an evenly spread and non-zero spectrum indicates that all parameters are almost equally contributing to independent model changes, whereas the presence of small or zero eigenvalues means that the corresponding parameters (or linear combinations thereof) are irrelevant. Based on this observation, the FIM spectrum becomes a useful indication of the capacity of a model to effectively explore its parameter space, ‘making use’ of all its degrees of freedom. This capacity, according to Abbas et al. 2021 , may also be beneficial during training. The (normalized) effective dimension introduced in Abbas et al. 2021 is constructed to capture this capacity, and is defined as \hat{d}_{\mathrm{eff}}=\frac{2\,\mathrm{log}\bigg(\frac{1}{V_{\mathrm{\Theta}}}\int_{\mathrm{\Theta}}\sqrt{\mathrm{det}\Big(I_{D}+c_{N_{\mathrm{data}}}\hat{F}(\boldsymbol{\theta})\Big)}\mathrm{d}\boldsymbol{\theta}\bigg)}{D\,\mathrm{log}\,c_{N_{\mathrm{data}}}}\,\,, (10) where c_{N_{\mathrm{data}}}=\frac{N_{\mathrm{data}}}{2\pi\,\mathrm{log}\,N_{\mathrm{data}}} with N_{\mathrm{data}}\equiv|\mathcal{D}| being the number of input data samples, D the number of parameters, and \hat{F}(\boldsymbol{\theta}) , the normalized FIM, defined as \hat{F}(\boldsymbol{\theta})=\frac{D}{\frac{1}{V_{\mathrm{\Theta}}}\int_{\mathrm{\Theta}}\mathrm{tr}\big(F(\boldsymbol{\theta})\big)\mathrm{d}\boldsymbol{\theta}}\,F(\boldsymbol{\theta})\,\,, (11) with \frac{1}{V_{\mathrm{\Theta}}}\int_{\mathrm{\Theta}}\mathrm{tr}\big(F(\boldsymbol{\theta})\big)\mathrm{d}\boldsymbol{\theta}\approx\frac{1}{M}\sum_{m=1}^{M}\mathrm{tr}\big(F(\boldsymbol{\theta}_{m})\big) . The \hat{d}_{\mathrm{eff}} is normalized to the dimensionality of the parameter space D , hence being bounded in [0,1] . Furthermore, it is computed from averages over the parameter space, hence depending solely on the architecture choices and the input distribution. Equipped with these definitions, we can now present the results of our experiments. From the spectra of the normalized FIM shown in Fig. 5 (a) we can make two observations. First, on average the QNNs have larger FIM eigenvalues and a flatter spectrum, and second, the spread over the 200 parameter samples is larger for NNs compared to the QNNs. These observations are consistent with those of Abbas et al. 2021 , and are reflected in the higher value of \hat{d}_{\mathrm{eff}} for the QNNs, as reported in the legend. We now move on to investigate whether these different geometrical properties result in practical differences in the training dynamics of our networks. This is shown in panel (b) of Fig. 5 . Here, we observe that both quantum and classical architectures train to approximately the same value of the loss function, with the classical NN achieving slightly lower loss. The behavior of the training loss, in particular the speed at which the training has approximately converged, is very similar when comparing classical and quantum networks, unlike the observations in Abbas et al. 2021 . Therefore, for our test case we cannot pinpoint a strong relationship between the geometrical properties described before and the effectiveness of training (similar observations have been also raised in a recent work Mingard et al. 2024 ). We refer the reader to Appendix 11 for a further analysis of the relation between training dynamics and FIM, which also includes tests on other NNs and QNNs. We conclude this section by mentioning that the trainability aspects investigated here concern only the training dynamics of QNNs for a fixed number of qubits, and that we are not addressing the problem of barren plateaus in this work, expected to occur for general QNN architectures with large numbers of qubits ( McClean et al. 2018 ; Thanasilp et al. 2023 ; Larocca et al. 2024 ) . 5 Influence of shot noise In a real quantum device, the expectation values \langle\hat{\sigma}_{n}^{z}\rangle_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}(\boldsymbol{x}) used in our QNNs would need to be estimated from a finite number of repeated measurements, also called shots, on the output quantum state. This introduces statistical fluctuations, i.e., shot noise, in the estimates for \langle\hat{\sigma}_{n}^{z}\rangle_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}(\boldsymbol{x}) . In this section we analyze the effects of shot noise on the training and performance of our QNNs, and their dependence on the number n_{\mathrm{shots}} of measurement shots. Furthermore, we present an application of the variance regularization technique introduced in Kreplin and Roth 2024 to our use case, and show that it can help to reduce the effects of shot noise in the training and subsequent inference stage of our QNN models. 5.1 Training and inference with shot noise Figure 6: (a) and (b) Training curves for XYZ (blue) and ZZXY (orange) QNNs, respectively, for different values of n_{\mathrm{shots}} used in the evaluation of predictions and gradients. The different solid lines correspond to different training instances performed starting from the same initial parameter configuration, but with different shot noise realizations. The dashed line corresponds to the noiseless limit, i.e., predictions and gradients evaluated to numerical precision. Here, N_{\mathrm{train}}=10^{5} . (c) Test set performance of XYZ (blue) and ZZXY (orange) QNNs trained in the noiseless regime, against n_{\mathrm{shots}} used at inference, for a test set of size 2\times 10^{5} . Remark: The \mathrm{MSE} and R^{2} shown here are calculated on the non-transformed output, i.e., after applying the inverse output transform \mathrm{clc}=g^{-1}(f) . We now analyze the influence of shot noise on the training dynamics and on the prediction performance of our QNNs. To this end, it is instructive to recall how shot noise influences the predictions of our QNNs. The QNNs’ predictions f_{\boldsymbol{\theta}}(\boldsymbol{x}) are calculated from a weighted average of the expectation values \langle\hat{\sigma}_{n}^{z}\rangle_{\boldsymbol{\vartheta},\boldsymbol{\varphi}} which, in a realistic quantum device, would be estimated from a finite number n_{\mathrm{shots}} of measured bit-strings as \mathrm{Est}_{n_{\mathrm{shots}}}[\langle\hat{\sigma}_{n}^{z}\rangle_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}]=\frac{1}{n_{\mathrm{shots}}}\sum_{s=1}^{n_{\mathrm{shots}}}b_{n}^{(s)}\,\,, with b_{n}^{(s)}\in\{-1,+1\} denoting the n -th ‘bit’ of the s -th measured bit-string. Let us call z_{n}\equiv\mathrm{Est}_{n_{\mathrm{shots}}}[\langle\hat{\sigma}_{n}^{z}\rangle_{\boldsymbol{\vartheta},\boldsymbol{\varphi}}] (we drop here the dependence on \boldsymbol{x} , \boldsymbol{\vartheta} and \boldsymbol{\varphi} for notational convenience). The z_{n} are random variables with covariance given by \mathrm{Cov}[z_{m},z_{n}]=\frac{\langle\hat{\sigma}_{m}^{z}\hat{\sigma}_{n}^{z}\rangle-\langle\hat{\sigma}_{m}^{z}\rangle\langle\hat{\sigma}_{n}^{z}\rangle}{n_{\mathrm{shots}}}\,\,. Using this, we can calculate the variance of the final prediction as \mathrm{Var}[f_{\boldsymbol{\theta}}(\boldsymbol{x})]=\sum_{m,n=1}^{N}w_{m}\,w_{n}\,\mathrm{Cov}[z_{m},z_{n}]\,\,, (12) with w_{n} being the n -th trainable weight in \boldsymbol{w} (see Eq. ( 3 )). Every QNN evaluation for calculating both predictions and gradients (with the parameter-shift rule) is then affected by statistical fluctuations which in general negatively impact the training and prediction performance of the model. We start by analyzing the training dynamics with a finite n_{\mathrm{shots}} for the XYZ and ZZXY networks. The results are shown in panels (a) and (b) of Fig. 6 , where we plot the training \mathrm{MSE} during the training epochs for different n_{\mathrm{shots}} (fixed throughout the training) for both the XYZ and ZZXY architectures, respectively. The different curves with the same color correspond to different training instances obtained by starting from the same initial parameter set, but with different shot noise realizations. For both architectures it is visible that for n_{\mathrm{shots}} sufficiently large (i.e., on the order of 10^{4} ) the training is successful, closely following the noiseless training curve. For smaller values of n_{\mathrm{shots}} , the \mathrm{MSE} is minimized in the initial iterations before the training becomes unstable, which happens when the gradients’ magnitude becomes comparable to the noise in the gradients’ evaluation. These results demonstrate that there is a regime where our QNNs train stably in the presence of shot noise, albeit it being relatively costly in the number of necessary circuit evaluations. We discuss in the next section a method targeted towards minimizing these costs. Second, we analyze the performance of our QNNs on a testing dataset when varying n_{\mathrm{shots}} . Specifically, we use the optimal network parameters configurations for both QNNs obtained after training in the noiseless regime, and test how a finite n_{\mathrm{shots}} (in particular smaller than 10^{4} ) affects their prediction performance. A useful metric we compute to understand the (average) impact of shot noise on the test set is the mean prediction variance (MPV), which is defined on a dataset \mathcal{D} as \mathrm{MPV}_{\mathcal{D}}(\boldsymbol{\theta})=\frac{1}{|\mathcal{D}|}\sum_{\boldsymbol{x}_{i}\in\mathcal{D}}\mathrm{Var}[f_{\boldsymbol{\theta}}(\boldsymbol{x}_{i})]\,\,. (13) The results are shown in panel (c) of Fig. 6 , where we plot the R^{2} and the \mathrm{MSE} for different n_{\mathrm{shots}} for the XYZ and ZZXY architectures. From these results it is clear that the quality of the predictions rapidly degrades for n_{\mathrm{shots}}<10^{4} while it is stable for larger values. The slight difference between the two architectures can be attributed to the difference in the value of the \mathrm{MPV} , which is indicated in the plot. Specifically, the ZZXY architecture has a slightly lower \mathrm{MPV} , which results in a lower number of shots needed to achieve a given accuracy. The \mathrm{MPV} , capturing this difference, becomes therefore a crucial ingredient for the method presented in the next section. 5.2 Variance regularization Figure 7: Variance regularization results. (a) and (b) Post-training mean squared error ( \mathrm{MSE} ) and mean prediction variance ( \mathrm{MPV} ) on testing set for XYZ and ZZXY QNNs, respectively. The color scale refers to the value of \lambda , the training is performed in the noiseless regime, with 2\times 10^{5} training data for 150 epochs, and 2\times 10^{5} testing data points are used. (c) and (d) Noisy training curves using variance regularization with \lambda=0.005 for XYZ (c) and ZZXY (d) QNNs, respectively. The upper row (solid lines) shows the mean squared error ( \mathrm{MSE} ), the middle row (dashed lines) shows the mean prediction variance ( \mathrm{MPV} ). The different color shades correspond to different n_{\mathrm{shots}} used, while the six different curves with the same colors correspond to six different training instances (from the same initial parameters, but different shot noise realizations). The lower row (dash-dotted line) shows the difference between the \mathrm{MSE} without variance regularization and the \mathrm{MSE} with variance regularization ( \Delta_{\mathrm{VR}}\mathrm{MSE}\equiv\mathrm{MSE}_{\mathrm{no\,var.\,reg.}}-\mathrm{MSE}_{\mathrm{var.\,reg.}} ). The shading correspond to the spread over the training instances. In this section, we discuss the variance regularization technique introduced in Kreplin and Roth 2024 and apply it to our QNNs for cloud cover. Variance regularization is a technique aimed at reducing the effects of measurement shot noise in the training and inference stage of a QML model. This is achieved by adding to the loss function (here the \mathrm{MSE} ) a term which is proportional to the variance of the output of the model, in order to simultaneously minimize both terms (if possible) and therefore obtain a model requiring fewer shots to be evaluated, both during and after training ( Kreplin and Roth 2024 ) . In our context, the loss function that we minimize in the training reads as \mathcal{L}_{\mathcal{D}}(\boldsymbol{\theta};\lambda)=\mathrm{MSE}_{\mathcal{D}}(\boldsymbol{\theta})+\lambda\,\mathrm{MPV}_{\mathcal{D}}(\boldsymbol{\theta})\,\,, (14) where \mathrm{MPV}_{\mathcal{D}}(\boldsymbol{\theta}) is defined in Eq. ( 13 ) and \lambda is a regularization parameter. In general, the evaluation of \mathrm{MPV}_{\mathcal{D}}(\boldsymbol{\theta}) requires measurements in addition to those performed for evaluating the model output. In our case however, we can estimate both \mathrm{MSE} and \mathrm{MPV} from the same set of measurement shots, since f_{\boldsymbol{\theta}}(\boldsymbol{x}) is constructed only from \hat{\sigma}^{z} expectation values. Calculating the gradients of \mathcal{L}_{\mathcal{D}}(\boldsymbol{\theta};\lambda) can be done with the same parameter-shift rule of Eq. ( 5 ), therefore this changing of the loss does not result in additional training overhead. We test this technique on our two QNN architectures in the same setting as in the previous section. The regularization parameter \lambda is chosen to be constant during training, although we remark here that Kreplin and Roth 2024 also proposes a dynamical regularization approach which may further improve the training. The results are shown in Fig. 7 . Training the QNNs with variance regularization in the noiseless regime (Fig. 7 (a) and (b)) shows that there exist values of \lambda for which the \mathrm{MPV} can be reduced of more than one order of magnitude while still keeping the \mathrm{MSE} low (i.e., below 10^{-2} ). In other words, these results show that there are regions of the QNNs’ parameter space where both the prediction error and the prediction variance can be low, and that variance regularization can effectively target them provided one chooses a suitable value for \lambda . With these positive results, we move on to applying variance regularization with a finite n_{\mathrm{shots}} , to assess whether a finite \lambda can help in stabilizing the training even when n_{\mathrm{shots}}<10^{4} (Fig. 7 (c) and (d)). From both panels it is evident that a value of \lambda=0.005 is already sufficient to stabilize the training even for a relatively low n_{\mathrm{shots}}=100 . For a better comparison with the case of no variance regularization, we also show the difference with respect to the training \mathrm{MSE} in the previous section (Fig. 6 (a)), in the lower row of panels (c) and (d). For n_{\mathrm{shots}}<10^{4} , the difference \Delta_{\mathrm{VR}}\mathrm{MSE}\equiv\mathrm{MSE}_{\mathrm{no\,var.\,reg.}}-\mathrm{MSE}_{\mathrm{var.\,reg.}} remains positive throughout the training, indicating a better training performance when using a finite \lambda . For a large number of shots n_{\mathrm{shots}}\geq 10^{4} , the difference is very small or negative, which indicates that in this regime adding the \mathrm{MPV} to the loss contrasts the \mathrm{MSE} minimization. For further minimizing the \mathrm{MSE} one could continue the training potentially gradually decreasing \lambda , as mentioned above and done in Kreplin and Roth 2024 . Overall, the results presented here show that variance regularization is an effective approach for achieving a stable training of a QNN even with a moderate number of shots. 6 Discussion and outlook In this paper we explore the potential of QNNs as parameterization schemes in climate models, focusing on the specific case of cloud cover parameterizations. With the goal of predicting cloud cover from coarse-grained state variables, we compare different QNN architectures with classical NNs of similar size (i.e., similar number of parameters) on several aspects: prediction accuracy, generalization ability and trainability. Overall, the investigated QNNs show a similar performance (at least in the noiseless setting) to classical NNs in all these aspects, which is a promising indication of the applicability of these models to learn patterns in climate data. Our work opens up several directions for further investigating the applicability of QML in developing parameterizations for climate models. We outline those in the following, while also discussing criticalities and potential limitations associated to them. A first extension to our work would be to study the performance and learning behavior of the proposed architectures for problems of larger size, which would require moving away from the cell-based approach we took here, by considering also neighboring model cells (as done in Grundner et al. 2022 in the context of classical NNs). Furthermore, while we have performed a thorough analysis of possible QNN ansatzes, we are aware that our architecture search is not exhaustive. Notable interesting examples to investigate in future works could include quantum convolutional neural networks ( Cong et al. 2019 ) or QNNs with measurement feedforwards ( Foss-Feig et al. 2023 ; Sahay and Verresen 2024 ; Chan et al. 2024 ; Iqbal et al. 2024 ) . While increasing the size of the problem, and thus the number of qubits, may introduce trainability issues such as barren plateaus with increasing number of qubits ( McClean et al. 2018 ; Thanasilp et al. 2023 ; Larocca et al. 2024 ) , we note that there exist architectures that are immune to such problems ( Pesah et al. 2021 ) , and parameter initialization strategies to mitigate them ( Grant et al. 2019 ; Friedrich and Maziero 2022 ; Zhang et al. 2022 ; Gelman 2024 ) . Our construction could be also tested on parameterization schemes other than cloud cover. Changing the parameterization scheme would likely result in a more complex learning task, which may also increase the chance of observing a separation between the quantum and classical ML algorithms for the considered dataset. In fact, it is to a large extent unknown what types of classical datasets are better suited to quantum learning models than to a classical ones, and extensive tests on several architectures and datasets as done here are very valuable to pinpoint features that may help answering this question. Going beyond regression, another interesting extension would be to re-frame the parameterization learning problem in a probabilistic setting. Specifically, one could build quantum generative models ( Amin et al. 2018 ; Dallaire-Demers and Killoran 2018 ; Coyle et al. 2020 ; Gao et al. 2022 ) for learning the full probability distribution of the process considered (here cloud cover). Switching to generative modeling, a task that is to some extent more natural to quantum computing, may increase the chance of observing a separation between the quantum and classical models for the given problem ( Du et al. 2020 ) . Finally, another direction concerns the online implementation of the proposed QNNs, i.e., their coupling to the dynamical core of the climate model solving the Navier-Stokes equations. While QNNs consisting of a small number of qubits can be numerically simulated and thus in principle be readily used within a climate model, a larger number of qubits would require the coupling of a quantum device to the dynamical core. Given that parameterization schemes need to be run for every cell of the model at every time-step, such a coupling could become impractical in terms of computation runtime. To address this limitation, a possibility would be to build classical surrogates ( Schreiber et al. 2023 ; Landman et al. 2022 ; Sweke et al. 2023 ; Jerbi et al. 2024 ) of the trained QNNs, to be then used online. In this way, the quantum device would be used only in the development stage of the parameterization, and our work lays a solid basis for developing such a workflow. Another possible direction are quantum-inspired methods such as tensor networks ( Orús 2019 ) , which already find applications as (Q)ML models ( Stoudenmire and Schwab 2016 ; Efthymiou et al. 2019 ; Haghshenas et al. 2022 ; Ran and Su 2023 ; Rieser et al. 2023 ) , in classical data compression and loading ( Dilip et al. 2022 ; Jumade and Sawaya 2023 ; Jobst et al. 2023 ) , and generative modeling ( Han et al. 2018 ; Merbis et al. 2023 ; Liu et al. 2023 ) . Data and code availability The code and the data used for this work can be made available from the authors upon reasonable request.