Training single-electron and single-photon stochastic physical neural networks Preprint: APS/123-QED

T. Dou, S. Kumara, J. Burns, E. Sigler, P. Girdhar, D. Petty, G. J. Milburn, J. Plested, M. J. Woolley · 2026

Read Training single-electron and single-photon stochastic physical neural networks Preprint: APS/123-QED by T. Dou, S. Kumara, J. Burns, E. Sigler, P. Girdhar, D. Petty, G. J. Milburn, J. Plested, M. J. Woolley (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10861.txt.

Introduction

Dou and colleagues offer electronic and photonic stochastic neurons for physical nets, where learning and inference run. The electronic neuron tunnels electrons through a quantum dot, with dot charge as its base. The photonic neuron uses a photon source driving one of two modes linked by a tunable link, with idle occupation as its base. Training tests MNIST sorting with hidden-layer nets, using stochastic neurons and coherently-driven detector neurons. Using real outputs in the backward pass, the net tops 97 percent in trials, and holds under noise and doubt.

Catalog record

CREATORT. Dou, S. Kumara, J. Burns, E. Sigler, P. Girdhar, D. Petty, G. J. Milburn, J. Plested, M. J. Woolley
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66759
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10861

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Training single-electron and single-photon stochastic physical neural networks Preprint: APS/123-QED T. Dou, S. Kumara, J. Burns, E. Sigler, P. Girdhar, D. Petty, G. J. Milburn, J. Plested, M. J. Woolley Abstract The computational demands of deep learning motivate the investigation of alternative approaches to computation. One alternative is physical neural networks (PNNs), in which learning and inference are performed directly via physical processes. Stochastic PNNs arise when the underlying neurons are realized by the dynamics of a stochastic activation switch. Here we propose novel electronic and photonic stochastic neurons. The electronic realization is implemented by single-electron tunneling through a quantum dot. The photonic realization is implemented via a single-photon source driving one of two modes coupled via a controllable beam-splitter-like interaction. In the electronic case, the charge state of the quantum dot forms the basis for the stochastic neuron, whereas in the photonic case the occupation of the undriven mode serves as the basis for the stochastic neuron. Training of stochastic PNNs is performed with models of stochastic neurons, as well as with coherently-driven, single-photon detector stochastic neurons previously introduced. Several training strategies for MNIST handwritten digit classification have been investigated using single-hidden-layer stochastic PNNs, including varying the number of trials in each layer to control forward pass stochasticity and employing either true probability or empirical outputs in the backward pass to evaluate their influence on gradient estimation. We show that when empirical outputs are used in the backward pass, the network achieves more than 97% test accuracy with few trials per layer. Despite the simplicity of the model architecture, high test accuracy is maintained in the presence of a high degree of noise and model uncertainty. The results demonstrate the potential of embracing stochastic PNNs for deep learning. I Introduction Deep neural networks have become a dominant paradigm for perception, inference, and control, driven by advances in data availability, algorithmic innovations, and specialized digital accelerators 12 ; 24 ; 6 . At the same time, the rising computational and energetic costs of training and inference 21 motivate the exploration of alternative computing architectures beyond conventional digital computation. One appealing route is to perform parts of neural network computation directly, using the natural physical dynamics of an engineered system. These so-called physical neural networks (PNNs) 30 ; 31 ; 19 ; 10 enable potentially energy-efficient and ultrafast physical computation. A central challenge with PNNs is training in the presence of device nonidealities 20 . Real hardware is noisy, lossy, and imperfectly calibrated; moreover, its characteristics drift in time and vary across nominally identical devices. In many analog processors, these effects are often treated as small perturbations to an underlying deterministic computation, enabling “noise-aware” or “quantization-aware” variants of backpropagation 9 ; 31 ; 28 ; 35 ; 29 ; 33 . This perturbative viewpoint can be effective when the signal-to-noise ratio (SNR) is high in every layer, so that randomness merely blurs otherwise deterministic activations. However, when the operating point is pushed toward extreme energy efficiency or when the underlying information carriers are intrinsically discrete, the perturbative picture breaks down. In optics, shot noise emerges from the quantization of the electromagnetic field, while in electronics, charge discreteness and stochastic tunneling are fundamental. In these regimes the neuron output may become highly stochastic, with low per-evaluation SNR and discrete readout outcomes. Rather than viewing this as an impairment, one can view the hardware naturally as implementing a stochastic neural network 2 ; 8 ; 18 ; 17 , whose stochastic neurons are probabilistic activation switches. The practical question then becomes: can we reliably train PNNs in a regime where stochasticity is the rule, not the exception? Recent work on few-quanta optical neural networks has shown that high-accuracy, deterministic inference can be achieved, even when intermediate layers operate at SNR \sim 1 , by explicitly incorporating a physics-based probabilistic model of the measurement process during training 17 . This physics-aware stochastic training perspective is compelling because it aligns the learning algorithm with the actual statistics of the experimental hardware. However, in many physical platforms the training loop faces a different bottleneck: the experimentally accessible observables may be limited to samples of stochastic outputs, rather than direct access to the underlying activation probabilities or pre-activations. Consequently, the learner may not have access to a sufficiently accurate probabilistic model of the device response, especially when the number of samples is limited. This raises a basic and practically consequential problem: to what extent can a stochastic PNN be trained from limited sampling data, especially when the output layer is at a low SNR? Here we study training strategies for stochastic physical neural networks, focusing on the regime where each neuron evaluation yields a discrete, stochastic outcome. We introduce physically motivated realizations of stochastic neurons: single-electron transistor stochastic neurons, where the charge state of a quantum dot acts as the stochastic neuron; stochastic neurons based on controllable beam-splitter-like interaction driven by a deterministic single-photon source; and coherently-driven single-photon detector stochastic neurons previously introduced. They share a common interface: a controllable pre-activation parameter that determines an activation probability and a measurable stochastic output sample. Following a description of these physical systems, we systematically compare backpropagation compatible estimators under experimentally realistic constraints. The results show that useful learning signals can be extracted even when only a small number of samples is available per layer, provided that the estimator is matched to the accessible observables and the network is trained with an appropriate treatment of stochasticity across layers. In addition, high accuracy can be maintained despite substantial noise and model uncertainty. II Physical Stochastic Neurons Artificial neural networks are commonly formulated as compositions of affine transformations followed by nonlinear activation functions 6 . For a fully-connected feedforward neural network, the forward propagation at the l^{\text{th}} layer can be written as \displaystyle\mathbf{z}^{(l)} \displaystyle=\mathbf{W}^{(l)}\mathbf{h}^{(l-1)}+\mathbf{w}_{0}^{(l)}, (1a) \displaystyle\mathbf{h}^{(l)} \displaystyle=\bm{f}\left(\mathbf{z}^{(l)}\right), (1b) where \mathbf{z}^{(l)} is the pre-activation, \mathbf{W}^{(l)} is the weight matrix, \mathbf{w}_{0}^{(l)} is the bias vector, \mathbf{h}^{(l-1)} is the activation from the previous layer, and \bm{f}(\cdot) is an element-wise nonlinear activation function. The overall transformation implemented by a deep neural network is a nested composition of such layer-wise maps. In PNNs, these mathematical transformations can be implemented by physical processes directly realized in hardware. In so-called isomorphic PNNs 31 , the network topology and the set of tunable physical parameters are designed to mirror the connectivity and parameters of the corresponding digital neural network. A key distinction between digital and physical modules is that physical systems are unavoidably subject to noise. This leads to a mismatch between the mathematical and physical transformations, even when the same nominal parameters are assigned. While certain noise sources can be mitigated through engineering improvements, others are fundamentally linked to the discrete nature of the information carriers themselves. For example, in optical systems, this discreteness manifests as photon shot noise, whereas in electronic systems it arises from the quantization of charge. When operating neural-network hardware at extremely low energy levels, which is a desirable regime for scalable and energy-efficient computing, such shot noise becomes a dominant effect rather than a small perturbation. As a result, the output of a physical neuron is often stochastic, even when the input is held fixed. These considerations motivate the concept of a stochastic PNN,

Read the complete text