Neuromorphic Quantum Neural Networks with Tunnel-Diode Activation Functions

Jake McNaughton, A. H. Abbas * , and Ivan S. Maksymov · 2025

Read Neuromorphic Quantum Neural Networks with Tunnel-Diode Activation Functions by Jake McNaughton, A. H. Abbas * , and Ivan S. Maksymov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-04978.txt.

Introduction

Jake McNaughton, Abbas, and Ivan Maksymov present a 2025 paper on using a tunnel diode's physics as the activation function inside neural networks. The head title stresses full-precision and ternarised networks; the catalog title frames the same work as neuromorphic quantum networks. Activation functions shape how each unit in a network responds, and standard choices are pure math.

A tunnel diode has a bent current-voltage curve born of quantum tunneling. Used as the activation, that curve beat standard functions in deep networks, giving lower loss and higher accuracy in training and testing. The authors also argue the device suits future hardware for lean, energy-saving AI chips. The work links semiconductor electronics, quantum physics, and machine learning in one component.

Catalog record

CREATORJake McNaughton, A. H. Abbas * , and Ivan S. Maksymov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-04978

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neuromorphic Quantum Neural Networks with Tunnel-Diode Activation Functions Jake McNaughton, A. H. Abbas * , and Ivan S. Maksymov Abstract The mathematical complexity and high dimensionality of neural networks hinder the training and deployment of machine learning (ML) systems while also requiring substantial computational resources. This fundamental limitation drives ML research, particularly in the exploration of alternative neural network architectures that integrate novel building blocks, such as advanced activation functions. Tunnel diodes are well-known electronic components that utilise the physical effect of quantum tunnelling (QT). Here, we propose using the current–voltage characteristic of a tunnel diode as a novel, physics-based activation function for neural networks. We demonstrate that the tunnel-diode activation function (TDAF) outperforms traditional activation functions in terms of accuracy and loss during both training and evaluation. We also highlight its potential for implementation in electronic circuits suited to developing neuromorphic, quantum-inspired AI systems capable of operating in environments not suitable for qubit-based quantum computing hardware. I Introduction The fields of machine learning (ML) and neuromorphic computing (NC) are rapidly evolving, with increasing demands for energy-efficient and biologically plausible computational models [ 1 , 2 ] . Algorithmic neural network models rely on activation functions [ 3 ] —mathematical functions applied to the output of a neuron—that enable deep learning architectures to learn complex patterns in the input data [ 4 ] . The nonlinearity of activation functions is crucial for modelling intricate relationships between inputs and outputs, enabling the neural network to generalise beyond the training data [ 5 , 3 , 4 ] . Without nonlinearity, neural networks reduce to linear models, limiting their ability to capture and learn hierarchical representations found in real-world data [ 3 ] . However, commonly used activation functions such as ReLU, sigmoid and tanh exhibit limitations, particularly in deep learning, due to issues such as vanishing gradients and energy inefficiency [ 4 ] . These challenges hinder learning in deep networks, necessitating alternative solutions that offer both efficient computation and reduced power consumption [ 4 , 6 , 7 ] . Physics, particularly quantum mechanics, has profoundly influenced ML, inspiring the development of novel algorithms that exploit physical principles to enhance computational efficiency and reduce power consumption [ 1 , 2 , 8 , 9 ] . A notable example is quantum reservoir computing (RC) [ 10 , 11 , 12 ] , a subclass of neuromorphic and unconventional computing systems [ 13 ] that employs the intrinsic dynamics of physical systems to enable energy-efficient ML solutions, particularly for predicting highly nonlinear and chaotic time series, as well as for pattern recognition tasks [ 11 , 12 ] . Concurrently, physics-informed neural networks integrate fundamental physical laws—expressed through partial differential equations—directly into the learning process [ 14 ] . This approach ensures that models remain consistent with established physical principles while requiring fewer data points compared to traditional deep learning methods. Quantum neural networks (QNNs) are computational models that integrate quantum mechanics with traditional neural network architectures used in ML [ 15 , 16 ] . Modern research on QNNs focuses on integrating classical artificial neural networks—widely used in ML and computer vision [ 4 ] —with the unique advantages of quantum information processing [ 17 , 18 ] . QNNs and NC systems share the goal of replicating cognitive processes observed in biological brains [ 19 , 20 , 21 , 8 , 9 , 22 ] . Both QNNs and NC systems aim to overcome the limitations of conventional computing, which relies on deterministic logic and sequential processing. NC systems address these challenges through event-driven architectures and parallel processing, mimicking the function of biological neurons and synapses [ 19 , 20 , 21 ] . Fig. 1: Architecture of a neural network using the current–voltage characteristic of a tunnel diode (inset) as a nonlinear activation function, referred to as TDAF in the main text. Quantum tunnelling (QT) has been utilised in tunnel [ 23 ] and resonant-tunnelling diodes [ 24 ] , with certain NC architectures exploiting negative differential resistance [ 25 , 22 ] , a hallmark of tunnelling diodes. QT-based devices, including tunnel diodes, exhibit significantly lower power consumption than traditional integrated circuits [ 26 ] , also exhibiting a number of characteristics essential for applications in challenging environments such as space [ 27 ] . Additionally, QT has facilitated the development of scanning tunnelling microscopy (STM) [ 28 ] and has also been experimentally observed in quantum dots [ 25 ] , which serve as essential components of quantum NC systems [ 10 ] . Recent advancements in quantum computing have increasingly employed QT in quantum annealing and NC systems [ 29 ] . In quantum annealing, tunnelling enables systems to traverse potential energy barriers, aiding the discovery of optimal solutions in combinatorial optimisation problems [ 29 ] . In other classes of NC systems, QT mechanisms have been integrated to emulate the architecture of the brain [ 30 ] . Finally, QT also plays a critical role in quantum biology, influencing enzymatic reactions and energy transfer in photosynthesis [ 31 ] . The mathematical expressions governing the probability of QT through a potential barrier exhibit rich nonlinear properties [ 32 ] and semiconductor diodes serve as a key element of NC systems [ 33 ] . Therefore, in this paper we propose and theoretically demonstrate that the current–voltage (I–V) characteristic of a tunnel diode can serve as a novel nonlinear activation function in neural networks (Fig. 1 ). Unlike conventional activation functions, which are often heuristic and lack direct physical interpretations, the intrinsic nonlinearity of the tunnel diode arises from well-defined quantum mechanical principles [ 34 , 35 ] . By systematically comparing traditional activation functions used in ML, we show that the neural network implementing the tunnel-diode activation function (TDAF) not only exhibits superior performance in terms of convergence, accuracy and expressiveness of the model but also introduces an energy-efficient approach to neuromorphic computing by extending prior research work [ 32 ] . This quantum-inspired activation function opens new possibilities for designing more biologically plausible and computationally efficient neural architectures, further bridging the gap between semiconductor physics and quantum AI systems. II Methods II-A Traditional Activation Functions The nonlinearity of activation functions enables neural networks to model complex patterns beyond what linear transformations alone can achieve [ 4 ] . Various activation functions have been developed, each with advantages and limitations [ 4 , 7 ] . For example, sigmoid f(x)=\dfrac{1}{1+e^{-x}} and hyperbolic tangent (tanh) f(x)=\dfrac{e^{x}-e^{-x}}{e^{x}+e^{-x}} functions [ 19 , 36 , 4 ] compress inputs into a fixed range (0,1) and (-1,1) , respectively. However, while useful for probability estimation and feature scaling, these functions suffer from saturation, where large or small inputs lead to near-zero gradients, hindering weight updates in multilayer networks [ 4 ] . Therefore, one of the most widely used activation functions is the Rectified Linear Unit (ReLU), defined as f(x)=\max(0,x) [ 4 ] . ReLU is computationally efficient and helps mitigate some of the vanishing gradient problems associated with sigmoid and tanh functions. However, ReLU is not fully immune to gradient-related issues, since neurons based on this function can become inactive when they consistently receive negative inputs, which

Read the complete text