Correspondence Between Ising Machines and Neural Networks

Andrew G. Moore · 2025

Read Correspondence Between Ising Machines and Neural Networks by Andrew G. Moore (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-00746.txt.

Introduction

Andrew Moore links two computing worlds that rarely meet: Ising machines and neural networks. Ising model computation powers quantum annealers, adiabatic quantum computers, and thermodynamic classical devices, and tradition equates the computed answer with the machine's ground state, its lowest energy configuration. Moore generalizes the picture from ground states to spin averages, letting computation happen at high temperatures instead of only in the cold ground state.

On that basis he builds a systematic correspondence between Ising devices and neural networks, plus a simple method to run trained feed-forward networks on Ising-type hardware. A mathematical proof shows these implementations always succeed. For builders of unconventional hardware, the result means a trained network need not wait for specialized chips: it can be compiled onto the physics of spins.

Catalog record

CREATORAndrew G. Moore
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-00746

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Correspondence Between Ising Machines and Neural Networks Andrew G. Moore Abstract Computation with the Ising model is central to future computing technologies like quantum annealing, adiabatic quantum computing, and thermodynamic classical computing. Traditionally, computed values have been equated with ground states. This paper generalizes computation with ground states to computation with spin averages, allowing computations to take place at high temperatures. It then introduces a systematic correspondence between Ising devices and neural networks and a simple method to run trained feed-forward neural networks on Ising-type hardware. Finally, a mathematical proof is offered that these implementations are always successful. 1 Introduction The Ising model holds a special place in the race to develop the computing technologies of the future. On one hand, it is the universal language of quantum annealing and adiabatic quantum computing, forcing a significant amount of quantum computing research to flow through the problem of Ising Hamiltonian design. On the other hand, emerging classical devices implementing the Ising model, such as coupled oscillators [ 5 ] , memristors [ 4 ] and, most recently, transistor-based p-bits [ 8 ] , promise a future of ultra low power compute-in-memory edge devices. No matter what hardware it is run on, the Ising model stands as the single most versatile physics-based method for solving NP-complete combinatorial optimization problems [ 10 , 16 ] . However, the problem of designing Ising systems to execute computations is far from simple. Therefore, the single problem of developing new techniques to implement computation with the Ising model is of utmost importance to the development a wide variety of emerging and frontier technologies. Neural networks, on the other hand, are so omnipresent that their importance hardly requires elaboration. The connections between the Ising model and neural networks at a theoretical level have been noticed and studied since the origins of machine learning, but much still remains to be discovered about this relationship, and even more remains to be proven rigorously. Only a few papers have concerned themselves with running neural networks on Ising hardware, despite the fact that running a trained neural network on an Ising machine or quantum annealer would be very interesting practically as well as theoretically. This paper aims to patch that gap by providing not only a systematic technique for implementing certain feed-forward neural networks on Ising hardware, but also a rigorous mathematical proof of that method’s correctness. 1.1 Main Results Traditionally, Ising computation operates at low temperatures, conceptually equating ‘solution’ and ‘ground state’ ( Section 2.2 ). This paper introduces a new approach to extracting solutions from Ising systems: instead of states, we observe the sign of spin averages ( Section 2.3 ). This idea generalizes the notion of ground state solutions to all temperatures, allowing truly probabilistic noise-tolerant computation. The main result of this paper is that if one maps the parameters of a trained neural network with binary inputs and outputs to the coefficients of an Ising Hamiltonian, the resulting Ising system will behave like the neural network. A heuristic derivation of the high temperature case is provided in Section 3 ). Practically, this result means that neural networks can be run natively on any hardware that implements the Ising model. Methods are provided, along with proofs of correctness, for implementing shallow tanh networks at high temperature ( Theorem 5.1 ) and deep sign networks at low temperature ( Theorem 6.1 ). The main technical idea is as follows. We observe that both \tanh -activated neural networks and the naive mean field approximation of the Ising model contain a hyperbolic tangent applied to an affine function ( Section 3 ). Though these two formulae are not exactly equal, we show that the error between them is at most little-o of a control parameter ( Lemma 5.5 ), while the magnitude of the circuit output is big-O of that same parameter. It follows that for the right parameter, the Ising system replicates the neural network ( Section 5.2 ). That control parameter is easily seen to be the temperature gradient, a common method for enforcing directionality in Ising circuitry. Finally, we provide detailed computational experiments showing both the high and low temperature behavior for the case of 2-bit integer multiplication ( Section 4 ). We also provide a quantized solution, with a heuristic discussion of quantization procedures ( Section 7 ). 1.2 Other Work Traditional computing implements a complicated function (say, 16-bit integer multiplication) by introducing the abstraction layer of digital logic gates between the physical processes and the desired function. In contrast, a physics-based or physics-inspired computing device is a computing device that leverages physical dynamics and processes to perform computations directly [ 2 , 1 ] . In practice, this definition encompasses a huge variety of novel approaches, but in our case it refers simply to the introduction of the Ising model, rather than logic gates, as the privileged abstraction layer. In other words, given a complicated Boolean function, we would like to know how to model it with Ising hardware. It is possible to design an Ising computer by implementing logic gates with Ising spins, then assembling them into digital logic, an approach we would call “traditional logic via Ising.” Many papers in the literature take this approach [ 13 , 3 , 27 , 25 ] , as it is indisputably the shortest and clearest route to the implementation of a complicated function with Ising spins. This approach has proven effective for implementing functions such as multiplication and factoring, but necessarily shares many of the drawbacks of digital logic: while excellent for implementing well-understood mathematical functions, it is less than ideal for the problems tackled by artificial intelligence. A significant amount of research has also gone into designing Hamiltonians for natural Ising applications like combinatorial optimization problems [ 10 ] and linear system solving [ 6 ] . However, much less attention has been given to the general design problem: how do we efficiently implement any Boolean function directly with Ising hardware in a natural way? This paper will focus on this general design problem, in hopes that it will unlock the true potential of these frontier devices. We already have a great method of implementing arbitrary functions efficiently, even those that cannot be explicitly specified: the feed-forward neural network (FFNN). In fact, neural networks and their relatives are precisely the functions we would most like to offload to specialized inference hardware. It is therefore imperative that a way be found to run neural networks on Ising systems. Our correspondence, introduced in Section 3 , is based on mean field theory. Several papers in the past ten years have attempted to apply mean field theory to the analysis of feed-forward neural networks. In these cases the meaning is quite different: ‘mean field neural network’ usually refers to a mean field approximation of neural network behavior as the number of neurons increases, not the idea that neural networks approximate the mean field behavior of another system. The closest to this work is [ 14 ] , which modifies the statistical mechanics model directly, building in the directionality of information flow by analogy to renormalization, then shows that its mean-field behavior yields the \tanh -activated FFNN. We differ

Read the complete text