Quantum entanglement provides a competitive advantage in adversarial games

Peiyong Wang, Kieran Hymas, James Quach · 2026

Read Quantum entanglement provides a competitive advantage in adversarial games by Peiyong Wang, Kieran Hymas, James Quach (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10289.txt.

Introduction

Peiyong Wang, Kieran Hymas, and James Quach test whether quantum entanglement helps an agent learn in a fully classical contest, the game Pong. Their hybrid agent uses a small parameterized quantum circuit as a feature extractor inside a policy learning setup. Circuits with fixed or trainable entangling gates beat separable ones at matched parameter counts, and in low-capacity regimes they match or beat classical neural baselines. Feature analysis suggests entangled circuits learn distinct structure, better suited to modelling how opposing agents interact.

Catalog record

CREATORPeiyong Wang, Kieran Hymas, James Quach
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39283
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.10289

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Quantum entanglement provides a competitive advantage in adversarial games Peiyong Wang, Kieran Hymas, James Quach Abstract Whether uniquely quantum resources confer advantages in fully classical, competitive environments remains an open question. Competitive zero-sum reinforcement learning is particularly challenging, as success requires modelling dynamic interactions between opposing agents rather than static state–action mappings. Here, we conduct a controlled study isolating the role of quantum entanglement in a quantum–classical hybrid agent trained on Pong, a competitive Markov game. An 8-qubit parameterised quantum circuit serves as a feature extractor within a proximal policy optimisation framework, allowing direct comparison between separable circuits and architectures incorporating fixed (CZ) or trainable (IsingZZ) entangling gates. Entangled circuits consistently outperform separable counterparts with comparable parameter counts and, in low-capacity regimes, match or exceed classical multilayer perceptron baselines. Representation similarity analysis further shows that entangled circuits learn structurally distinct features, consistent with improved modelling of interacting state variables. These findings establish entanglement as a functional resource for representation learning in competitive reinforcement learning. keywords Quantum Machine Learning, Reinforcement Learning, Artificial Intelligence 1 Main Competitive environments arise in many fields, from quantitative trading 35 ; 36 to modern reinforcement learning 28 ; 30 ; 29 , where one player’s gain is usually another’s loss. In game theory, the simplest abstraction of this antagonism is the two-player zero-sum game, whose value under optimal play is characterised by the minimax theorem 37 . Many competitive decision problems are sequential rather than one-shot, and can be formalised as (zero-sum) stochastic games—also known as Markov games—in which two agents repeatedly act in a shared state with stochastic transitions 27 ; 16 . This perspective aligns naturally with modern RL, where self-play in competitive games has powered several landmark research 28 ; 30 ; 29 . Pong provides a particularly controlled example: it is a classic two-player competitive game, and common RL benchmark formulations assign rewards that are largely anti-symmetric between the two sides (e.g., \pm 1 on scoring), making it a close approximation to a zero-sum Markov game 2 ; 19 ; 20 . These competitive benchmarks, therefore, offer a natural testbed for probing whether uniquely quantum resources—most notably entanglement—can yield measurable benefits for learning and decision making. Quantum computing has long been anticipated to deliver improvements over classical algorithms across a range of domains, including optimisation, quantum system simulation, and machine learning, by offering advantages in computational complexity and predictive performance. A canonical example is Grover’s search algorithm, where quantum superposition enables an oracle to evaluate all database entries in parallel, yielding a quadratic speedup with \mathcal{O}(\sqrt{N}) time complexity 7 . Beyond superposition, other non-classical quantum resources have also been shown to provide advantages: quantum contextuality underpins the memory advantage of contextual recurrent neural networks (CRNNs) over classical recurrent neural networks (RNNs) 1 . Among these resources, quantum entanglement is widely regarded as a key enabler of quantum advantage. Entanglement enables models and algorithms to exploit quantum correlations that lack classical counterparts, potentially enhancing the expressive power and learning efficiency of quantum machine learning (QML) architectures. To date, however, systematic empirical evidence for such benefits remains limited. Existing benchmarking studies have primarily focused on supervised learning, particularly (binary) classification tasks 4 . Within this setting, the data reuploading model 22 , also known as the quantum Fourier model (QFM) 25 , stands out as one of the few quantum models for which entanglement has been shown to improve classification accuracy 4 . These results suggest that entanglement can meaningfully enhance the performance of variational quantum models, motivating further investigation of its impact beyond supervised learning scenarios. Research on quantum reinforcement learning (QRL) has established several forms of provable quantum advantage, but these proofs typically rely on settings where a quantum agent interacts with a quantum environment or communicates through a quantum channel. For example, 24 demonstrates that access to quantum channels can yield algorithmic speed-ups for QRL agents. In 39 , the authors introduced a quantum deep deterministic policy gradient algorithm for the quantum state generation and the eigenvalue problems. Quantum signals can also be harnessed to enhance the average reward outcomes in the infinite-horizon Markov decision problem 6 . Such results, however, do not readily extend to classical RL environments, which are far more complex and less structured than the idealised models commonly assumed in theoretical quantum machine learning analyses. Most proofs of quantum advantage in machine learning rely on specific structures in the data that can be efficiently utilised by a quantum machine learning model, but not by a classical model. One of the popular choices for such structures is those related to cryptography with a (classical) hardness proof, such as the data constructed based on the decisional Diffie-Hellman assumption 34 , those based on weak pseudorandom functions in 23 , and the classical data constructed based on the discrete logarithm algorithm in 17 . The hidden subgroup problem is also a popular choice for proving quantum advantage in learning from classical data 38 . However, in modern artificial intelligence research, the machine learning model is expected to adaptively discover and utilise the unknown structures in the training data with as few assumptions or biases as possible 33 ; 5 ; 11 . Despite this limitation, a growing body of work has examined quantum agents acting within classical environments 31 ; 9 ; 21 ; 10 ; 15 ; 14 ; 12 . Prior studies have explored the use of parameterised quantum circuits (PQCs) for Q-function and value-function approximation 31 ; 10 , as policy networks trained using REINFORCE 9 , as components of the actor and critic networks for the soft actor-critic algorithm 12 , or the proximal policy optimisation (PPO) algorithm 10 . These works demonstrate that PQCs can, in principle, serve as function approximators within standard RL pipelines. However, they do not address a fundamental question: Does quantum entanglement improve agent performance in classical RL tasks? Since entanglement is the resource often associated with quantum advantage, an answer to this urgent question is timely for quantum machine learning. No experimental benchmarking study has isolated and evaluated the role of entanglement in PQC-based RL agents operating in classical environments. Existing works typically introduce entanglement implicitly or treat it as a design choice rather than a variable of interest. Instead of using the PQC solely as a Q-function approximator or a policy function, we adopt an 8-qubit QFM circuit as a backbone, providing features for downstream actor and critic heads, following the construction of the PPO agent 26 in CleanRL 8 . The architecture of our agent can be found in Fig. 1 . We compare the performance of our hybrid network with four qualitatively different backbone networks: • A classical multi-layer perceptron (MLP), which has three layers in total: one input, one output and one hidden. • A separable data reuploading PQC, with only single-qubit gates. • An entangled data reuploading PQC. The entanglement gate is the controlled-Z gate. • An entangled data reuploading PQC. The entanglement gate is the trainable IsingZZ ( R_{ZZ} ) gate: R_{ZZ}=e^{-i\frac{\theta}{2}Z\otimes Z}. (1) where each backbone takes an 8 -dimensional observation vector as input encoding the left and right paddle positions p_{l} , p_{r} , and velocities s_{l} , s_{r} , as well

Read the complete text