Quantum Time-Series Learning with Evolutionary Algorithms

Vignesh Anantharamakrishnan, Márcio M. Taddei · 2024

Read Quantum Time-Series Learning with Evolutionary Algorithms by Vignesh Anantharamakrishnan, Márcio M. Taddei (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-17580.txt.

Introduction

Vignesh Anantharamakrishnan and Márcio Taddei tune quantum circuits with evolution search, in work from 2024. Variational quantum circuits need tuned dials before they can forecast time series well. Gradient steps rule that tuning, yet they can stick fast in poor local dips.

An evolution strategy instead breeds dial sets and keeps the best forecast scorers. Across real data sets, gradient runs stuck in dips that evolution routes dodged fully. Forecast error fell as much as six fold with evolution tuning in the best case. A mixed route keeps speed from gradients and escape power from evolution search. Accuracy sensitive tasks gain most from the swap in tuning style.

Catalog record

CREATORVignesh Anantharamakrishnan, Márcio M. Taddei
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-17580

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Quantum Time-Series Learning with Evolutionary Algorithms Vignesh Anantharamakrishnan, Márcio M. Taddei Abstract Variational quantum circuits have arisen as an important method in quantum computing. A crucial step of it is parameter optimization, which is typically tackled through gradient-descent techniques. We advantageously explore instead the use of evolutionary algorithms for such optimization, specifically for time-series forecasting. We perform a comparison, for diverse instances of real-world data, between gradient-descent parameter optimization and covariant-matrix adaptation evolutionary strategy. We observe that gradient descent becomes permanently trapped in local minima that have been avoided by evolutionary algorithms in all tested datasets, reaching up to a six-fold decrease in prediction error. Finally, the combined use of evolutionary and gradient-based techniques is explored, aiming at retaining advantages of both. The results are particularly applicable in scenarios sensitive to gains in accuracy. I Introduction Machine learning has risen to tremendous prominence in the last decade with advances in many different tasks like classification, transformation, data analysis and generation in fields as diverse as customer segmentation, computer vision, sound and text interpretation, among many more. At the same time, the breakthrough potential of quantum computing, together with recent advances in available quantum hardware, make it a suitable alternative for probing new techniques in computing tasks, including those of machine learning. In the era of noisy intermediate-scale quantum (NISQ) devices, variational quantum algorithms (VQAs) Cerezo et al. 2021a ; Bharti et al. 2022 are an important candidate for such advancements for their current feasibility, as well as for being a testbed for techniques for future implementations. VQA requires, as does classical machine learning, the optimization of many parameters, and the most common optimizations techniques used in VQA are gradient descent in its many refinements Romero et al. 2018 ; Bharti et al. 2022 . However, evolutionary strategies have also been proposed and applied to certain tasks, such as finding molecular or many-body ground states Rattew et al. 2020 ; Chivilikhin et al. 2020 ; Robert et al. 2021 ; Wakaura et al. 2021 ; Wakaura and Tomono 2021 ; Anand et al. 2021 ; Huang et al. 2022 ; Chen et al. 2022a ; Franken et al. 2022 ; Schleich et al. 2023 ; Friedrich and Maziero 2023 , quantum encoding and state preparation Chen et al. 2022b ; Creevey et al. 2023 ; West et al. 2023 , as well as classically defined tasks Zhao et al. 2021 ; Pellow-Jarman et al. 2023 ; Turati et al. 2023 ; Albino et al. 2023 ; Kölle et al. 2024 . The exploration of different optimization techniques is necessary, among other reasons, because of barren plateaus, which can easily affect VQA optimization McClean et al. 2018 ; Wang et al. 2021 ; Cerezo et al. 2021b ; Ragone et al. 2023 . Evolutionary algorithms do not per se eliminate the issue of barren plateaus Arrasmith et al. 2021 , but as a different approach to optimization, offer different possibilities to navigate them. Another common problem in VQA parameter optimization is the convergence to local minima; in this regard evolutionary algorithms are particularly welcome because of their global nature. We shall see that the techniques proposed and their efficacy in our tests precisely suggest that avoiding local minima is a crucial advantage of evolutionary algorithms in VQA over gradient descent. One kind of problem where VQAs can be applied to is that of time series. Time series are data that depend on a one-dimensional parameter with a sequential ordering (time or a variable akin to time). They can represent myriad kinds of information, such as economics indicators, oral and written language, weather data, etc. The supervised learning task we will tackle is forecasting, the ability to predict later points in a series based on the previous ones. It has an expected structure — closer points being typically more relevant to prediction than distant ones —, something reflected in the architecture for machine learning for forecasting tasks. There is widespread interest in advancing the capabilities of time-series forecasting, be it in accuracy or in predicting further into the future. Here we study the use of evolutionary algorithms against gradient descent to optimize parameters in a VQA applied to time-series forecast, with a focus on scenarios where gradient-descent methods underperform in terms of accuracy. Such scenarios can be naturally brought about by extending how far into the future predictions are made, as it readily and realistically increases errors. The evolutionary techniques presented are able to achieve up to a six-fold decrease in error given the same quantum-circuit ansatz and dataset. Since evolutionary algorithms have long training times, we also present a hybrid method, combining gradient descent and evolutionary training to obtain an even higher accuracy while mitigating the longer train time. In fact, the hybrid method reaches an almost ten-fold decrease in error compared to gradient descent in one instance. In Section II we present the methods used in our experimentation, whose results and discussion are found in Section III . Section IV is left for concluding remarks. II Methods II.1 Variational Quantum Algorithms VQAs are hybrid algorithms which employ a quantum circuit with variable, parameter-dependent gates and a measurement in the end that produces a classical variable, from which a prediction is derived. As in classical machine learning, training is used to classically optimize the parameters such that the predictions match the ground truth of the training data (minimize a suitable cost function). Two important differences of VQA compared to classical methods are that the measurement outcomes are intrinsically probabilistic (differently from classical methods that introduce randomness, such as mini-batching) and that evaluating the derivatives of the cost function requires additional runs of the circuit (typically using the parameter-shift rule Mitarai et al. 2018 ; Schuld et al. 2019 ). The simplest way to perform such optimization is by gradient descent, which follows the direction of steepest descent of the cost function. It has the advantage of a speedy calculation and is considered the primary method for parameter optimization in classical and quantum algorithms. One of its challenges in VQA is the issue of barren plateaus McClean et al. 2018 , where derivatives of a cost function are exponentially suppressed in an exponentially large fraction of the parameter space. The issue affects any optimization method in VQA Arrasmith et al. 2021 , but global methods probe the parameter space differently, hence may provide different behaviors in the face of barren plateaus. More importantly for the present work, gradient-descent methods are local, hence subject to convergence to local minima. In spite of the existing techniques to avoid them, we shall see that, indeed, the behavior of the gradient descent is consistent with being trapped in local minima that can be otherwise circumvented. In the experimentation of this paper, gradient descent will be performed with the Adam optimizer Kingma and Ba 2017 with with a learning rate of 0.03, specifically the PyTorch implementation Paszke et al. 2019 . All other parameters in the Adam optimizer were set to their torch default values. Evolutionary methods for optimization have a rich history and avail of a wide range of different algorithms Bäck and Schwefel 1993 ; Bäck et al. 2023 . For our case of optimizing multiple

Read the complete text