Understanding Dynamics of Adam in Zero-Sum Games: An ODE Approach
Yi Feng, Weiming Ou, Xiao Wang · 2026
Read Understanding Dynamics of Adam in Zero-Sum Games: An ODE Approach by Yi Feng, Weiming Ou, Xiao Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19392.txt.
Introduction
Feng, Ou and Wang derive differential equations that capture the continuous-time behavior of Adam-DA, the descent-ascent cousin of Adam used for zero-sum games. Theory for this popular method has lagged behind practice. The equations closely track the discrete steps of Adam-DA and give a workable analytic frame for studying local convergence and implicit gradient regularization. Their analysis finds the two momentum parameters play exactly opposite roles to their documented effects in minimization problems. GAN experiments across architectures and datasets confirm the reversed momentum effect.
Catalog record
| CREATOR | Yi Feng, Weiming Ou, Xiao Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 130727 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.19392
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Understanding Dynamics of Adam in Zero-Sum Games: An ODE Approach Yi Feng, Weiming Ou, Xiao Wang Abstract The remarkable success of the Adam in training neural networks has naturally led to the widespread use of its descent-ascent counterpart, Adam-DA, for solving zero-sum games. Despite its popularity in practice, a rigorous theoretical understanding of Adam-DA still lags behind. In this paper, we derive ordinary differential equations (ODEs) that serve as continuous-time limits of the Adam-DA. These ODEs closely approximate the discrete-time dynamics of Adam-DA, providing a tractable analytical framework for understanding its behavior in zero-sum games. Using this ODE approach, we investigate two fundamental aspects of Adam-DA: local convergence and implicit gradient regularization. Our analysis reveals that the roles of the first- and second-order momentum parameters in zero-sum games are exactly the opposite of their well-documented effects in minimization problems. We validate these predictions through GAN experiments across multiple architectures and datasets, demonstrating the practical implications of this reversed momentum effect. † † affiliationnotice: * Authors are listed in alphabetical order. 1 Introduction Zero-sum games lie at the core of many modern machine learning tasks, including GANs ( 29 ) and adversarial training ( 28 ) . While a rich body of theory has been developed for solving zero-sum games, particularly for Gradient Descent-Ascent (GDA) and its variants ( 16 ; 49 ; 20 ) , in practice Adam Descent-Ascent (Adam-DA), the descent-ascent counterpart of Adam ( 40 ) , remains the optimizer of choice. For instance, most GANs studies employ Adam-DA for training ( 1 ; 76 ; 56 ) . Despite this ubiquity, the theoretical understanding of Adam in zero-sum games remains far less developed compared to its extensive studied behavior in minimization. When studying momentum-based algorithms in games, such as Adam-DA, one might expect that, although some game-specific adaptations are necessary, the principles derived from theoretical analyses in minimization largely remain applicable to zero-sum games. For instance, the recent work of ( 36 ) , ( 7 ) and ( 47 ) study the benefits of incorporating Nesterov or Heavy-ball momentum, a core component of Adam, in game-solving algorithms. All of these works primarily focus on positive momentum parameters, reflecting the standard choice in optimization algorithms for minimization. However, practical experience in GANs training–a prominent application of zero-sum games–suggests that negative momentum often improves stability and performance ( 27 ) . This gap between theory and practice motivates the following questions: How can we theoretically understand Adam’s behavior in zero-sum games? In particular, in which aspects does Adam behave differently in zero-sum games compared to standard minimization? In this work, we try to answer above questions by deriving ordinary differential equations (ODEs) which are the continuous time limit of Adam-DA. The derived ODEs accurately approximate the underlying algorithm. This approach of using ODEs to study optimization algorithms dates back to Polyak’s seminal work ( 52 ) for analyzing momentum method in minimization problems and has been further developed in recent years to analyze the dynamics of various algorithms ( 58 ; 66 ; 57 ) . In particular, we study two aspects of Adam in zero-sum games: local convergence and implicit gradient regularization . These two aspects are natural targets: local convergence characterizes the behavior of the trajectory near an equilibrium, whereas implicit gradient regularization provides a more global perspective by describing how the trajectory interacts with the geometry (e.g., flatness) of the loss landscape. The two viewpoints are complementary and, taken together, offer a more complete picture of Adam’s dynamics in zero-sum games. 1.1 Summary of Contributions and Limitations Contributions on Local Convergence: We provide quantitative local convergence results for both the ODEs of Adam-DA (Theorem 4.3 ) and the Adam-DA algorithm (Theorem 4.4 ). We find that, in typical zero-sum games, a smaller first-order momentum improves local convergence over a broader range of step sizes (Corollary 4.5 ). This contrasts with Adam’s behavior in minimization, where achieving a similar effect typically requires a larger first-order momentum. As a further corollary, we show that Adam-DA always diverges on bilinear objectives, regardless of parameter choices (Corollary 4.6 ). This is again opposite to the minimization setting, where Adam can converge to a neighborhood of a local minimum under suitable parameters ( 75 ) . These results substantially extend prior separations between game dynamics and minimization, which were previously established mainly for simpler methods without adaptivity and momentum ( 3 ; 2 ) . Contributions on Implicit Gradient Regularization: We provide qualitative descriptions of how the parameters of algorithm influence the interaction between the algorithm’s trajectories and the flatness of min-max loss landscapes through the analysis of purposed ODEs. We find that a smaller first-order momentum \beta and a larger second-order momentum \rho guide the trajectories toward flatter regions of the loss landscape. Again, this behavior is exactly the opposite of the implicit gradient regularization effect observed in minimization, where achieving a similar effect requires a larger \beta and a smaller \rho ( 8 ) . We further validate these predictions empirically on GAN training across common architectures and datasets, a representative class of min–max games captured by our theory. Limitations. A limitation of this work is that we primarily study Adam’s dynamics in a deterministic setting. Nevertheless, our findings are informative for the stochastic regime. In particular, the experiments in Section 5 use stochastic Adam for GAN training, and the observed behavior is consistent with our theoretical predictions. We also note that, in minimization, deterministic analyses of Adam have been an important step and have yielded key insights, including the edge-of-stability phenomenon ( 12 ; 11 ) and implicit regularization effects ( 62 ; 63 ; 70 ; 67 ) . Since Adam in zero-sum games is substantially less understood than in minimization, we view the deterministic analysis here as a natural first step toward a complete theory. 1.2 Related Works ODEs in Optimization. ODEs method was introduced to study momentum in minimization problems, starting with the seminal work of ( 52 ) . Recently, inspired by optimization algorithms that combine momentum and adaptivity such as Adam, ODEs or their stochastic generalization has also been applied to study adaptive methods in minimization, e.g., ( 25 ; 48 ; 14 ) . For zero-sum games, ( 59 ) employed this methodology to study the anchor acceleration methods. ( 15 ) developed stochastic differential equations for algorithms like Extra-gradient in zero-sum games under a stochastic setting. Two recent works, ( 54 ) and ( 21 ) provide continuous-time analyses of vanilla Gradient Descent-Ascent and Heavy-ball momentum in zero-sum games, respectively. The current work generalizes these results to the Adam algorithm, which is more complex and remains poorly understood in game-theoretic settings. A more detailed comparison is provided in Appendix A . Local Convergence in zero-sum Games. Local convergence of learning algorithms in zero-sum games has received great attention in recent years. ( 46 ) analyzed the local convergence of the Gradient Descent-Ascent (GDA) algorithm and its variants, showing the importance of the interaction between players on the dynamics of the algorithms. ( 22 ) provide a local convergence analysis of GDA under finite timescale separation. ( 43 ) studied the local convergence to a Stackelberg Equilibrium for GDA-based learning algorithms.