Physics of Learning: A Lagrangian perspective to different learning paradigms

Siyuan Guo * Department of Computer Science, University of Cambridge Max Planck Institute for Intelligent Systems United Kingdom & Germany &Bernhard Schölkopf Max Planck Institute for Intelligent Systems ELLIS Institute Tübingen Germany and * Correspondence: [email protected] · 2025

Read Physics of Learning: A Lagrangian perspective to different learning paradigms by Siyuan Guo * Department of Computer Science, University of Cambridge Max Planck Institute for Intelligent Systems United Kingdom & Germany &Bernhard Schölkopf Max Planck Institute for Intelligent Systems ELLIS Institute Tübingen Germany and * Correspondence: [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-21049.txt.

Introduction

Physicists build efficient machines by minimizing an action; perhaps learning can be framed the same way. Siyuan Guo and Bernhard Schölkopf explore that idea in a 2025 work-in-progress paper called Physics of Learning. Efficient learning, for them, means reaching a target error with the fewest observations in the least time.

Starting from a Learning Lagrangian, the authors derive known algorithms from first principles. Bellman's optimality equation from reinforcement learning emerges from the stationary paths. So does Adam, the workhorse optimizer of generative modeling. The postulate is that learning searches for stationary trajectories of this Lagrangian, and algorithms are what those trajectories look like. The paper sketches a unifying physical picture of several learning paradigms.

Catalog record

CREATORSiyuan Guo * Department of Computer Science, University of Cambridge Max Planck Institute for Intelligent Systems United Kingdom & Germany &Bernhard Schölkopf Max Planck Institute for Intelligent Systems ELLIS Institute Tübingen Germany and * Correspondence: [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-21049

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Physics of Learning: A Lagrangian perspective to different learning paradigms Siyuan Guo * Department of Computer Science, University of Cambridge Max Planck Institute for Intelligent Systems United Kingdom & Germany &Bernhard Schölkopf Max Planck Institute for Intelligent Systems ELLIS Institute Tübingen Germany and * Correspondence: [email protected] Abstract We study the problem of building an efficient learning system. Efficient learning processes information in the least time, i.e., building a system that reaches a desired error threshold with the least number of observations. Building upon least action principles from physics, we derive classic learning algorithms, Bellman’s optimality equation in reinforcement learning, and the Adam optimizer in generative models from first principles, i.e., the Learning Lagrangian . We postulate that learning searches for stationary paths in the Lagrangian, and learning algorithms are derivable by seeking the stationary trajectories. Table 1: Overview of Physics-Inspired Learning Lagrangian . Machine learning encompasses a broad set of paradigms from supervised, unsupervised learning to reinforcement learning and generative models. We postulate that learning also follows a physical law, the principle of least action. We unify different learning paradigms through derivation from the first principles. In particular, we compare the learning Lagrangian with existing physical laws and detail each principle’s suitable application in learning tasks. We derive classical learning algorithms that arise when searching for stationary solutions in the Lagrangian. Physics Learning Fermat’s principle T=\int_{A}^{B}dt T=\int_{\epsilon[\emptyset]}^{\epsilon[\mathbf{s}]}dt [*] Hamiltonian H(\mathbf{x},\mathbf{p})=\mathbf{p}\cdot\dot{\mathbf{x}}-L(\mathbf{x},\dot{\mathbf{x}}) H(\mathbf{s},\mathbf{a},\lambda)=r(\mathbf{s},\mathbf{a})+f(\mathbf{s},\mathbf{a})^{T}\lambda [ \dagger ] the Lagrangian L=T-V L(\ell,\nabla_{\theta}\ell)=\frac{1}{2}(\nabla_{\theta}\ell)^{T}F^{-1}\nabla_{\theta}\ell-\ell(\theta) [*] Applications Algorithms Fermat’s principle Parametric Models A-optimality ( Atkinson et al. 2007 ) Hamiltonian Reinforcement Learning Bellman’s Equation ( Bellman 1958 ) the Lagrangian Generative Models / Supervised Learning Adam ( Kingma 2014 ) / RMSprop ( Tieleman 2012 ) • Notes: T in Fermat’s principle denotes time taken to travel from point A to point B ; \epsilon[\emptyset],\epsilon[\mathbf{s}] is the generalization error after observing zero data to data sequence \mathbf{s}:=s_{1},s_{2},\ldots ; H is the (physical) Hamiltonian system with position \mathbf{x} and momentum \mathbf{p} and Lagrangian L ; H(\mathbf{s},\mathbf{a},\lambda) is the reinforcement learning correspondent with state \mathbf{s} , action \mathbf{a} , reward r(\mathbf{s},\mathbf{a}) , transition dynamics f(\mathbf{s},\mathbf{a}) and momentum equivalent \lambda ; L=T-V represents kinetic energy minus potential energy; \ell denotes some log-likelihood function; \nabla_{\theta}\ell is gradient with respect to model parameters \theta\in\mathbb{R}^{P} ; F^{-1} denotes the inverse Fisher information. Bold symbols are vectors; (\cdot)^{\top} is transpose; \dot{x} is derivative with respect to time. The learning Lagrangian indicated via [ \dagger ] means it is classic textbook material in control theory (see Todorov 2006 ). Learning Lagrangians indicated by [*] are proposed in this work; to the best of our knowledge, no prior published work exists as of September 2025. 1 Introduction Modern machine learning encompasses a broad set of paradigms — supervised and unsupervised learning, reinforcement learning, and generative models, with deep architectures as the dominant modeling substrate. As momentum built across labs, industry, and policymakers, work shifted toward translating technical advances into products. These efforts have accelerated deployment but also privileged trial-and-error engineering and scale-first heuristics, in part because we still lack a principled understanding of when and why learning emerges, generalizes, and fails. This gap has impeded a systematic methodology for designing sample- and compute-efficient learning systems. This paper demonstrates a close connection between physics and learning and postulates that learning algorithms arise as stationary trajectories of a learning Lagrangian . This paper presents a first-principles account by casting diverse learning paradigms in a single variational framework. We posit learning Lagrangians and show that algorithms arise as stationary points of their action, thereby providing a unifying perspective to parameter estimation tasks—covering supervised learning and generative modeling—and reinforcement learning. Table 1 provides a summary of the paper’s main result. Motivated by physical principles, we postulate the corresponding learning analogy and illustrate its use in suitable learning tasks. By seeking stationary paths of the associated action, we recover classical algorithms. Related Work. Machine learning and physics have early origins from energy-based models ( Hinton 2025 ; Hopfield 1982 ) to their statistical mechanical analysis of memory capacity ( Gardner & Derrida 1988 ) . Kaplan et al. 2020 show physics-like scaling law emerges as the neural models scale; and recent efforts have begun to analyze this phenomenon using statistical mechanics tools ( Cui et al. 2021 ; Sorscher et al. 2022 ; Defilippis et al. 2024 ; Bahri et al. 2024 ; Paquette et al. 2024 ) . Bahri et al. 2020 give a more recent survey focused on deep models. This paper, on the other hand, studies the relationship between efficient learning and the physics Lagrangian without discussing the choice of model architectures. This work derives algorithms through seeking stationary trajectories, and the commonality shared between different learning paradigms offers a unifying perspective. Organization of the paper: • Section 2 formalizes the connection with kinematic quantities (distance, velocity, acceleration) with Shannon information, deriving the corresponding information-processing velocity and acceleration. Insight 2 shows that learning is a decelerating process. • Section 3 reviews the relevant physical principles and presents the postulated learning Lagrangians . Solving for stationary trajectories of the associated action recovers classical algorithms in parametric models (Sec. 3.1 ), reinforcement learning (Sec. 3.2 ), and parameter estimation tasks (including supervised learning and generative models)(Sec. 3.3 ), thereby offering a unifying perspective across seemingly disparate learning paradigms. We thus hypothesize that learning obeys the Principle of Least Action: searching for stationary paths yields learning algorithms. 2 Learning as a deceleration process. Learning in intelligent systems travels distance not in terms of space but information observed. A data stream until time t is s_{1},s_{2},\ldots,s_{t} , abbreviated as s_{\leq t} . In physics, speed is defined as the rate of change of position with respect to time: v=\lim_{\Delta t\to 0}\frac{\Delta s}{\Delta t}=\frac{ds}{dt} . In information processing, we define position as the amount of Shannon information ( Shannon 1948 ) up until time t: I(s_{\leq t}):=\log\frac{1}{p(s_{\leq t})}=-\log p(s_{\leq t}) . The rate of change of information content with respect to time, termed as instantaneous velocity in information, is thus derivable as: v=\lim_{\Delta t\to 0}\frac{I(s_{\leq t+\Delta t})-I(s_{\leq t})}{\Delta t} . In discrete information flows (e.g., language tokens) when \Delta t=1 , given a data stream x_{\leq{t}} , the velocity at time t is v(t)=-\log p(x_{t}\mid x_{<t}) . Next token prediction is thus modeling the instantaneous rate of change in information, or instantaneous velocity in information. To check the consistency between distance and velocity in information processing, we expect it to satisfy basic physics properties, e.g., distance as an integral over velocities. distance as integral. In discrete time, physical distance satisfies: \text{distance}=\sum_{i}v(t_{i})\Delta t . That holds true in information processing too: the total amount of information is the sum of chain-ruled conditional probabilities: I(x_{\leq t})=-\log p(x_{1},\ldots,x_{t})=\sum_{i=1}^{t}v(t_{i})=-\sum_{i=1}^{t}\log p(x_{i}\mid x_{<i}) . Continuing from understanding kinematic quantities in information processing, acceleration is the instantaneous change in velocity, defined as a=\frac{dv}{dt}=\lim_{\Delta t\to 0}\frac{\Delta v}{\Delta t} . acceleration. In discrete information flows, acceleration models the instantaneous change in conditional probability in information processing: \displaystyle a(t)=-\log p(x_{t+2}\mid x_{\leq{t+1}})+\log p(x_{t+1}\mid x_{\leq t}) (1) Figure 1: Expected test-time in-context learning velocity and acceleration: (Left) In-context per-token loss \ell_{t}=v(t)=\mathbb{E}[-\log p_{\theta}(x_{t}\mid x_{<t})] ; (Right) In-context per-token difference in loss \Delta\ell_{t}=a(t)=\mathbb{E}[\ell_{t+1}-\ell_{t}] . In-context learning (as shown in the right) is a deceleration process, meaning loss

Read the complete text