Higher-order response theory in stochastic thermodynamics and optimal control
Sam D’Ambrosia 1,2, Adrianne Zhong 1,2,3, Michael R. DeWeese 1,2,4 · 2025
Read Higher-order response theory in stochastic thermodynamics and optimal control by Sam D’Ambrosia 1,2, Adrianne Zhong 1,2,3, Michael R. DeWeese 1,2,4 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-24540.txt.
Introduction
Samuel DAmbrosia, Adrianne Zhong, and Michael DeWeese tidy the theory of optimal heat-engine protocols. Linear response theory helps design minimal-work ways to drive a system between states. Nanoscale devices and biomolecular machines both use such protocols. Different driving regimes produced different-looking approximations. Their relationships were murky.
The authors show each approximation is a truncation of one object. A causal Volterra series for the response generates them all. Higher-order terms are then built in a systematic way. Two test systems carry the analysis. One is an overdamped particle in a harmonic trap. The other is a two-state double well. Higher-order response improves excess work predictions somewhat. The protocols improve modestly. The cost is heavy computation. Worse, the series can predict unphysically negative excess work.
Catalog record
| CREATOR | Sam D’Ambrosia 1,2, Adrianne Zhong 1,2,3, Michael R. DeWeese 1,2,4 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-24540
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Higher-order response theory in stochastic thermodynamics and optimal control Preprint: APS/123-QED Sam D’Ambrosia 1,2, Adrianne Zhong 1,2,3, Michael R. DeWeese 1,2,4 Abstract Linear response theory has found many applications in statistical physics. One of these is to compute minimal-work protocols that drive nonequilibrium systems between different thermodynamic states, which are useful for designing engineered nanoscale systems and understanding biomolecular machines. We compare and explore the relationships between linear-response-based approximations used to study optimal protocols in different driving regimes by showing that they arise as controlled truncations of a general causal response (Volterra) expansion. We then construct higher-order response terms and discuss the drawbacks and utility of their inclusion. We illustrate our results for an overdamped particle in a harmonic trap, ultimately showing that the inclusion of higher-order response in calculating optimal protocols provides marginal improvement in effectiveness despite incurring a significant computational expense, while introducing the possibility of predicting arbitrarily low and unphysical negative excess work. I Introduction A central goal of nonequilibrium thermodynamics is to characterize and calculate optimal, minimal-work protocols that transform a thermodynamic system between different states in finite-time 45 ; 8 . These protocols find applications in fields such as the engineering of nanoscopic devices 19 ; 58 ; 39 ; 40 ; 53 ; 44 ; 35 ; 34 ; 1 ; 12 ; 22 ; 21 , and in understanding biophysical systems 24 ; 18 ; 46 ; 31 ; 7 ; 17 ; 52 . However, exact, analytic optimal protocols exist only for the simplest systems, such as a Brownian particle in a harmonic potential 45 . Alternatively, a wide range of approximate results rely on assumptions based on linear response , which assumes that the thermodynamic system remains close to the driving protocol’s equilibrium state at all times 28 ; 62 ; 30 . These include the range of results from slow driving thermodynamic geometry 47 ; 60 ; 42 ; 41 ; 59 ; 21 ; 22 , ansatz-based slow driving results 9 , and results applying in the weak driving regime 10 ; 36 ; 37 . However, linear response represents only the first-order term of a higher order response expansion, or Volterra series. Our goal in this manuscript is both to clarify the basis of and relationships among linear response approximations as used in finite-time thermodynamics, and to study to higher order response in this context. While the Volterra series is well known in control theory 11 ; 13 ; 54 ; 23 ; 29 , in physics it often appears implicitly such as in time-ordered response 28 ; 62 or Dyson expansions 20 . Here, we use it as a clarifying framework to organize and compare existing linear-response approximations and to explore higher-order extensions. We first demonstrate how existing linear response approaches such as thermodynamic geometry and ansatz-based weak driving are derived from the first term of the Volterra series. We also demonstrate the equivalence of linear-response thermodynamic geometry with the perturbative approach expressed in 50 , and extend this perturbative solution to all orders for the overdamped moving harmonic oscillator, observing that including higher orders in the excess work cost function can lead to predictions of unphysical negative excess work, and that jumps found in true optimal protocols 45 ; 55 ; 3 ; 4 can cause the series to diverge. Following this, we construct next-order response terms in the context of finite-time thermodynamics. To evaluate the utility of using next-order correction beyond linear response to derive optimal finite-time protocols, we study quadratic response for an overdamped harmonic oscillator. We find that while including higher-order response terms can marginally improve the performance of derived optimal protocols, their inclusion comes at a substantial computational cost, and again allows for the possibility of predicting unphysical negative excess work. These obstacles further motivate a different but related approach to optimal stochastic thermodynamics based on a recently discovered connection between optimal transport and thermodynamic geometry 55 ; 27 , which avoids relying on limited near-equilibrium expansions. Preliminaries The results of our manuscript are valid for passive (i.e., detailed-balance preserving) overdamped and underdamped Langevin dynamics, as well as passive discrete state Markov dynamics. Given a Hamiltonian H_{\lambda}(x) parameterized by control-parameters \lambda\in\mathcal{M} , the expected work needed to implement a finite-time protocol \Lambda=\lambda(t)|_{t\in[0,t_{f}]} connecting \lambda(0)=\lambda_{i} to \lambda(t_{f})=\lambda_{f} is given by \langle W\rangle=\int_{0}^{t_{f}}\dot{\lambda}^{\mu}\bigg\langle\frac{\partial H_{\lambda}}{\partial\lambda^{\mu}}\bigg\rangle\,{\mathrm{d}t}, (1) where we have suppressed the explicit time dependence of \lambda , H , and the average over the nonequilibrium distribution. Here we focus on the continuous case where x\in\mathbb{R}^{d} . For the discrete case x\in\Omega where \Omega represents a finite discrete state space, integrals over x\in\mathbb{R}^{d} become sums over x\in\Omega (e.g., as specified in 43 ). Here, \mathcal{M} is a k -dimensional manifold. Throughout this paper we utilize the Einstein summation convention where repeated upper and lower indices denote implicit summation, and the dot denotes a total time derivative \dot{\lambda}^{\mu}:={\mathrm{d}}\lambda^{\mu}/{\mathrm{d}t} . Greek indices will indicate covariant expressions, while Latin indices will correspond to coordinate dependent expressions. The unadorned brackets \langle\cdot\rangle denote a nonequilibrium expectation, (i.e., over trajectories x(t)|_{t\in[0,t_{f}]} that start in equilibrium with \lambda_{i} and evolve via some specified Langevin dynamics), while \langle\cdot\rangle^{\mathrm{eq}}_{\lambda} denotes an expectation value over the equilibrium thermodynamic state corresponding to control parameters set to \lambda . The probability distribution over the system’s microstates at equilibrium with respect to control parameters \lambda is given by the canonical ensemble, \rho^{\mathrm{eq}}_{\lambda}=\text{exp}\{-\beta[H_{\lambda}(x)-F(\lambda)]\}=\frac{e^{-\beta H_{\lambda}(x)}}{Z(\lambda)}, (2) where \beta is the inverse temperature, and F ( \lambda ) = -\beta^{-1} ln[ \int exp \{-\beta H_{\lambda}(x^{\prime})\}{\mathrm{d}x}^{\prime} ] is the free energy of the equilibrium state determined by H_{\lambda}(x) , which can written using the partition function Z(\lambda)=\int\exp\{-\beta H_{\lambda}(x^{\prime})\}{\mathrm{d}x}^{\prime} . Here we will only consider isothermal protocols. Because of this from here onward we set \beta=1 without loss of generality. The time-evolution of the nonequilibrium probability density \rho_{t} is governed by the following deterministic partial differential equation (PDE) \frac{\partial\rho_{t}}{\partial t}=\mathcal{L}_{\lambda}[\rho_{t}], (3) where in the continuous case \mathcal{L}_{\lambda} is the Fokker-Planck operator (for the discrete case, this would be the master equation and transition rate matrix). We will assume that for any \lambda defining the potential energy function the equilibrium distribution is the unique zero-mode of the Fokker-Planck operator \mathcal{L}_{\lambda}[\rho^{\mathrm{eq}}_{\lambda}]=0, (4) and under the dynamics \partial_{t}\rho_{t}=\mathcal{L}_{\lambda}[\rho_{t}] for a fixed \lambda , any arbitrary initial distribution \rho_{0} will relax to the equilibrium distribution, \lim_{t\rightarrow\infty}\rho_{t}=\rho^{\mathrm{eq}}_{\lambda} . Splitting the nonequilibrium probability density \rho_{t}(x) into the equilibrium density \rho^{\mathrm{eq}}_{\lambda} and nonequilibrium deviation \delta\rho_{t}(x) , \rho_{t}(x)=\rho^{\mathrm{eq}}_{\lambda}(x)+\delta\rho_{t}(x), (5) where, since \rho^{\mathrm{eq}}_{\lambda}(x) is the zero-mode of {\mathcal{L}}_{\lambda} [Eq. ( 4 )], we can rewrite the time evolution as \frac{\partial\rho_{t}}{\partial t}=\mathcal{L}_{\lambda}[\delta\rho_{t}]. (6) Using \delta\rho_{t} , we can distinguish average excess work from average total work. Inserting Eq. ( 5 ) into Eq. ( 1 ) we obtain \langle W\rangle=\langle W_{\text{rev}}\rangle+\langle W_{\text{ex}}\rangle, (7) where the two terms are \displaystyle\langle W_{\mathrm{rev}}\rangle=\int^{t_{f}}_{0}{\mathrm{d}t}\dot{\lambda}^{\mu}\int{\mathrm{d}}x\frac{\partial H_{\lambda}(x)}{\partial\lambda^{\mu}}\rho_{\lambda}^{\mathrm{eq}}(x), (8) \displaystyle\langle W_{\mathrm{ex}}\rangle=\int^{t_{f}}_{0}{\mathrm{d}t}\dot{\lambda}^{\mu}\int{\mathrm{d}}x\frac{\partial H_{\lambda}(x)}{\partial\lambda^{\mu}}\delta\rho_{t}(x). (9) Here, \langle W_{\mathrm{rev}}\rangle is the reversible work, which is equal to the free energy difference \Delta F=F(\lambda_{f})-F(\lambda_{i}) between the equilibrium states defined by the initial and final control parameters \lambda_{i} and \lambda_{f} , which is independent of the protocol between the initial and final points. \langle W_{\mathrm{ex}}\rangle is the excess work, which is dependent on the shape and speed of the protocol. Given that \langle W_{\mathrm{rev}}\rangle=\Delta F is