Finite-time transitions in optimal control and non-equilibrium relaxation

Jan Meibohm, Samuel Monter, Sarah A. M. Loos, Clemens Bechinger · 2026

Read Finite-time transitions in optimal control and non-equilibrium relaxation by Jan Meibohm, Samuel Monter, Sarah A. M. Loos, Clemens Bechinger (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25798.txt.

Introduction

Meibohm and three colleagues study, in theory and experiment, how to steer a colloidal particle through an inhomogeneous environment in finite time. A final-state cost that varies with position competes with dissipation along the path. That contest yields a sharp switch in control strategy at a critical duration. The authors tie the switch to a phase transition in relaxation after a quench. There, control cost plays the role of the rate function for rare paths. The work links optimal control with nonequilibrium physics.

Catalog record

CREATORJan Meibohm, Samuel Monter, Sarah A. M. Loos, Clemens Bechinger
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45970
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.25798

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Finite-time transitions in optimal control and non-equilibrium relaxation Jan Meibohm, Samuel Monter, Sarah A. M. Loos, Clemens Bechinger Abstract We theoretically and experimentally study finite-time optimal control of a colloidal particle steered through a spatially inhomogeneous environment, modeled by a position-dependent energetic cost at the final state. The competition between this state-dependent penalty and path-dependent dissipation gives rise to a sharp transition in the control strategy at a critical control duration. We further show that this transition can be linked to a dynamical phase transition in nonequilibrium relaxation after a quench, where the control cost maps onto the rate function governing rare trajectories. Introduction With ongoing miniaturization of technological devices, the optimization of noisy processes has become increasingly important. At small scales, strong fluctuations are unavoidable, and performance is constrained by energy dissipation. Similar constraints govern biological systems, such as molecular motors and microorganisms, which must operate efficiently under strong noise and finite-time conditions Chi et al. 2024 ; Ju et al. 2025 ; Howard 2001 ; Jülicher et al. 1997 ; Soga et al. 2017 . A defining feature of such processes is that they occur over finite durations, leading to a fundamental trade-off between energetic cost and speed: faster protocols incur higher dissipation, whereas slower protocols reduce energetic cost at the expense of performance. Optimal control theory provides a natural framework to quantify and optimize such trade-off by identifying protocols that minimize a prescribed cost functional over a finite-time horizon Fleming and Rishel 1975 ; Bechhoefer 2021 ; Alvarado et al. 2025 . Even in simple settings, such as dragging colloidal particles or navigating active swimmers through fluctuating environments, optimal protocols can be nontrivial, with discontinuities arising at the protocol boundaries Schmiedl and Seifert 2007 ; Loos et al. 2024 ; Colabrese et al. 2017 ; Garcia-Millan et al. 2025 ; Gupta et al. 2023 . In structured environments with spatially varying energetic cost, optimal control becomes further enriched: the optimization must specify not only how fast to drive the system, but also where to go, since the location of the endpoint is part of the optimization task. This competition between path-dependent dissipation and position-dependent energetic penalty gives rise to distinct optimal strategies. Here we show that this trade-off leads to a finite-time transition between qualitatively distinct optimal protocols. For a broad class of control problems with nonconvex energetic penalties, we demonstrate theoretically and experimentally that a critical protocol duration separates a regime where it is optimal to accept an energetic penalty from one in which active steering towards less costly regions is favorable. For symmetric landscapes, this transition is accompanied by spontaneous symmetry breaking Kappen 2005a ; Kappen 2005b of the optimal solution, reminiscent of a continuous phase transition. Exploiting the connection between stochastic optimal control and large deviation theory Fleming ; Touchette 2009 ; Chetrite and Touchette 2015 , we further show that this control transition can be mapped onto a finite-time dynamical phase transition (FTDPT) in the relaxation dynamics of a freely diffusing stochastic system Meibohm and Esposito 2022 ; Blom and Godec 2022 ; Meibohm and Esposito 2023 ; Vadakkayil et al. 2024 . In this mapping, the optimal control cost plays the role of a rate function, and the transition manifests as a nonanalyticity associated with a change in the dominant relaxation pathway, from rare fluctuations at short times to typical relaxation trajectories at longer times. While direct observation of such rare events requires exponentially many realizations, optimal control experiments access the same information through averages over controlled trajectories, thereby bypassing this sampling bottleneck. Our results thus establish optimal control as an experimentally accessible route to dynamical phase transitions and, more broadly, to rare event physics in mesoscopic systems. In a companion paper Meibohm et al. , we show that the finite-time control transition and its direct link to FTDPTs generalize to a much broader class of control problems. Control problem Figure 1: A particle (blue) is driven by a harmonic trap (red) at constant mean horizontal velocity v_{\parallel} toward an obstacle (green), characterized by an energetic cost V(x) . The trap controls the lateral velocity v_{\perp} to minimize the total work performed on the particle. As a paradigmatic control scenario in a heterogeneous environment, we here consider the situation sketched in Fig. 1 . A microscopic particle (blue), suspended in a viscous fluid and subjected to thermal noise, is steered by a harmonic trap (red) whose time-dependent position \lambda(t) serves as control parameter. Starting in equilibrium at time t=0 at position x_{0} , the particle moves with constant mean longitudinal velocity v_{\parallel} to the right and reaches an obstacle (green) after time t_{f} at distance L=v_{\parallel}t_{f} . The obstacle is modeled by a structured energy landscape V(x) extending in the transverse direction with spatially varying cost. The average particle motion is fully determined by the trap position. While its longitudinal velocity v_{\parallel} is fixed, the transverse particle velocity v_{\perp}(t) is controlled to minimize a total cost comprising an energetic penalty V(x_{f}) and the dissipated energy accumulated along the path. As an illustrative example, we consider an overdamped particle dynamics in presence of additive white noise \xi(t) , as described by the following Langevin equation \displaystyle\dot{x}(t)=-\tau_{\text{p}}^{-1}[x(t)-\lambda(t)]+\sqrt{2k_{\text{B}}T/\gamma}\,\xi(t)\,, (1) which provides an accurate minimal model of our experimental setup. Here, T denotes the ambient fluid’s temperature, k_{\text{B}} the Boltzmann constant, and \tau_{\text{p}}=\gamma/\kappa the particle relaxation time, determined by the particle’s friction coefficient \gamma and the optical trap stiffness \kappa . The work required for steering the particle in perpendicular direction is given by W^{s}_{t_{f}}=\int_{0}^{t_{f}}\!\!\text{d}t\ \dot{\lambda}(\lambda-x) Seifert 2012 ; Peliti and Pigolotti 2021 . The objective is to minimize the mean \langle W_{t_{f}}\rangle of the total work W_{t_{f}}=W^{s}_{t_{f}}+V(x_{f}) over both the control protocol \lambda(t) and the mean particle position u(t)=\langle x(t)\rangle , for a fixed mean initial condition u_{0}=\langle x(0)\rangle . The mean \langle W_{t_{f}}\rangle reads \displaystyle{W}_{t_{f}}[u(t),\lambda(t)]=\langle W_{t_{f}}\rangle=\int_{0}^{t_{f}}\!\!\text{d}t\,\dot{\lambda}(t)[\lambda(t)-u(t)]+\tilde{V}(u_{f})\,, (2) where u_{f}=\langle x(t_{f})\rangle is the final mean position and \tilde{V}(u_{f})=\langle V(x_{f})\rangle is the noise-averaged penalty. We constrain the minimization of {W}_{t_{f}} so that u(t) satisfies the noise-averaged dynamics Eq. ( 1 ), by introducing a Lagrange multiplier. Applying the Pontryagin principle Fleming and Rishel 1975 ; Bechhoefer 2021 then yields a quadratic control Hamiltonian (Sec. B in app , whose optimal solution gives \displaystyle{W}_{t_{f}}(u_{f},u_{0}) \displaystyle=\frac{\gamma(u_{f}-u_{0})^{2}}{t_{f}}+\tilde{V}(u_{f})\,, (3) with \lambda_{0}=u_{0} and \lambda_{f}=u_{f} , reflecting that the system does not store excess potential energy at t_{f} . These boundary terms are not imposed, but are a direct result of the minimization. The first term on the r.h.s. of Eq. ( 3 ) accounts for the total dissipative costs and corresponds to the obstacle-free solution Schmiedl and Seifert 2007 , while the second term accounts for the mean penalty at u_{f} . In a final step, we optimize {W}_{t_{f}} over u_{f} , i.e., \displaystyle{W}^{*}_{t_{f}}(u_{0})=\min_{u_{f}}{W}_{t_{f}}(u_{f},u_{0})\,, (4) to obtain the optimal total cost {W}^{*}_{t_{f}}(u_{0})={W}_{t_{f}}(u^{*}_{f},u_{0}) , which solely depends on the initial particle position u_{0} . Here we denote by u^{*}_{f}(u_{0},t_{f})=\text{argmin}_{u_{f}}{W}_{t_{f}}(u_{f},u_{0}) the associated minimizer. Finite-time control transition Examination of the cost function in such structured environment leads to a general observation: The competition between the position-dependent penalty V(x_{f}) and viscous dissipation penalizing large displacements along x . As we will show below, this competition can lead to abrupt switches in the optimal control strategies

Read the complete text