Stochastic Optimal Feedforward-Feedback Control for Partially Observable Sensorimotor Systems
Bastien Berret, Frédéric Jean · 2026
Read Stochastic Optimal Feedforward-Feedback Control for Partially Observable Sensorimotor Systems by Bastien Berret, Frédéric Jean (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-04994.txt.
Introduction
Bastien Berret and Frédéric Jean present a continuous-time method for optimal feedforward-feedback control of partly observable, stochastic, nonlinear, high-dimensional systems. Stretching nearby optimal control, their feedforward plan outright accounts for feedback uncertainties and latencies. Statistical linearization converts the stochastic problem to a nearly equivalent fixed tuning in a tractable augmented state space that keeps key nonlinearities. Applied to human neuromechanics, the method shows muscle co-shrink emerging as an optimal change to task demands.
Catalog record
| CREATOR | Bastien Berret, Frédéric Jean |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60706 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.04994
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Stochastic Optimal Feedforward-Feedback Control for Partially Observable Sensorimotor Systems Bastien Berret, Frédéric Jean Abstract Robust control of complex engineered and biological systems hinges on the integration of feedforward and feedback mechanisms. This is exemplified in neural motor control, where feedforward muscle co-contraction complements sensory-driven feedback corrections to ensure stable behaviors. However, deriving a general continuous-time framework to determine such optimal control policies for partially observable, stochastic, nonlinear, and high-dimensional systems remains a formidable computational challenge. Here, we introduce a framework that extends neighboring optimal control by enabling the feedforward plan to explicitly account for feedback uncertainties and latencies. Using statistical linearization, we transform the stochastic problem into an approximately equivalent deterministic optimization within a tractable, augmented state space that retains critical nonlinearities, offering both mechanistic interpretability and theoretical guarantees on approximation fidelity. We apply this framework to human neuromechanics, demonstrating that muscle co-contraction emerges as an optimal adaptation to task demands, given the characteristics of our sensorimotor system. Our results provide a computational foundation for neuromotor control and a generalizable tool for the control of nonlinear stochastic systems. Introduction Achieving robust behavior in the face of delays and uncertainties is a fundamental challenge for both engineered and biological systems. In human sensorimotor control, systemic latencies (>50 ms) render pure feedback control insufficient for tasks such as drilling a hole [ 28 ] . Consequently, the central nervous system (CNS) employs anticipatory muscle co-contraction [ 35 ] —a ubiquitous strategy observed across tasks from tool use to locomotion [ 48 ] . By exploiting the nonlinear, activation-dependent viscoelasticity of muscles [ 25 , 12 ] , the CNS regulates mechanical impedance [ 11 , 21 , 8 ] , thereby mitigating the consequences of sensory noise and delays on state feedback control [ 19 , 37 ] . While human sensorimotor control highlights the critical coupling of feedforward and feedback mechanisms, a theoretical framework to optimally combine them remains elusive. Specifically, current mathematical tools struggle to address the nonlinear, high-dimensional, and partially observable nature of systems subject to sensorimotor latencies. Solving these stochastic optimal control problems in continuous time is notoriously difficult beyond the standard Linear-Quadratic-Gaussian (LQG) case, which is a dominant yet limiting modeling framework for the neural control of movement [ 42 ] . Classical formulations describe the optimal solution through infinite-dimensional, computationally intractable equations in belief space [ 52 , 17 , 2 ] . This has motivated the development of approximate numerical methods, most notably trajectory optimization approaches like Differential Dynamic Programming (DDP) [ 26 ] and its stochastic variants such as iterative LQG (iLQG) [ 43 , 30 ] and stochastic DDP [ 41 ] . These algorithms iteratively approximate dynamics and quadratize costs to generate locally optimal feedback control policies, yet they often struggle to seamlessly integrate state estimation with planning under uncertainty. To address partial observability, belief-space extensions like B-DDP [ 36 , 45 ] incorporate uncertainty propagation via approximate filters, though often at the cost of high computational complexity. Other paradigms, such as Stochastic Model Predictive Control [ 33 ] or sampling-based path-integral frameworks [ 44 , 40 , 50 ] , offer alternative ways to handle uncertainty. However, like modern deep reinforcement learning [ 34 , 15 , 49 ] , these methods prioritize empirical scalability over the interpretability and theoretical guarantees essential for modeling complex neuromechanical systems. To address these limitations, we introduce a nonlinear stochastic optimal control framework for partially observable systems that leverages efficient numerical tools while preserving interpretability and approximation guarantees. Our approach falls within the category of trajectory optimization and, similar to iLQG and B-DDP, utilizes Kalman-type filters for uncertainty propagation. However, we depart from traditional neighboring optimal control—which designs feedback only after planning a nominal deterministic path [ 10 , 1 ] —by accounting for stochasticity during the planning phase [ 7 , 4 ] . By restricting the control policy to an affine dependence on the state estimate, we merge feedforward and feedback components into a unified dynamic optimization problem. We demonstrate that through statistical linearization [ 6 , 29 ] , we can reformulate this challenging stochastic problem as a deterministic optimal control problem in a tractable, augmented space, while preserving the critical nonlinear properties and covariance controllability essential for robust motor control. The resulting problem is solvable using state-of-the-art tools for deterministic trajectory optimization. Application of this framework to human sensorimotor control illuminates the fundamental interdependence between muscle co-contraction and state feedback control. Results Partially observable stochastic optimal control problem Problem formulation and hypotheses Let x_{t}\in\mathbb{R}^{n} , the state of a system at time t , be described by an Itô process x=\{x_{t}\} solution of a stochastic control system dx_{t}=f(t,x_{t},u_{t})dt+G(t,x_{t},u_{t})dw_{t},\quad x_{0}=\xi, (1) and the observation at time t , y_{t}\in\mathbb{R}^{p} , be described by an Itô process y=\{y_{t}\} of the form dy_{t}=g(t,x_{t})dt+H(t,x_{t})dv_{t},\quad y_{0}=0, (2) where w=\{w_{t}\} , v=\{v_{t}\} are two independent Wiener processes of dimensions k\leq n and p respectively, and \xi is a given random variable of dimension n (independent of w_{t},v_{t} ). A control process u=\{u_{t}\} (where u_{t}\in\mathbb{R}^{m} ) is called admissible if it is \{\mathcal{Y}_{t}\}_{t\geq 0} -adapted, where \mathcal{Y}_{t} is the \sigma -algebra generated by \{y_{s},0\leq s\leq t\} . The general stochastic optimal control problem under consideration is to find an admissible control which minimizes the cost functional \mathbb{J}(u)=\mathbb{E}[J(u)],\qquad\hbox{with}\quad J(u)=\psi(x_{T})+\int_{0}^{T}\ell(t,x_{t},u_{t})dt, (3) for a fixed or free time horizon T>0 , possibly subject to some additional constraints in expectation or in probability on the state. Except for the LQG case, such a problem is extremely difficult to analyze and solve numerically. It is then natural to look for suboptimal solutions by choosing a restricted class of admissible controls for which the problem is easier to handle. In this paper, we consider a context characterized by the following points: • Movement execution is preceded by a planning phase that allows some parameters of the control policy to be determined off-line, from prior experience and knowledge; • Parameter uncertainties and random disturbances are rather small and approximately Gaussian (no multimodal distributions); • Observation is partial and possibly of poor quality due to systemic noise and delays (see below). As a consequence, feedforward (open-loop, deterministic) controls and average behaviors play a central role, and we can rely on Kalman-type estimators. Inspired by the concept of neighboring-optimal stochastic control (see [ 39 , 10 , 1 , 32 ] with different terminologies), we propose to consider admissible feedback controls of the form described below. Fixing T>0 for simplicity (see Remark 3 regarding free time), we denote \mathcal{L}^{2}:=\mathcal{L}^{2}([0,T],\mathbb{R}^{m}) and \mathcal{L}_{M}^{2}:=\mathcal{L}^{2}([0,T],M_{m,n}(\mathbb{R})) . For an open-loop control u^{\mathrm{ol}}\in\mathcal{L}^{2} and an open-loop gain L\in\mathcal{L}_{M}^{2} , we define the control process u=\pi(u^{\mathrm{ol}},L) by u_{t}=\pi(u^{\mathrm{ol}},L)(t):=u^{\mathrm{ol}}(t)+L(t)\left(\hat{x}_{t}-m^{\mathrm{ol}}(t)\right),\quad t\in[0,T], (4) where: • m^{\mathrm{ol}}(\cdot) is the trajectory of the deterministic part of the system, i.e., the solution of the differential equation \dot{m}^{\mathrm{ol}}(t)=f(t,m^{\mathrm{ol}}(t),u^{\mathrm{ol}}(t)),\quad m^{\mathrm{ol}}(0)=\mathbb{E}[\xi]; (5) • \hat{x} is the linearized Kalman filter around (m^{\mathrm{ol}}(\cdot),u^{\mathrm{ol}}(\cdot)) (see formula ( 10 ) below). It is worth noting that the equations defining m^{\mathrm{ol}} and \hat{x} depend only on u^{\mathrm{ol}} and L , which justifies the notation u=\pi(u^{\mathrm{ol}},L) . Moreover, the same affine structure for the control policy \pi arises in related methods such as iLQG and DDP [ 30 , 41 ] . Finally, we define the restricted class \mathcal{U}