Numerical approximations for partially observed optimal control of stochastic partial differential equations

Feng Bao, Yanzhao Cao, Hongjiang Qian · 2025

Read Numerical approximations for partially observed optimal control of stochastic partial differential equations by Feng Bao, Yanzhao Cao, Hongjiang Qian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00381.txt.

Introduction

Feng Bao and co-authors compute best control of noisy fluid systems in a 2025 paper. The system state lives in a vast space, while watchers see just a thin slice. Control must thus act on a guess of the true state.

Max rules for such control come first, with twin back equations in tow. Their method joins gradient steps, steered by those rules, with a particle filter. The filter tracks the chance spread of the hidden state from the thin reads. Test runs show the joint method steers well. Flood, flow, and reactor tasks share this half seen shape.

Catalog record

CREATORFeng Bao, Yanzhao Cao, Hongjiang Qian
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE85 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-00381

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Numerical approximations for partially observed optimal control of stochastic partial differential equations Thanks: The research of F. Bao was supported by the National Science Foundation under grant DMS-214267 and the Department of Energy under grant DE-SC002541; the research of H. Qian and Y. Cao was supported by the Department of Energy under grant DE-SC0022253, DE-SC002564. Feng Bao, Yanzhao Cao, Hongjiang Qian Abstract . In this paper, we study numerical approximations for optimal control of a class of stochastic partial differential equations with partial observations. The system state evolves in a Hilbert space, whereas observations are given in finite- dimensional space ℝ d {\mathbb{R}}^{d} . We begin by establishing stochastic maximum principles (SMP) for such problems, where the system state is driven by a cylindrical Wiener process. The corresponding adjoint equations are characterized by backward stochastic partial differential equations. We then develop numerical algorithms to solve the partially observed optimal control. Our approach combines the stochastic gradient descent method, guided by the SMP, with a particle filtering algorithm to estimate the conditional distributions of the state of the system. Finally, we demonstrate the effectiveness of our proposed algorithm through numerical experiments. 2020 Mathematics Subject Classification 93E11, 60G35, 65K10, 60H15, 60H10 1. Introduction For a fixed finite horizon T>0 and a bounded domain \mathcal{O}=(0,L)\subset{\mathbb{R}} , we consider the following controlled stochastic partial differential equations (SPDEs): (1.1) dX(t)=[AX(t)+F(X(t),u(t))]dt+G(X(t),u(t))dW(t),\quad X(0)=X_{0}\in L^{2}(0,L), where W:[0,T]\times\Omega\to E denotes a cylindrical \mathcal{Q} -Wiener process in a separable Hilbert space E on a stochastic basis (\Omega,{\mathcal{F}},\{{\mathcal{F}}_{t}\}_{t\in[0,T]},{\mathbb{P}}) satisfying usual conditions. Here \mathcal{Q} is a positive self-adjoint nuclear operator on E and A:D(A)\subset H:=L^{2}(\mathcal{O})\to H is a densely defined self-adjoint, negative definite linear operator with domain D(A) and compact inverse. The reaction term F:H\times U\to H and diffusion coefficients G:H\times U\to\mathcal{L}(E;H) are nonlinear continuous operator depending on a control process u taking values in \mathcal{U} , a subset of another Hilbert space U . Suppose that the full state of process X is not directly observable, we instead observe a function of X corrupted by noise. It leads to the observation process Y given by (1.2) dY(t)=h(X(t))dt+dB(t),\quad Y(0)=0\in{\mathbb{R}}^{d} where h:H\to{\mathbb{R}}^{d} is a continuous function, and B(t),t\geq 0 is a standard Brownian motion in {\mathbb{R}}^{d} , independent of W(t) . The purpose of the classical filtering problem is to estimate the conditional expectation \pi_{t}(\varphi)={\mathbb{E}}[\varphi(X(t))|{\mathcal{F}}_{t}^{Y}] for a class of functions \varphi , where {\mathcal{F}}_{t}^{Y} is the \sigma -algebra generated by the observation process, that is, {\mathcal{F}}_{t}^{Y}:=\sigma\{Y(s):s\leq t\} . For nonlinear filtering of the stochastic partial differential equation, we refer to [ 25 , 4 ] and references therein. One would like to determine the control to minimize their cost functional. In ( 1.1 ), the control may depend only on observations and cannot be determined from the state process X only. This control problem is referred to as a partially observed optimal control problem; see Fleming and Pardoux [ 15 ] , Bensoussan [ 9 ] , Pardoux [ 36 ] , and references therein. It combines classical stochastic optimal control with non-linear filtering problem. In this paper, we focus on systems where the state process follows the stochastic partial differential equations ( 1.1 ) driven by a cylindrical Wiener process, and the observation process follows ( 1.2 ) in a finite-dimensional space {\mathbb{R}}^{d} . This setting naturally arises in applications where large-scale distributed systems, such as ( 1.1 ), are either physically inaccessible or too high-dimensional for full state monitoring. Instead, partial observations, like ( 1.2 ), provide indirect access to system state. The goal of the controller is to design control strategies based on available but incomplete information Y . To further illustrate the motivation of studying partially observed system ( 1.1 ) and ( 1.2 ), we take an aquatic system in the ecological problem as an example. Aquatic ecosystems, such as the Great Lakes, are complex environments where water quality and marine life depend on a delicate balance of organic and inorganic agents. The concentration of organic and inorganic such as pollutants and nutrients in the water body can be described by a stochastic partial differential equation (SPDE) as follows: (1.3) \left\{\begin{array}[]{ll}&\!\displaystyle\frac{\partial C}{\partial t}-D\Delta C+(\nabla C)v=b(C,u)+N_{C},\quad t\geq 0,\;\xi\in\mathcal{O}\\ &\!\displaystyle C|_{\partial\mathcal{O}}=0,\quad C(0,\xi)=C_{0}(\xi),\,\xi\in\mathcal{O},\end{array}\right. where \mathcal{O} is an open, connected, bounded domain representing the aquatic body. The C is the concentration level of m_{1} different organic and inorganic agents such as pollutants and nutrients. The third term on the left of the first equation ( 1.3 ) represents the transport of C due to water movement, where v is given velocity as a function of space-time. The function b represents the interactions between m_{2} different control agents u and the m_{1} different pollutants and nutrients C . The N_{C} is the distributed noise representing the additive effect of randomness, such as land run-offs from surrounding farmlands, acid rain, accidental oil spills, and summer cottages, etc. The aquatic system supports diverse species, including microorganisms and fish populations, where the stock of fish is regulated by the Department of Fisheries. The biomass per unit volume of m_{3} different species of population y is governed by (1.4) dy=h(C,y)dt+N_{y},\quad y(0)=y_{0},t\geq 0 where h(C,y) represents the growth of the species and N_{y} accounts for random environmental factors. For example, the function h can take a standard logistic growth function. Regulatory agencies, such as the Department of Fisheries and Environments, are interested in seeking optimal strategies to maintain water quality and promote marine life, e.g. by applying antipollutants, biological agents predating unwanted microorganisms, physical removal of solid water, algae, etc. They would like to minimize their cost functional to achieve goals. For the formulation of ( 1.3 ) as an SPDE ( 1.1 ) and its corresponding partially observed optimal control problem, we refer to [ 2 , pp. 1593-1597] . Another example from electromagenetic interference control problem can also be found in [ 2 ] . The primary challenge of partially observed control problem is that the control process must be adapted to the observation filtration, while observations depends on controlled process, leading to circular dependency. To overcome this difficulty, we use the measure transformation approach to introduce (1.5) M(t):=\exp\Big\{\int_{0}^{t}h(X(s))dY(s)-\frac{1}{2}\int_{0}^{t}|h(X(s))|^{2}ds\Big\}, where h is bounded continuous mapping from H to {\mathbb{R}}^{d} . Then M(t) is the unique solution to stochastic ordinary differential equations (SODEs): (1.6) dM(t)=M(t)h(X(t))dY(t),\quad M(0)=1. Define a new measure {\mathbb{Q}} by \begin{array}[]{rl}&\!\displaystyle\frac{d{\mathbb{Q}}}{d{\mathbb{P}}}\Big|_{{\mathcal{F}}_{T}}:=M(T)\end{array} It follows from Girsanov’s theorem [ 23 ] that W(\cdot) and B(\cdot) are cylindrical Wiener process and Brownian motions in {\mathbb{R}}^{d} , resepectively, in the new probability space (\Omega,{\mathcal{F}},\{{\mathcal{F}}_{t}\}_{t\in[0,T]},{\mathbb{Q}}) . We would like to remark that we have considered Y a prior as a Wiener process in (\Omega,{\mathcal{F}},\{{\mathcal{F}}_{t}\},{\mathbb{P}}) , rather than B from modeling perspective; see [ 39 ] . The cost functional is given by (1.7) \begin{array}[]{ll}J(u)&\!\displaystyle={\mathbb{E}}^{\mathbb{Q}}\Big[\int_{0}^{T}L(X(t),u(t))dt+\Phi(X(T))\Big]\\ &\displaystyle={\mathbb{E}}^{\mathbb{P}}\Big[\int_{0}^{T}M(t)L(X(t),u(t))dt+M(T)\Phi(X(T))\Big],\end{array} for running cost functional L:H\times U\to{\mathbb{R}} and terminal cost \Phi:H\to{\mathbb{R}} , where {\mathbb{E}}^{\mathbb{Q}} and {\mathbb{E}}^{\mathbb{P}} represents expectation on (\Omega,{\mathcal{F}},\{{\mathcal{F}}_{t}\}_{t\in[0,T]},{\mathbb{Q}}) and (\Omega,{\mathcal{F}},\{{\mathcal{F}}_{t}\}_{t\in[0,T]},{\mathbb{P}}) , respectively. Throughout the paper, we take {\mathbb{E}} as {\mathbb{E}}^{\mathbb{P}} if there is no specification. The control problem is to minimize J(u) defined ( 1.7 ) subject to ( 1.1 ) and ( 1.6 ). That is, Problem : find u^{\star}\in\mathcal{U}_{ad}[0,T] such that (1.8) J(u^{\star})=\inf_{u\in\mathcal{U}_{ad}[0,T]}J(u). where \mathcal{U}_{\text{ad}}[0,T] is the set of admissible controls defined as (1.9) \mathcal{U}_{ad}[0,T]=\{u:[0,T]\times\Omega\to U|u\text{ is }{\mathcal{F}}^{Y}\text{-progressively measurable}\}. The primary objective

Read the complete text