Domain Adaptation of Drag Reduction Policy to Partial Measurements
Anton Plaksin, Georgios Rigas · 2025
Read Domain Adaptation of Drag Reduction Policy to Partial Measurements by Anton Plaksin, Georgios Rigas (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-04309.txt.
Introduction
Anton Plaksin and Georgios Rigas wrote a 2025 paper on moving a drag-cutting control policy from full sensing to partial sensing. Fluid control needs rich, fast measurements that real setups rarely give. Simulations grant full state access, so learned policies lean on it. Real vehicles carry sensors only on the body.
Their test case cuts the drag of a simple road vehicle shape. A feature transfer map bridges the two sensing worlds. Reinforcement learning trained the full-state policy in the wake flow. The transfer then adapts it to body-only readings. The method may bring lab-grade control to real roads.
Catalog record
| CREATOR | Anton Plaksin, Georgios Rigas |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-04309
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Domain Adaptation of Drag Reduction Policy to Partial Measurements Anton Plaksin, Georgios Rigas Abstract Feedback control of fluid-based systems poses significant challenges due to their high-dimensional, nonlinear, and multiscale dynamics, which demand real-time, three-dimensional, multi-component measurements for sensing. While such measurements are feasible in digital simulations, they are often only partially accessible in the real world. In this paper, we propose a method to adapt feedback control policies obtained from full-state measurements to setups with only partial measurements. Our approach is demonstrated in a simulated environment by minimising the aerodynamic drag of a simplified road vehicle. Reinforcement learning algorithms can optimally solve this control task when trained on full-state measurements by placing sensors in the wake. However, in real-world applications, sensors are limited and typically only on the vehicle, providing only partial measurements. To address this, we propose to train a Domain Specific Feature Transfer (DSFT) map reconstructing the full measurements from the history of the partial measurements. By applying this map, we derive optimal policies based solely on partial data. Additionally, our method enables determination of the optimal history length and offers insights into the architecture of optimal control policies, facilitating their implementation in real-world environments with limited sensor information. 1 Introduction Feedback control of fluid-based engineering systems offers significant potential to improve energy efficiency in key sectors such as energy and transport, driving progress toward net-zero emissions. Recent breakthroughs in machine learning have greatly advanced the modeling, optimization, and control of fluid flows ( Duriez et al. 2016 ; Brunton et al. 2020 ; Rabault et al. 2020 ; Garnier et al. 2021 ; Sharma et al. 2023 ) . Despite these advancements, designing feedback control remains difficult due to the nonlinear, multiscale nature of fluid dynamics. Optimal control laws typically rely on a dense set of spatio-temporally resolved measurements—a requirement that is feasible in simulations but challenging to meet in real-world applications. In practice, sensor placement is often limited by technical constraints, resulting in only partial measurements being available. In this paper, we propose a framework to adapt feedback control policies, originally developed using full-state measurements, to realistic scenarios where only partial measurements are accessible due to real-world limitations. We demonstrate our approach in a simulated environment aimed at reducing the aerodynamic drag of road vehicles ( Sudin et al. 2014 ; Choi et al. 2014 ) . The simulations are conducted in two-dimensional direct numerical simulation (DNS) environments, where the flow dynamics are obtained by numerically solving the Navier-Stokes equations, and the vehicle is modeled as a simplified 2D bluff body with square geometry. Recent numerical studies ( Rabault et al. 2019 ; Rabault and Kuhnle 2019 ; Tang et al. 2020 ; Paris et al. 2021 ; Li and Zhang 2022 ; Chen et al. 2023 ) have successfully employed Reinforcement Learning (RL) ( Sutton and Barto 2018 ) algorithms to derive feedback control policies in such environments, demonstrating that jet actuators can stabilize the unsteadiness in the wake behind the body when full-state measurements in the wake are available. However, in realistic scenarios, control policies rely on the history of measurements on the vehicle (partial measurements), which presents a more complex optimization challenge, as in Xia et al. 2024 . In our paper, we address the intermediate scenario where full measurements behind the vehicle are available during the training stage, but only partial measurements are accessible during deployment. To bridge this gap, we propose a supervised learning method of Policy Domain Adaptation (PDA), which leverages a Domain-Specific Feature Transfer (DSFT) map ( Wei et al. 2018 ) to reconstruct full measurements from the history of partial measurements. This approach enables us to achieve the following results: • Taking the composition of the trained DSFT map and the optimal policy for the full measurement case, we obtain the optimal policy for the partial measurement case (see Fig. 2 a). • Without training a new policy, we analyze the PDA performance depending on the measurement history length and find the minimum length giving the optimal result (see Fig. 2 b). • Our research provides insights into the architecture of optimal policies for the partial measurement case (see Discussion and Limitations). Figure 1: Flow pressure fields with the jet actuators and measurement locations for the following cases: uncontrolled flow (a); the flow stabilized by the policies trained by TQC algorithm using wake measurements (b) and the measurement history from the body base (c); the flow stabilized by PDA policy ( 2 ) with n=48 and m=1 (d). 2 Preliminaries and Baselines The environment is a 2D direct numerical simulation (DNS) of a laminar flow past a square bluff body with Re=100 (see Fig. 1 a). The implementation is taken from Rabault et al. 2019 ; Rabault and Kuhnle 2019 and is based on FEniCS and the Dolfin library Logg et al. 2012 . The flow dynamics is calculated as a solution (v_{t}(\cdot),p_{t}(\cdot)) of the Navier-Stokes equation, where v_{t}(\cdot) is a velocity function and p_{t}(\cdot) is a pressure function. The flow exhibits vortex shedding in the wake, an instability which increases the drag. The body has two controllable jet actuators on the side edges which influence the vortex shedding. The task is to find a feedback policy that, taking certain measurements as input, reduces the drag of the body by stabilising the vortex shedding. The discrete-time task can be considered within the RL paradigm ( Sutton and Barto 2018 ) as a Markov Decision Process (MDP) (\mathcal{S},\mathcal{A},\mathcal{P},\mathcal{R},\gamma) , where \mathcal{S} is the space of all possible states s_{t}=(v_{t}(\cdot),p_{t}(\cdot),a_{t-1}) , \mathcal{A} is the space of two-dimensional actions a_{t}\in[-a_{*},a_{*}]^{2} defining a smooth change of the jet actuators’ force, \mathcal{P} is a transition function giving the next state s_{t+1}=(v_{t+1}(\cdot),p_{t+1}(\cdot),a_{t}) by the current state s_{t}=(v_{t}(\cdot),p_{t}(\cdot),a_{t-1}) and the current action a_{t} according to the Navier-Stokes equation, \mathcal{R} is a reward function giving the negative drag coefficient r_{t} , \gamma is a discount factor. Our aim is to find a policy maximizing the expectation of the total reward \sum_{t=0}^{\infty}\gamma^{t}r_{t} . It is important to note that the state space of this task is infinite-dimensional, making a direct solution highly challenging. However, previous studies ( Chen et al. 2023 ; Xia et al. 2024 ) have demonstrated that optimal performance can be achieved within the class of policies \pi(o^{FM}_{t},a_{t-1}) , where o^{FM}_{t} represents pressure measurements at specific discrete locations in the wake (see Fig. 1 b). In this paper, we replicate these findings and use the optimal policy \pi^{*}(o^{FM}_{t},a_{t-1}) as a baseline target for our approach (represented by the green line in Fig. 2 a). Although such policies solve the task optimally in simulations, learning them in real-world environments may be technically unfeasible due to the inability to access o^{FM}_{t} . A more realistic task is to find a policy that achieves optimal performance based only on pressure measurements obtained on the body base o^{PM}_{t} (see Fig. 1 c). Such problem can be considered (see, e.g., Bertsekas 2012 ) as a Partial Observed MDP (\mathcal{S},\mathcal{A},\mathcal{P},\mathcal{R},\Omega,\mathcal{O},\gamma) , where \Omega is a set of such measurements o^{PM}_{t} and \mathcal{O} is a function given o^{PM}_{t} by s_{t} . The paper of Xia et al. 2024 tackled this task by directly applying RL algorithms to find a policy \pi(o^{PM}_{t-n:t},a_{t-m:t-1})