Adaptive Sensor Steering Strategy Using Deep Reinforcement Learning for Dynamic Data Acquisition in Digital Twins

Collins O. Ogbodo, Timothy J. Rogers, Mattia Dal Borgo, David J. Wagg · 2025

Read Adaptive Sensor Steering Strategy Using Deep Reinforcement Learning for Dynamic Data Acquisition in Digital Twins by Collins O. Ogbodo, Timothy J. Rogers, Mattia Dal Borgo, David J. Wagg (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-10248.txt.

Introduction

Collins Ogbodo, Timothy Rogers, Mattia Dal Borgo, and David Wagg teach a digital twin to move its own sensors to wherever they help most, in a 2025 paper. A digital twin mirrors a physical structure and is only as good as the data fed into it. Sensors placed once cannot follow changing conditions like new damage. The team instead frames sensor placement as a sequence of decisions and trains a reinforcement learning agent to reposition sensors as the structure evolves.

Case studies on a cantilever plate, in healthy and damaged states, show the agent learning to chase informative locations. Data quality improved, and with it the twin's accuracy in mirroring the plate. The framework keeps the twin tightly representative of its physical counterpart over time. They present it as a step toward twins that manage their own measurement strategy rather than relying on a fixed layout.

Catalog record

CREATORCollins O. Ogbodo, Timothy J. Rogers, Mattia Dal Borgo, David J. Wagg
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-10248

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Adaptive Sensor Steering Strategy Using Deep Reinforcement Learning for Dynamic Data Acquisition in Digital Twins Collins O. Ogbodo, Timothy J. Rogers, Mattia Dal Borgo, David J. Wagg Abstract This paper introduces a sensor steering methodology based on deep reinforcement learning to enhance the predictive accuracy and decision support capabilities of digital twins by optimising the data acquisition process. Traditional sensor placement techniques are often constrained by one-off optimisation strategies, which limit their applicability for online applications requiring continuous informative data assimilation. The proposed approach addresses this limitation by offering an adaptive framework for sensor placement within the digital twin paradigm. The sensor placement problem is formulated as a Markov decision process, enabling the training and deployment of an agent capable of dynamically repositioning sensors in response to the evolving conditions of the physical structure as represented by the digital twin. This ensures that the digital twin maintains a highly representative and reliable connection to its physical counterpart. The proposed framework is validated through a series of comprehensive case studies involving a cantilever plate structure subjected to diverse conditions, including healthy and damaged conditions. The results demonstrate the capability of the deep reinforcement learning agent to adaptively reposition sensors improving the quality of data acquisition and hence enhancing the overall accuracy of digital twins. A Preprint Keywords Digital Twins \cdot Reinforcement Learning \cdot Information Theory \cdot Design of Experiment \cdot Structural Health Monitoring. 1 Introduction The increasing complexity and multidisciplinary nature of engineering systems over the years has continuously motivated the development of new methods for analysis, monitoring, and optimisation. This increase has led to the emergence of digital technologies such as digital twins — a virtual replica of a physical asset that enables a bidirectional coupling between digital and physical spaces [ 1 ] . The digital twin paradigm provides opportunities across different engineering disciplines, including technical risk reduction and reduced cost of experiments in digital engineering, enhanced first-time yield and product optimisation in manufacturing, and improved system capability and operational availability in operation engineering [ 2 ] . In other fields like precision medicine, digital twins are utilised for patient-personalised medical care [ 3 ] and in geophysical science for estimation of ice sheet flow model parameters [ 4 ] . Digital twin systems are built from the integration of models and data using sophisticated algorithms, expert know-how, and digital connectivity, presenting significant predictive capability when compared to current technologies [ 5 ] . Within engineering systems, this integration involves the combination of physics-based and data-driven models for improved reliability of predictive results. Critical aspects such as continual validation and updating ensure that the virtual twin maintains a good representation of the physical system. To achieve this representation, digital twin systems assimilate streams of data from the physical asset in real or near real-time. While the decreasing cost of sensors and enhanced connectivity has made available a large amount of data, the quality of data assimilated by the digital twin is a key determinant of its predictive accuracy. Given this dependence, data used in the digital twin update process are expected to contain relevant patterns of interest, be characterised by low noise levels, and reproducible under the same circumstances [ 6 ] . To ensure the virtual representation is tailored to the behaviour of its physical counterpart, a critical part of the virtual-to-physical feedback flow of a digital twin is a dynamic data acquisition process. In scenarios where data are scarce, methods such as active learning and reinforcement learning can guide the collection of additional data that is most relevant to the digital twin’s objectives [ 7 ] . This work therefore presents a novel approach for the dynamic data acquisition process of digital twins using a sensor steering methodology based on deep reinforcement learning (DRL). Our proposed framework learns a sensor steering policy that is deployed online within the virtual space and decides on data acquisition strategies, particularly sensor location, to maximise the information content of acquired data. This approach extends the adaptability of digital twins to the changing behaviours of the physical asset [ 7 ] . This paper is organised as follows: Section 2 presents a review of previous related methodologies of sensor placement and their respective limitations within the digital twin paradigm. In Section 3 , the problem definition and mathematical abstractions via DRL are provided. Section 4 establishes how the proposed methodology integrates into the digital twin paradigm. Section 5 presents the results of the proposed strategy when applied to a cantilever plate structure. Finally, Section 6 summarises our main contributions, including limitations and future directions. 2 Background The problem of optimal sensor placement (OSP) has been well researched across multiple studies within structural dynamics [ 8 , 9 ] . The key aspects of OSP research are the evaluation criteria and optimisation algorithms [ 10 ] . The evaluation criteria align with specific monitoring objectives and effectively reflect the quality of the sensor placement solution, and the iterative search for optimal solutions is largely influenced by the selected criteria’s structure, which significantly impacts computational efficiency [ 10 ] . Different evaluation criteria have been extensively explored, some of which aim to optimise a prespecified objective, such as maximising a characteristic vibration signal, typically kinetic energy, which has been found to yield sub-optimal results due to its independence on the parameters being estimated [ 11 ] , modal kinetic energy [ 12 , 13 ] and driving point residues [ 14 , 15 ] . Other criteria are based on maximising modal identification metrics, like modal assurance criteria [ 16 ] and singular value decomposition ratio [ 17 ] , as well as information-based criteria such as information entropy [ 18 ] and mutual information [ 19 ] . A summary of these criteria is presented in Wang et al [ 10 ] with their respective merits and demerits. The optimisation algorithm, on the other hand, is the computational strategy adopted to either minimise or maximise the selected evaluation criteria, which is usually iterative. A number of optimisation algorithms have also been explored. Some of these are evolutionary algorithms, notably genetic algorithms, particle swarm optimisation, and simulated annealing [ 9 ] . Other heuristic algorithms such as the forward and backward sequential sensor placement (FSSP and BSSP) have also been successfully applied to obtain optimal locations [ 20 ] . Recent research has also explored data-driven approaches based on DRL within an optimisation formulation to search the placement space for optimal location. DRL was applied in Jabini & Johnson [ 21 ] to find the optimal location of two sensors in a base-isolated system with five degrees of freedom using a value-based deep Q-Network agent. Within the digital twin paradigm, where data assimilation and continuous updating are required, acquiring high-quality data is essential to ensure the digital twin maintains an accurate representation of the physical asset [ 5 ] . An essential stage of the digital twin life cycle is continuous validation against operational data, which ensures accuracy in prediction and decision support. This process is highly dependent on the data acquired at every stage of the operational lifespan of the physical asset (Figure 1 ). While existing sensor placement strategies are suitable for

Read the complete text