The Dark Side of Digital Twins: Adversarial Attacks on AI-Driven Water Forecasting

Mohammadhossein Homaei, Víctor González Morales, Óscar Mogollón-Gutiérrez, Andrés Caro · 2025

Read The Dark Side of Digital Twins: Adversarial Attacks on AI-Driven Water Forecasting by Mohammadhossein Homaei, Víctor González Morales, Óscar Mogollón-Gutiérrez, Andrés Caro (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-20295.txt.

Introduction

Mohammadhossein Homaei and co-authors attack the digital twin of a Spanish water network to expose how fragile AI forecasting can be. Digital twins mirror real systems and predict demand live. Their learning models, though, can be fooled by crafted inputs.

The twin uses a memory network to forecast water use. Standard gradient attacks nudge inputs to spoil forecasts. The team adds learning automata that tune the attack on the fly. Adaptive tweaks make the sabotage harder to spot. Forecast error climbed steeply under the combined assault. Prediction reliability fell across the tested scenarios. The authors urge defenses before twins run real utilities. Water systems are critical infrastructure worth protecting.

Catalog record

CREATORMohammadhossein Homaei, Víctor González Morales, Óscar Mogollón-Gutiérrez, Andrés Caro
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-20295

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Dark Side of Digital Twins: Adversarial Attacks on AI-Driven Water Forecasting Mohammadhossein Homaei, Víctor González Morales, Óscar Mogollón-Gutiérrez, Andrés Caro Abstract Digital twins (DTs) are improving water distribution systems by using real-time data, analytics, and prediction models to optimize operations. This paper presents a DT platform designed for a Spanish water supply network, utilizing Long Short-Term Memory (LSTM) networks to predict water consumption. However, machine learning models are vulnerable to adversarial attacks, such as the Fast Gradient Sign Method (FGSM) and Projected Gradient Descent (PGD). These attacks manipulate critical model parameters, injecting subtle distortions that degrade forecasting accuracy. To further exploit these vulnerabilities, we introduce a Learning Automata (LA) and Random LA-based approach that dynamically adjusts perturbations, making adversarial attacks more difficult to detect. Experimental results show that this approach significantly impacts prediction reliability, causing the Mean Absolute Percentage Error (MAPE) to rise from 26% to over 35%. Moreover, adaptive attack strategies amplify this effect, highlighting cybersecurity risks in AI-driven DTs. These findings emphasize the urgent need for robust defenses, including adversarial training, anomaly detection, and secure data pipelines. I Introduction Digital twin technology has emerged as a critical driver of digital transformation across various industries, playing a crucial role in improving the accuracy and efficiency of cyber-physical systems. One area where this technology has been widely adopted is in water distribution networks. DTs enable real-time and accurate simulations of physical systems, facilitating enhanced decision-making and optimization of operations. Through data-driven and automated processes, this technology helps industries increase operational efficiency and utilize resources more sustainably [ 1 , 2 ] . However, despite their many benefits, DTs are exposed to significant security challenges due to their complex structure and continuous connection to the internet. One of the most critical security threats is data and model poisoning, which can significantly compromise the performance of digital twin systems and lead to erroneous outcomes. Data poisoning involves manipulating input data that feeds into the system, while model poisoning involves tampering with ML models [ 3 , 4 ] . These threats pose serious risks, especially for systems that rely on ML models for prediction and optimization, as they can degrade the accuracy of forecasts and increase operational costs [ 5 ] . In this context, AML attacks, particularly FGSM, have demonstrated the ability to disrupt ML models [ 6 , 7 , 8 ] , and PGD [ 9 ] consists of the iterative application of FGSM. These attacks introduce small perturbations to input data, drastically reducing model accuracy and misleading prediction systems. Given that ML models such as LSTM networks are extensively used for water consumption forecasting in distribution networks, such attacks can significantly impact the efficiency and effectiveness of these systems [ 10 , 11 ] . This paper focuses on addressing the security challenges faced by DTs in water distribution networks and proposes innovative solutions to mitigate the risks of data and model poisoning. A security layer has been developed to safeguard the system against cyberattacks like FGSM and data poisoning, ensuring system integrity. The evaluation results demonstrate that the proposed platform improves the system’s accuracy and efficiency, reduces operational costs, and supports intelligent decision-making. These solutions are vital for ensuring the sustainability of water resources and advancing digital transformation in the water sector. I-A Objective of the Article This paper focuses on cybersecurity risks in DTs for water distribution networks, specifically in water consumption forecasting using time series data. It examines AML attacks, such as FGSM and PGD, and their impact on LSTM-based prediction models. To make attacks more complex and harder to detect, the study explores the use of LA. Additionally, it proposes mitigation strategies to strengthen DTs against data and model poisoning, improving system reliability, reducing costs, and supporting better decision-making in digital water management. Table I: DT Projects in Water Industry with AI/ML/DL and Their Vulnerabilities to Poisoning Attacks Project Data Used Model/Algorithm ML/AI/DL Techniques Vulnerability Possible Attack Vectors Mitigation Strategies Ciliberti et al. (2021) Pressure, flow, and asset data AI models for leak detection, optimization ML/AI for DMA optimization High Data poisoning of asset management systems Data integrity verification, encrypted data channels Bonilla et al. (2022) Real-time pressure and flow rate data GCNs AI/ML for hydraulic state estimation High Data poisoning of real-time pressure and flow data Data validation techniques, secure data pipelines Zekri et al. (2022) IoT sensor data, asset operation data Multi-Agent Systems, AI-driven agents Multi-agent reinforcement learning Moderate-High Model poisoning by corrupting reward system Robust reward functions, anomaly detection Matheri et al. (2022) Wastewater treatment sensor data Cyber-Physical Systems (CPS), AI optimization models AI/ML for predictive maintenance High Data poisoning via corrupted sensor data Secure real-time data transmission, predictive anomaly detection Ramos et al. (2022) Leakage detection, water usage data Optimization algorithms AI-driven optimization for water management Moderate Tampered leakage data poisoning Cryptographic methods for data validation Henriksen et al. (2022) Hydrological data, climate models ML Models ML for climate adaptation Moderate Tampered hydrological data affecting water management Redundant data sources, data quality audits Savic (2022) Water usage patterns AI anomaly detection models AI/ML for anomaly detection High Model poisoning via corrupted anomaly detection data AI model validation, adversarial training Pedersen et al. (2022) Water level sensors, drainage data Hydraulic models with DTs ML for error classification Moderate Data poisoning from water level sensors Redundant sensor validation, secure data transmission Valencia Smart Water (2023) SCADA, customer feedback Hydraulic models with real-time optimization AI/ML for pressure management Moderate Tampered sensor inputs poisoning Secure data transmission, blockchain verification Sabesp Digital Twin (2023) IoT sensor data, remote monitoring ML for anomaly detection AI/ML for fault detection High Data poisoning from faulty sensors or pump data manipulation Real-time anomaly detection, secure IoT devices Tarragona Water Consortium (2023) Hydraulic models, real-time sensors Live simulations for predictive maintenance ML for predictive maintenance Moderate Data manipulation through compromised sensors Redundant sensor data validation systems Smart Water Grid in Gaula (2023) Leakage detection, water usage data Digital twin with real-time optimization AI-driven optimization for water loss prevention Moderate-High Data poisoning from compromised sensors Blockchain-based validation, real-time monitoring Water Research Foundation AI/ML Project (2023) Utility performance data ML models for prediction AI/ML for performance optimization High Model poisoning via contaminated datasets Regular model audits, federated learning Menapace et al. (2024) Pressure sensor data GNNs DL/ML for pressure estimation High Data poisoning through compromised sensor data Data cross-validation, hybrid training with anomaly detection I-B Paper Structure This paper is structured as follows: Section II reviews related work and the motivation behind addressing cybersecurity in WDS. Section III presents the proposed DT platform and forecasting models. Section IV analyzes the impact of FGSM-based AML attacks on LSTM models. Section V applies the FGSM attack and evaluates forecasting accuracy. Section VI introduces a Learning Automata-based FGSM attack to improve stealth. Section VII proposes a Random Learning Automata strategy to enhance unpredictability. Section VIII discusses DT vulnerabilities and mitigation strategies. Finally, Section IX concludes the paper and outlines future directions. II Related Works and Motivation II-A Related Works The increasing reliance on AI and ML in water distribution networks has led to significant advancements in digital twin technology. However, these AI-driven systems also introduce cybersecurity vulnerabilities, particularly AML threats. Several studies have investigated

Read the complete text