Trustworthy and Explainable Deep Reinforcement Learning for Safe and Energy-Efficient Process Control: A Use Case in Industrial Compressed Air Systems

Vincent Bezold, Patrick Wagner, Jakob Hofmann, Marco Huber, Alexander Sauer · 2025

Read Trustworthy and Explainable Deep Reinforcement Learning for Safe and Energy-Efficient Process Control: A Use Case in Industrial Compressed Air Systems by Vincent Bezold, Patrick Wagner, Jakob Hofmann, Marco Huber, Alexander Sauer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18317.txt.

Introduction

Vincent Bezold leads a five author team putting a learning controller in charge of factory air compressors, with proof it can be trusted. Compressed air eats a large share of plant power, and set rules often keep pressure higher than needed. Their reinforcement learning policy runs the system under real limits while saving energy.

A three layer checking kit probes the policy with tweaked inputs, slope tests, and feature credit scores, so staff can see why it acts. Across several compressor setups the policy stayed within safe bounds, looked ahead to coming demand, and cut energy by about 4 percent against the plant's own controller. Pressure and forecast data drove most calls, an honest pattern engineers can accept.

Catalog record

CREATORVincent Bezold, Patrick Wagner, Jakob Hofmann, Marco Huber, Alexander Sauer
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-18317

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Trustworthy and Explainable Deep Reinforcement Learning for Safe and Energy-Efficient Process Control: A Use Case in Industrial Compressed Air Systems Vincent Bezold, Patrick Wagner, Jakob Hofmann, Marco Huber, Alexander Sauer Abstract This paper presents a trustworthy reinforcement learning approach for the control of industrial compressed air systems. We develop a framework that enables safe and energy-efficient operation under realistic boundary conditions and introduce a multi-level explainability pipeline combining input perturbation tests, gradient-based sensitivity analysis, and SHAP (SHapley Additive exPlanations) feature attribution. An empirical evaluation across multiple compressor configurations shows that the learned policy is physically plausible, anticipates future demand, and consistently respects system boundaries. Compared to the installed industrial controller, the proposed approach reduces unnecessary overpressure and achieves energy savings of approximately 4 % without relying on explicit physics models. The results further indicate that system pressure and forecast information dominate policy decisions, while compressor-level inputs play a secondary role. Overall, the combination of efficiency gains, predictive behavior, and transparent validation supports the trustworthy deployment of reinforcement learning in industrial energy systems. [type=editor, auid=000, bioid=1, orcid=0009-0006-4430-4710] [type=editor, auid=000, bioid=2, orcid=] [type=editor, auid=000, bioid=3, orcid=0009-0004-0871-8444] [type=editor, auid=000, bioid=4, orcid=0000-0003-3413-6291] [type=editor, auid=000, bioid=4, orcid=0000-0003-3822-1514] {graphicalabstract} † † highlights: Interpretable deep RL for safe and efficient compressed air system control. Multi-level explainability with SHAP, sensitivity, and perturbation tests. Physically plausible and predictive policy respecting system boundaries. keywords Deep Reinforcement Learning ,Trustworthy Artificial Intelligence ,Explainable Artificial Intelligence ,Safe Reinforcement Learning ,Industrial Process Control ,Compressed Air Systems ,Explainability ,SHAP † † credit: Data Curation, Methodology, Software, Validation, Visualization, Writing – Original Draft Preparation, Writing – Review & Editing † † credit: Methodology, Writing – Review & Editing † † credit: Data Curation, Methodology, Software, Validation † † credit: Funding Acquisition, Project Administration, Resources, Writing – Review & Editing † † credit: Funding Acquisition, Project Administration, Resources, Writing – Review & Editing † † corresponding: Corresponding author 1 Introduction Compressed air systems are integral to many industrial processes and account for a significant share of electricity consumption in manufacturing environments [ 32 , 38 ] . Optimizing their operation is crucial for reducing energy demand, improving reliability, and enabling adaptive production planning [ 32 ] . Conventional control strategies, such as rule-based logic and model predictive control, often struggle with the nonlinear dynamics, component switching, and load variability inherent in multi-compressor systems [ 15 ] . Reinforcement learning (RL) has emerged as a promising alternative, capable of learning adaptive control policies directly from interaction data [ 42 ] . It has shown success across diverse domains including robotics, games, recommendation systems, and language model fine-tuning through human feedback [ 8 , 24 , 34 ] . However, the adoption of RL in industrial control remains limited. Key concerns include the black-box nature of deep RL agents, sensitivity to distributional shift, and a lack of verifiability [ 7 , 13 , 17 ] . Another fundamental challenge is the data-hungry and exploratory nature of RL, which makes learning directly on physical systems impractical or even infeasible due to safety and reliability concerns [ 19 ] . As a result, simulation environments are typically required to enable agent training before deployment in real-world applications. To address the issues of opacity and lack of trust in learned policies, the field of explainable artificial intelligence (XAI) has developed a variety of methods that enhance the transparency and interpretability of complex machine learning models, including RL agents. These techniques provide systematic ways to understand, validate, and build confidence in agent behavior, which is crucial for industrial deployment. In this work, we investigate deterministic RL agents for compressor control with a focus on physical plausibility, interpretability, and policy transparency. We introduce a structured evaluation framework that combines input perturbation tests, gradient-based sensitivity analysis, and post hoc explainability using SHAP (SHapley Additive exPlanations) [ 3 , 27 ] . This enables us to systematically assess both the decision quality and the internal reasoning of the policy across a wide range of operating conditions [ 29 ] . We evaluate our approach across multiple compressor setups and show that the RL agent learns to anticipate demand, operate within system constraints, and reduce energy use without relying on handcrafted control models [ 1 , 6 ] . While these results support the viability of RL for industrial control, further research is needed to ensure robustness under rare and adversarial scenarios before deployment in safety-critical systems can be fully endorsed. 2 Related Work Reinforcement learning has become a core methodology in modern artificial intelligence, with applications ranging from robotics and game-playing to energy systems and natural language processing [ 42 , 24 , 34 ] . Deep reinforcement learning (DRL), in particular, enables scalable policy optimization in complex environments with high-dimensional inputs and nonlinear dynamics. Compressed Air and Industrial Systems: Compressed air systems have recently received increased attention in the RL community due to their high energy demand and control complexity. 45 integrate interval type-2 fuzzy logic with DRL to improve robustness under uncertainty. 11 combine imitation learning and primal-dual optimization for safe control of compressed air energy storage. 25 propose a hierarchical RL controller for multi-compressor coordination that explicitly accounts for component degradation. Cross-Domain Applications: In related domains, DRL has been applied to HVAC (Heating, Ventilation, and Air Conditioning) systems, microgrids, and manufacturing processes. For instance, 2 apply the Deep Deterministic Policy Gradient (DDPG) algorithm to HVAC demand response. 12 use RL to coordinate hybrid microgrid storage. General industrial applications are covered by 18 and 36 . In the mobility domain, 43 propose an RL-based energy management strategy for hybrid electric vehicles. Furthermore, large-scale deployments such as DeepMind’s use of RL to optimize data center cooling have demonstrated real-world impact and up to 40% efficiency gains [ 16 ] . Explainability and Trustworthiness: As DRL policies are inherently complex and nonlinear, explainability becomes essential for trust and deployment. A variety of approaches have been proposed, including gradient-based analysis, surrogate modeling, and model-agnostic feature attribution. Among the latter, SHAP (SHapley Additive exPlanations) has gained popularity due to its theoretical grounding and flexibility [ 27 ] . 35 use DeepSHAP to interpret DRL scheduling agents. 40 survey post hoc and intrinsic explainability methods in RL, including SHAP and feature saliency maps. 5 and 21 propose inherently interpretable surrogates such as differentiable decision trees and symbolic rule tables. While promising, these methods may only generalize well in dense regions of the training data, with reduced reliability under distributional shift. Safe and Predictive Control: Several works incorporate safety into RL via control-theoretic constraints or hybrid architectures. 9 embed Control Lyapunov and Barrier Functions into Soft Actor-Critic (SAC) agents to ensure formal safety guarantees. 4 hybridize PID control with DRL for enhanced robustness. Model Predictive Control (MPC) has also been combined with DRL, as in 33 and 30 , who use Koopman-based dynamics to improve DRL-enhanced MPC. Verification and Generalization: Verification tools for DRL include reachability analysis, model checking, and adversarial testing. 23 provide a survey of such techniques. 28 promote multi-objective optimization to balance efficiency and robustness. 44 apply offline RL for safe and efficient cooling control in data centers, using physics-informed constraints. Positioning: These contributions demonstrate DRL’s increasing maturity across domains, including energy and industrial control. However, explainability

Read the complete text