Uncertainty-Aware Deep Learning Framework for Remaining Useful Life Prediction in Turbofan Engines with Learned Aleatoric Uncertainty

Krishang Sharma · 2025

Read Uncertainty-Aware Deep Learning Framework for Remaining Useful Life Prediction in Turbofan Engines with Learned Aleatoric Uncertainty by Krishang Sharma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-19124.txt.

Introduction

Krishang Sharma tackles a practical safety problem: guessing how much useful life is left in a turbofan jet engine before it fails. His system also reports how unsure the guess is, by learning the noise built into the sensor data itself. The design mixes pattern blocks that scan at several time scales, memory networks that track sequences, and attention that weighs both sensors and time steps.

Tests use the NASA CMAPSS engine data sets, a standard benchmark in this field. Overall accuracy is competitive with earlier work, but the clear gain comes in the final stretch of engine life, where errors fall by roughly a quarter to two fifths. Calibrated confidence ranges make those late-life warnings more trustworthy for maintenance decisions.

Catalog record

CREATORKrishang Sharma
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-19124

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Uncertainty-Aware Deep Learning Framework for Remaining Useful Life Prediction in Turbofan Engines with Learned Aleatoric Uncertainty Krishang Sharma Abstract Accurate Remaining Useful Life (RUL) prediction coupled with uncertainty quantification remains a critical challenge in aerospace prognostics. This research introduces a novel uncertainty-aware deep learning framework that learns aleatoric uncertainty directly through probabilistic modeling—an approach unexplored in existing CMAPSS-based literature. Our hierarchical architecture synergistically integrates multi-scale Inception blocks for temporal pattern extraction, bidirectional Long Short-Term Memory networks for sequential modeling, and a dual-level attention mechanism operating simultaneously on sensor and temporal dimensions. The innovation lies in the Bayesian output layer that predicts both mean RUL and variance, enabling the model to learn data-inherent uncertainty. Comprehensive preprocessing employs condition-aware clustering, wavelet denoising, and intelligent feature selection. Experimental validation on NASA CMAPSS benchmarks (FD001-FD004) demonstrates competitive overall performance with RMSE values of 16.22, 19.29, 16.84, and 19.98 respectively. Remarkably, our framework achieves breakthrough critical zone performance (RUL ≤ \leq 30 cycles) with RMSE of 5.14, 6.89, 5.27, and 7.16—representing 25-40% improvements over conventional approaches and establishing new benchmarks for safety-critical predictions. The learned uncertainty provides well-calibrated 95% confidence intervals with coverage ranging from 93.5% to 95.2%, enabling risk-aware maintenance scheduling previously unattainable in CMAPSS literature. I Introduction I-A Background and Motivation Contemporary aerospace systems demand sophisticated prognostic capabilities to prevent catastrophic failures while optimizing operational costs. Remaining Useful Life (RUL) prediction—the estimation of operational time until system maintenance becomes necessary—serves as the cornerstone of modern Prognostics and Health Management (PHM) systems. Traditional physics-based modeling approaches require extensive domain expertise and substantial computational resources, while emerging data-driven methodologies leverage historical sensor streams for intelligent pattern recognition. Deep learning has fundamentally transformed RUL prediction through automated feature extraction from high-dimensional multivariate sensor data. However, critical limitations persist in current approaches: absence of uncertainty quantification prevents risk-aware decision making, performance degradation in critical failure zones compromises safety, and insufficient adaptation to multi-modal operating conditions reduces real-world applicability. I-B Problem Statement Given multivariate time-series sensor measurements from aircraft engines operating across diverse flight conditions, this research investigates: How can we simultaneously achieve accurate RUL predictions and quantify the inherent uncertainty in those predictions, particularly excelling in critical failure scenarios where safety is paramount? I-C Proposed Solution This work proposes a comprehensive uncertainty-aware framework featuring: • Sophisticated preprocessing pipeline integrating condition-aware clustering, wavelet-based denoising, and correlation-based feature selection • Hierarchical deep architecture combining multi-scale convolution, bidirectional recurrence, and dual-dimension attention mechanisms • Novel Bayesian output layer learning aleatoric uncertainty through simultaneous mean and variance prediction • RUL-aware loss function emphasizing accuracy in critical operational zones I-D Key Contributions Our primary contributions include: 1. A hierarchical deep learning architecture integrating multi-scale temporal convolution, bidirectional LSTM, and novel dual-level attention operating on both sensor and temporal dimensions 2. Bayesian uncertainty quantification learning aleatoric uncertainty directly—an approach unexplored in CMAPSS literature—enabling risk-aware maintenance decisions 3. Breakthrough critical zone performance (RUL \leq 30) achieving RMSE values of approximately 5-7 cycles across all datasets, representing 25-40% improvements over existing methods and establishing new benchmarks 4. Comprehensive evaluation demonstrating well-calibrated 95% confidence intervals with actual coverage of 93.5-95.2% across all datasets I-E Organization The remainder of this manuscript is organized as follows. Section II critically reviews related work and identifies research gaps. Section III comprehensively details our proposed methodology encompassing preprocessing strategies and architectural design. Section IV describes experimental setup and implementation specifics. Section V presents quantitative results with comparative analysis. Section VI concludes with limitations and future research directions. II Related Work II-A Background and Dataset RUL prediction methodologies have evolved from classical physics-based models through traditional machine learning to contemporary deep learning approaches. The NASA Commercial Modular Aero-Propulsion System Simulation (CMAPSS) dataset has emerged as the standard benchmark for evaluating prognostic algorithms, providing multivariate sensor data from simulated turbofan engine degradation under varying operational conditions. II-B Existing Deep Learning Approaches LSTM-based Methods: Early recurrent approaches established baselines for temporal modeling. Bidirectional LSTM implementations achieved RMSE values of 17.60, 29.67, 17.62, and 31.84 on FD001-FD004 respectively. While effective for capturing temporal dependencies, these architectures lacked multi-scale feature extraction capabilities and uncertainty quantification. CNN-LSTM Hybrid Models: Combining convolutional and recurrent architectures demonstrated improved performance. CNN-LSTM-Attention models achieved RMSE of 15.98, 14.45, 13.91, and 16.64 across the four subsets, illustrating benefits of hierarchical feature learning with attention mechanisms for focusing on relevant temporal patterns. Convolutional Autoencoder Approaches: The CAELSTM (Convolutional Autoencoder with Attention-based LSTM) hybrid model demonstrated strong results on simpler datasets, achieving RMSE values of 14.44 and 13.40 for FD001 and FD003 respectively, through dimensionality reduction combined with attention-weighted sequence modeling. Advanced Attention Mechanisms: Attention-based GRU (ABGRU) algorithms integrated seq2seq modeling with feature fusion, achieving RMSE values of 12.83 and 13.23 for FD001 and FD003. These approaches highlighted the importance of dynamic feature weighting but remained limited to simpler single-condition datasets. Temporal Convolutional Networks: TCN-based architectures with attention mechanisms demonstrated efficiency in capturing long-range dependencies. The TCRSCANet model employed temporal convolution with recurrent skip connections, while FTT-GRU combined Fast Temporal Transformers with GRU layers, achieving RMSE of 30.76 on FD001 with computational efficiency advantages. Multi-Scale Temporal Methods: Recent work on Multi-scale Temporal-Gated Attention (MTGA) integrated multi-scale temporal CNNs with GRU and improved self-attention, demonstrating 19-25% RMSE reductions through adaptive feature weighting based on degradation relevance. Transformer-based Methods: State-of-the-art transformer approaches achieved exceptional RMSE values of 11.36 and 11.28 on FD001 and FD003, demonstrating superior performance on single-condition datasets through global attention mechanisms, though at significant computational cost limiting real-time deployment feasibility. II-C Critical Research Gaps Comprehensive analysis of existing literature reveals persistent limitations: • Absence of Uncertainty Quantification: Current CMAPSS literature predominantly provides deterministic point estimates without confidence measures. No existing work learns aleatoric uncertainty directly through probabilistic output layers, preventing risk-aware maintenance scheduling. • Critical Zone Performance Deficiency: Reported results focus on overall RMSE without detailed critical zone analysis. Literature lacks explicit reporting of performance metrics for RUL \leq 30 cycles, where prediction accuracy is most crucial for safety. Our analysis indicates existing methods achieve critical zone RMSE values exceeding 8-12 cycles. • Operating Condition Adaptation: Many high-performing methods demonstrate strong results on single-condition datasets (FD001, FD003) but struggle with multi-modal operational regimes (FD002, FD004), limiting practical applicability. • Computational Complexity Trade-offs: Transformer-based approaches achieving lowest overall RMSE require extensive computational resources (2M+ parameters), compromising real-time deployment in resource-constrained aerospace environments. II-D Our Approach Compared to Literature The framework addresses identified gaps through: (1) Bayesian uncertainty quantification with learned aleatoric uncertainty—unexplored in CMAPSS literature; (2) RUL-aware loss weighting achieving breakthrough critical zone RMSE of approximately 5-7 cycles, establishing new benchmarks; (3) condition-aware preprocessing with operating condition encoding ensuring robust multi-modal performance; (4) efficient hierarchical architecture (487K parameters) balancing accuracy with deployment feasibility. III Proposed Methodology Our framework comprises three integrated stages: intelligent data preprocessing, hierarchical feature extraction, and probabilistic prediction with learned uncertainty quantification. III-A System Architecture Overview Figure 1 illustrates the complete pipeline from raw sensor data to probabilistic RUL predictions with uncertainty bounds. The architecture synergistically combines preprocessing modules, multi-scale feature extraction, temporal modeling, attention mechanisms, and Bayesian output layers. Fig. 1: Complete system architecture showing the three-stage pipeline: (1) Preprocessing with feature selection, wavelet denoising, and condition-aware normalization, (2) Hierarchical feature extraction through multi-scale CNN, bidirectional LSTM, and dual-level attention,

Read the complete text