Probabilistic multivariate statistical process control via kernel parameter uncertainty propagation

Zina-Sabrina Duma, Victoria Jorry, Ayesha Sarfraz, Maria Paola di Crosta, Tuomas Sihvonen, Lassi Roininen, Satu-Pia Reinikainen · 2026

Read Probabilistic multivariate statistical process control via kernel parameter uncertainty propagation by Zina-Sabrina Duma, Victoria Jorry, Ayesha Sarfraz, Maria Paola di Crosta, Tuomas Sihvonen, Lassi Roininen, Satu-Pia Reinikainen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19055.txt.

Introduction

Duma and co-authors add doubt tracking to kernel-based process monitoring for factories. Kernel methods catch nonlinear faults, but their settings are often picked by rule of thumb and frozen. That can make alarm limits too sure and unstable. Their two-stage method first tunes the kernel, then samples its settings in a Bayesian way. The samples flow through the monitor to yield charts with doubt bands. On a standard chemical process bench, mean-based charts often spot faults better than fixed ones for one kernel type.

Catalog record

CREATORZina-Sabrina Duma, Victoria Jorry, Ayesha Sarfraz, Maria Paola di Crosta, Tuomas Sihvonen, Lassi Roininen, Satu-Pia Reinikainen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62877
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.19055

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Probabilistic multivariate statistical process control via kernel parameter uncertainty propagation Zina-Sabrina Duma, Victoria Jorry, Ayesha Sarfraz, Maria Paola di Crosta, Tuomas Sihvonen, Lassi Roininen, Satu-Pia Reinikainen Abstract Kernel-based multivariate statistical process control (K-MSPC) extends classical monitoring to nonlinear industrial processes. Its performance depends critically on kernel parameters such as lengthscales and variance terms. In current practice these parameters are typically selected by heuristics or deterministic optimisation, and then treated as fixed, despite being inferred from finite and noisy data. This can lead to overconfident control limits and unstable alarm behaviour when the kernel choice is uncertain. This work proposes a probabilistic K-MSPC framework that quantifies and propagates kernel parameter uncertainty to the monitoring statistics. The approach follows a two-stage workflow: (i) deterministic kernel calibration using supervised or unsupervised models, and (ii) Bayesian inference of kernel parameters via Markov chain Monte Carlo. Posterior samples are propagated through kernel Principal Component Analysis to produce probabilistic T 2 T^{2} and squarred prediction error control charts, together with uncertainty-aware contribution plots. The framework is evaluated on the Tennessee Eastman Process benchmark. Results show that posterior-mean monitoring often improves fault detection compared to deterministic prior-mean charts for the squared exponential kernel, while credible bands remain narrow in-control and widen under faults, reflecting amplified epistemic uncertainty in abnormal regimes. The automatic relevance determination kernel reduces posterior uncertainty and yields performance close to the deterministic baseline, whereas unsupervised calibration produces wider posterior bands but still robust fault detection. 1 Introduction Modern industrial plants are increasingly instrumented with high-frequency, high-dimensional measurements, creating a strong need for reliable data-driven monitoring methods that can detect abnormal operating conditions early and support diagnosis [ 27 ] . Multivariate statistical process control (MSPC) remains a cornerstone in this space, where latent-variable models such as principal component analysis (PCA) translate multivariate measurements into low-dimensional monitoring statistics and corresponding control charts, typically Hotelling’s T^{2} and squared prediction error (SPE) indicators, for fault detection and interpretation [ 18 , 24 ] . In contemporary manufacturing settings, MSPC is frequently embedded within broader “data science for operations” and Industry 4.0 initiatives, where statistical process control and related monitoring practices are combined with modern analytics workflows [ 29 ] . While classical MSPC based on PCA has proven effective for many industrial applications, its linear structure limits its ability to capture complex nonlinear relationships commonly encountered in modern processes [ 34 ] . To address this limitation, nonlinear extensions such as Kernel PCA (K-PCA) are introduced by mapping data into a high-dimensional reproducing kernel Hilbert space (RKHS), where linear projections correspond to nonlinear structures in the original space [ 34 ] . Kernel-based MSPC (K-MSPC) has since demonstrated improved fault detection capabilities in processes exhibiting nonlinear dynamics, multimodality, and complex interactions [ 20 , 19 , 40 ] . However, this increased modelling flexibility introduces an additional layer of complexity: the selection of kernel parameters [ 36 ] , such as the length scale and variance parameters in radial basis function kernels. These parameters directly influence the geometry of the feature space, the variance captured by principal components, and ultimately the sensitivity of T^{2} and SPE monitoring statistics [ 37 ] . In most existing K-MSPC studies, kernel parameters are selected using heuristic rules (e.g., median distance criteria), cross-validation, or deterministic optimisation procedures [ 1 , 9 ] . Once chosen, they are treated as fixed quantities, and subsequent monitoring proceeds under the implicit assumption that the selected kernel represents the true data-generating structure. Optimisation procedures such as gradient-based methods, genetic algorithms, or heuristic selection rules yield point estimates that are subsequently treated as fixed and certain [ 28 ] . However, kernel parameters are not directly observable quantities; they are inferred from finite and often noisy training data. As such, they are subject to epistemic uncertainty arising from limited sample size, model misspecification, and optimisation landscape nonconvexity. Ignoring this uncertainty has important implications for statistical process monitoring. The geometry of the kernel feature space — and therefore the eigenstructure of the K-PCA model — depends sensitively on the chosen parameters. Small variations in the lengthscale, for instance, can significantly alter the variance distribution between the retained principal subspace and the residual space [ 9 ] . Consequently, control limits derived from deterministic kernel estimates may be overconfident, potentially underestimating variability under normal conditions or mischaracterising fault persistence. This can manifest as unstable alarm behaviour, inflated false alarms, or premature return-to-normal indications in control charts. In other words, while K-MSPC extends linear MSPC to nonlinear settings, it inherits a hidden layer of uncertainty that remains unquantified in standard practice. To address this limitation, the objective of this work is to develop a probabilistic kernel-based multivariate statistical process control framework that explicitly quantifies and propagates uncertainty in kernel parameters to monitoring statistics. Rather than treating kernel parameters as fixed point estimates, we model them as random variables and infer their posterior distributions using Bayesian techniques. The resulting uncertainty is then propagated through the Kernel PCA model to obtain probabilistic control charts for both the T^{2} and SPE statistics, as well as for their corresponding variable contribution diagnostics. By embedding kernel calibration within a Bayesian inference framework, the proposed approach enables monitoring decisions that reflect epistemic uncertainty in model structure. This leads to control charts that not only signal faults but also quantify confidence in detection and attribution, thereby enhancing robustness, interpretability, and reliability in nonlinear process monitoring. 1.1 Our contribution This work is a direct continuation of Duma et al. (2026) [ 9 ] , which addressed deterministic kernel calibration for K-MSPC through supervised and procedural optimisation. The present paper addresses the complementary question left open there: how uncertainty in the calibrated kernel parameters propagates to monitoring statistics, control limits, and contribution diagnostics. The main contribution of this paper is: 1. Process monitoring using control charts is more accurate under uncertain and nonlinear conditions, thereby enhancing industrial quality yield and productivity. This contribution is achieved by the following sub-contributions: 1. We propose a two-stage probabilistic calibration framework for K-MSPC. In the first stage, kernel parameters are estimated deterministically using both supervised and unsupervised strategies. The supervised route employs intermediary classification or regression models (Gaussian process classification, GPC [ 23 ] , and Kernel PCR [ 9 ] ) optimised via gradient-based and derivative-free methods, while the unsupervised route evaluates a suite of kernel-selection criteria tailored to healthy-operation data. This stage provides informed prior means for subsequent Bayesian inference. 2. We introduce Bayesian sampling of kernel parameters using Markov chain Monte Carlo (MCMC) methods, including adaptive Metropolis (AM) [ 14 ] , delayed rejection adaptive Metropolis (DRAM) [ 13 ] , Hamiltonian Monte Carlo (HMC) [ 4 ] , and the No-U-Turn Sampler (NUTS) [ 16 ] . This enables posterior inference over kernel lengthscales and variance parameters rather than reliance on single-point estimates. 3. We formulate probabilistic T^{2} and SPE control charts by propagating posterior uncertainty through the Kernel PCA monitoring framework. In addition to probabilistic monitoring statistics, we derive uncertainty-aware contribution plots, allowing variable attribution to be expressed together with credible intervals. The proposed framework differs conceptually from three related research directions. First, while Bayesian inference of kernel parameters is well established in Gaussian process modelling, existing

Read the complete text