Generative Modeling of Approximately Periodic Time Series by a Posterior-Weighted Gaussian Process

Elias Reich, Saverio Messineo, Stefan Huber · 2026

Read Generative Modeling of Approximately Periodic Time Series by a Posterior-Weighted Gaussian Process by Elias Reich, Saverio Messineo, Stefan Huber (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13150.txt.

Introduction

Reich, Messineo and Huber model nearly periodic time series, as produced by automated factory and cyber-physical processes. Each repeat follows a shared path but differs in length, size and fine detail. Strictly periodic models squash repeat-to-repeat differences, while non-periodic models miss the strong shared patterns. Their random generative model uses a Gaussian process with a novel kernel-tuned posterior, splitting within-repeat shape from between-repeat variation while keeping the mean curve the same across repeats.

Catalog record

CREATORElias Reich, Saverio Messineo, Stefan Huber
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34711
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.13150

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Generative Modeling of Approximately Periodic Time Series by a Posterior-Weighted Gaussian Process Elias Reich, Saverio Messineo, Stefan Huber Abstract Discrete automated processes in industrial and cyber-physical systems often exhibit a repetitive structure in which successive repetitions follow a common trajectory while differing in duration, amplitude, and fine-scale dynamics. Such approximately periodic behavior poses a challenge for Gaussian Processes (GP) modeling: strictly periodic models suppress inter-repetition variability, while non-periodic models fail to capture the strong structural regularities required for generation. In this work, we propose a stochastic generative model for approximately periodic time series. The model is based on a GP whose posterior is modulated by a novel kernel. Our approach decouples intra-repetition structure from inter-repetition variability through a two-stage construction which yields a generative distribution with a identical mean function across repetitions, while allowing smooth variation between repetitions. The modeling choices are supported by an implementation in which realistic synthetic trajectories are generated from toy datasets. GP Gaussian Process LMC linear model of coregionalization NLL negative log-likelihood PSD positive-semi-definite MSE mean squared error MVTS multivariate time series ML machine learning tmp tmp 1 Introduction Discrete automated processes, such as those encountered in industrial production machines, robotic assembly lines, and cyber-physical control systems, often exhibit a characteristic form of repetition. Due to sensor noise, mechanical wear, environmental fluctuations, and control variability, such processes are not strictly periodic. Still, their observable dynamics consist of successive iterations that are similar in shape and duration. As a result, measurements collected during operation give rise to multivariate time series that repeatedly traverse comparable trajectories while exhibiting non-negligible variation across repetitions. In this setting, gp [ 14 ] are an appealing model: they provide a principled probabilistic model with calibrated uncertainty and interpretable structure, and periodic or quasi-periodic kernels allow us to encode repetition while retaining flexibility for repetition-to-repetition variability. The task of this paper is to propose a novel, stochastic generative model based on the gp , that formalizes and reproduces processes whose iterations “nearly” repeat themselves. To the best of our knowledge, no prior GP-based generative model provides: (i) long-horizon generative stability across arbitrarily many repetitions, and (ii) controlled, smoothly decaying inter-repetition variability. Our kernel-modulated posterior addresses this gap and is practically relevant in several application domains: it enables the generation of realistic synthetic data for unit testing, digital twins or populating honeypots in industrial systems; and it naturally supports likelihood-based anomaly detection by quantifying deviations from learned statistics. Problem formulation. Formally, observations of systems with repetitive behavior can be characterized as multivariate time series over a finite interval x\colon I\to\mathbb{R}^{D}\quad\text{with}\quad I=[0,N]\subset\mathbb{R}, that can be decomposed into consecutive segments I_{1},I_{2},\dots,I_{r} , with \bigcup_{j}I_{j}=I and each interval I_{j} corresponding to an individual repetition of the underlying process. We do not require that the I_{j} have equal length. By introducing reparameterizations \pi_{i}\colon I_{i}\rightarrow[0,1] that normalize time, we define the time-normalized repetition as y_{i}(t)=x\left(\pi_{i}^{-1}(t)\right) for all t\in[0,1] . Given \varepsilon>0 , we call x repetitive and, in turn, y_{1},\dots,y_{r} repetitions of an approximately periodic time series, if and only if \|y_{i}-y_{j}\|_{\infty}\leq\varepsilon for all 1\leq i,j\leq r . In such a case, a pair (y_{i},y_{j}) is called approximately equivalent . The process of splitting x in its repetitions is shown in [ 10 ] . To keep the proposed method as streamlined as possible, we will from now on assume that all time series data are already split into their repetitions and reparametrized to satisfy the constraints for approximate periodicity. Avoiding notational clutter, we will say y is a vector which contains all repetitions in order [y_{1},\dots,y_{r}]^{\top} and T is the vector of their respective domains [T_{1},\dots,T_{r}]^{\top} . We will also assume D=1 , but the model can be employed in higher dimensions through multi-output GPs such as the lmc ( lmc ) [ 1 ] . Generating approximately periodic processes poses a challenge for GP models. Classical periodic models enforce exact repetition and therefore fail to represent realistic inter-repetition variability, while generic non-periodic models disregard the strong structural regularities present in the data and therefore fail to make long term predictions. From a generative modeling perspective, this is particularly limiting: the model should be capable of producing arbitrarily long sequences of repetitions that preserve the characteristic shape of the process, while allowing variation between repetitions. Contributions. In this paper, we introduce a stochastic generative model for approximately periodic multivariate time series based on GPs, that can generate time series of arbitrarily many repetitions, preserving continuity over the whole time span while still allowing variation between repetitions. Our approach consists of two conceptually separate stages: (1) learning a stable repetition template using a strictly periodic GP posterior, and (2) injecting controlled variability between repetitions by modulating the posterior covariance with a smooth envelope. This separation ensures that the model’s mean dynamics remain consistent across arbitrarily long horizons, while its covariance structure reflects the natural decay of similarity between repetitions. This yields a generative model that produces trajectories with identical mean structure across repetitions while allowing smooth variation between repetitions. 2 Related Work Periodic kernels and their quasi-periodic variants are long-standing tools for modeling repetitive structure in time series [ 14 ] . In astronomy and astrophysics, scalable one-dimensional GP methods enable quasi-periodic modeling of stellar rotation and activity over long light curves [ 3 ] . Recent analyses connect quasi-periodic kernel hyperparameters to physically meaningful timescales and study their identifiability and sampling effects [ 7 ] . While effective and efficient algorithms for forecasting and uncertainty estimation exist [ 4 , 3 , 6 ] , these methods either enforce exact periodicity or introduce mean decay and variance inflation over long horizons, limiting their use as generative models for arbitrarily many repetitions. A substantial line of work recasts temporal GP regression as linear state-space models, yielding \mathcal{O}(N) inference via Kalman filtering and smoothing, with explicit linkages for periodic/quasi-periodic covariances [ 11 ] . These methods improve scalability and bring physical insight, but they do not by themselves enable long-horizon generation. Neural ODEs [ 2 ] and diffusion/score-based models [ 12 ] achieve impressive generative performance but often trade off interpretability and calibrated uncertainty as well as long-term stability [ 9 ] . For safety-critical industrial and cyber-physical applications, where stability is central, gp remain attractive. 3 Methodology We refer to the standard textbook [ 14 ] on GPs. Below we give a short GP primer to introduce the notation used throughout the paper. Let training inputs be T=[t_{1},\dots,t_{n}]^{\top} with observations y=[y_{1},\dots,y_{N}]^{\top} and define a psd ( psd ) kernel/covariance function k(t,t^{\prime}) with Gram-matrix K . Evaluated on the training inputs K:=K(T,T) , the matrix has entries [K]_{ij}=k(t_{i},t_{j}) . For a test input t_{*} we write k_{*}:=K(T,t_{*}) for the cross covariances and k_{**}:=K(t_{*},t_{*}) for the covariances. If there are multiple test inputs, we refer to them as T_{*} . With i.i.d. Gaussian observation noise \epsilon\sim\mathcal{N}(0,\sigma^{2}I) and prior over the latent (unobserved, noiseless) function f\sim\mathcal{GP}(\mu,k) – in practice the mean function \mu is usually zero without loss of generality – the standard posterior (i.e., predictive) distribution at t_{*} is available in closed form: \displaystyle f(t_{*})\mid T,y \displaystyle\sim\mathcal{N}(\hat{\mu},\,\hat{\Sigma})\quad\text{with} \displaystyle\hat{\mu} \displaystyle=\mu(t_{*})+k_{*}^{\top}(K+\sigma^{2}I)^{-1}(y-\mu(T)), (1) \displaystyle\hat{\Sigma} \displaystyle=k_{**}-k_{*}^{\top}(K+\sigma^{2}I)^{-1}k_{*}. Throughout this paper, we will rarely consider univariate inputs and outputs, if so it is explicitly stated; otherwise

Read the complete text