Independent Component Discovery in Temporal Count Data
Alexandre Chaussard, Anna Bonnet, Sylvain Le Corff · 2026
Read Independent Component Discovery in Temporal Count Data by Alexandre Chaussard, Anna Bonnet, Sylvain Le Corff (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21696.txt.
Introduction
Alexandre Chaussard, Anna Bonnet, and Sylvain Le Corff find independent components inside streams of count data. Modern collection yields growing piles of counts over time, from gene reads to event logs. Standard component methods were built for smooth continuous data, not counts.
Their generative model pairs regime-switching dynamics with a Poisson log-normal emission law. It finds disentangled components whose weight shifts with the regime. Clean components make the data easier to interpret and to perturb in analysis. The method suits fields where the raw signal is a count and the hidden drivers change their mix over time.
Catalog record
| CREATOR | Alexandre Chaussard, Anna Bonnet, Sylvain Le Corff |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 117 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21696
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Independent Component Discovery in Temporal Count Data Alexandre Chaussard, Anna Bonnet, Sylvain Le Corff Abstract Advances in data collection are producing growing volumes of temporal count observations, making adapted modeling increasingly necessary. In this work, we introduce a generative framework for independent component analysis of temporal count data, combining regime-adaptive dynamics with Poisson log-normal emissions. The model identifies disentangled components with regime-dependent contributions, enabling representation learning and perturbations analysis. Notably, we establish the identifiability of the model, supporting principled interpretation. To learn the parameters, we propose an efficient amortized variational inference procedure. Experiments on simulated data evaluate recovery of the mixing function and latent sources across diverse settings, while an in vivo longitudinal gut microbiome study reveals microbial co-variation patterns and regime shifts consistent with clinical perturbations. 1 Introduction Multivariate temporal count data arise in many application areas, notably healthcare, finance or climate science, where both interpretability and faithful characterization of perturbations and regimes (e.g. infections, trends, seasons) are increasingly central ( 39 ; 4 ; 36 ) . Despite their prevalence, principled modeling for temporal count data remains challenging: observations are non-negative, discrete, frequently overdispersed, and often exhibit heavy-tailed variability. While a substantial body of work focuses on forecasting models for temporal count data (see the review of 16 and the references therein), these approaches provide more limited tools for theoretically grounded analyses of latent structures, regime segmentation, dimension reduction, and the extraction of interpretable mechanisms from multivariate trajectories. In this context, Independent Component Analysis (ICA) provides an attractive framework for interpretable representation learning by expressing observed signals as mixed independent latent sources ( 33 ) . In temporal settings with linear mixing, the dependency structure can be leveraged to characterize the mixing map and latent sources ( 7 ) , supporting principled interpretation. Recent work then generalize identification results to structured ICA and nonlinear mixing models ( 40 ; 26 ) , improving on model expressivity. While these developments enable principled downstream analysis when observations are real-valued and corrupted by additive noise, their framework is not well-suited for temporal count data, where discreteness and heteroskedastic noise can lead to mispecification or unstable inference, highlighting the need for ICA models tailored to count data. In contrast, count data analysis typically relies on observation models that explicitly capture their statistical properties, such as negative binomial likelihoods ( 28 ) or Poisson composed models. Among these, Poisson log-normal (PLN) generative models ( 2 ) are particularly compelling, as their latent Gaussian variables induce flexible dependencies across dimensions while preserving a well-grounded probabilistic interpretation ( 13 ) . Yet, their potential for temporal representation learning and independent component analysis remain underexplored. In this work, we propose a generative framework for ICA of temporal count data using PLN models. To accommodate exogenous perturbations and regime changes in dynamics, we couple the PLN observation model with a switching linear dynamical system ( 23 ) , enabling latent regime segmentation and regime-specific dynamical analysis. Leveraging the model’s structure, we establish identifiability of the latent components under mild assumptions, supporting principled downstream interpretation. To learn the model parameters, we derive an efficient amortized variational inference procedure ( 8 ) that exploits conditional structure and uses a deep variational parameterization designed to scale to multivariate time series. To complement our identifiability results, we study several simulation regimes and demonstrate partial recovery of the mixing map in finite-sample setting. We then showcase the empirical relevance of the model on a gut microbiome study from 9 , in which the inferred regimes align with documented perturbations, and the recovered components yield biologically meaningful taxa-level co-variation patterns. We also report an auxiliary forecasting benchmark against standard baselines as a quantitative evaluation of the proposed model. Our methodological contributions are the following: (i) a generative model for ICA of temporal count data with regime switching for perturbation-aware analysis, (ii) identifiability guarantees for the mixing map up to standard ICA indeterminacies, and (iii) a structured amortized variational inference procedure to learn the model parameters. Notations. Consider a dataset \mathcal{D} of N temporal count data of length T . We write v_{1:T}^{1:K} to represent a multivariate time series of length T with K features per time step, i.e. for each x\in\mathcal{D} , we write x=x_{1:T}^{1:K}\in\mathds{N}^{T\times K} . For all 1\leq t\leq T , 1\leq i\leq K , the i -th feature of v_{t} is written v_{t}^{(i)} . For all sequences z=(z_{j})_{1\leq j\leq K}\in\mathbb{R}^{K} , we write x\sim\mathcal{P}(\exp z) when (x_{j})_{1\leq j\leq K} are independent with x_{j}\sim\mathcal{P}(\exp z_{j}) . We denote functions under the model by p_{\boldsymbol{\theta}} with parameters {\boldsymbol{\theta}} , and q_{\boldsymbol{\varphi}} the variational proxy with parameters {\boldsymbol{\varphi}} . 2 Background and related works Independent Component Analysis. A central goal in data analysis is to establish interpretable representations of high-dimensional observations, which are often correlated and difficult to analyze directly. ICA addresses this by assuming that observations are generated from component-wise independent latent sources of possibly smaller dimension, mixed through an unknown mixing function ( 33 ) . Denoting the sources by s=s_{1:T}^{1:d}\in\mathds{R}^{T\times d} and a parametric mixing map f_{\boldsymbol{\theta}}:\mathds{R}^{d}\to\mathds{R}^{K} , the observations are given by x_{t}=f_{\boldsymbol{\theta}}(s_{t}) , 1\leq t\leq T . To explicitly account for observation noise and enable principled inference, probabilistic ICA specifies a generative model via a prior p_{\theta}(s_{1:T}) and an observation model p_{\boldsymbol{\theta}}(x_{1:T}\mid s_{1:T}) , enabling likelihood-based learning and uncertainty quantification ( 26 ; 31 ) . A key challenge in ICA is the characterization of the mixing map f_{\boldsymbol{\theta}} . In linear ICA with additive noise, identifiability holds under some assumptions, typically excluding more than one Gaussian source ( 32 ) , or by assuming joint diagonalization of auto-correlation matrices in time series ( 7 ) ; both yielding mixing identification up to column-wise permutation and rescaling. Beyond the linear case, nonlinear ICA is in general not identifiable without additional structure, and temporal information is one principled route to restore identifiability ( 31 ) . Recent work formalizes structured nonlinear ICA models and establishes identifiability even with additive noise of unknown distribution ( 26 ) . However, these formulations do not directly extend to count data, whose discreteness, heteroskedasticity and overdispersion make continuous additive-noise models ill-suited. In this work, we adapt the structured probabilistic ICA viewpoint of 26 to count data by using a Poisson-based emission model, treating observation noise through composition in the likelihood, and enabling identifiability under mild assumptions. Structured count data. Count data are commonly found in many applications, and pose distinct challenges due to discreteness, non-negativity, and frequent overdispersion, limiting the applicability of standard modeling tools ( 10 ) . Among count-specific approaches, Poisson Log-Normal (PLN) models provide a principled framework for capturing dependencies via latent Gaussian log-intensities, enabling downstream tasks such as network inference and principle component analysis ( 14 ; 13 ) . Recent extensions to structured settings further highlight the flexibility of the framework and its interest for healthcare applications ( 12 ; 6 ) . Yet, PLN models tailored to temporal structures remain largely underexplored. Meanwhile, several models have been proposed for temporal count data, including integer auto-regressive models ( 34 ) , binary series ( 15 ; 37 ) , and negative binomial or Poisson regression ( 17 ; 20 ) ; however, these methods are mostly forecasting-oriented and