Testing for a common subspace in compositional datasets with structural zeros Journal: Computational Statistics & Data Analysis

Francesco Porro, Fabio Rapallo, Sara Sommariva · 2025

Read Testing for a common subspace in compositional datasets with structural zeros Journal: Computational Statistics & Data Analysis by Francesco Porro, Fabio Rapallo, Sara Sommariva (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-22853.txt.

Introduction

Compositional data are shares that sum to a whole. Some zeros in such data are structural, not random. Francesco Porro, Fabio Rapallo, and Sara Sommariva test shared structure in 2025. They compare two groups of such data. Each group has its own zero pattern.

Different zero patterns block standard logratio methods. Logratios compare parts on a log scale. Their test checks for a common principal subspace. It fits Aitchison geometry and logratio analysis. Under logratio normality, they derive a null distribution. A bootstrap version avoids distribution assumptions. Bootstrap means resampling the data. Simulations check small sample behavior. A microbiome dataset illustrates the method.

Catalog record

CREATORFrancesco Porro, Fabio Rapallo, Sara Sommariva
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-22853

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Testing for a common subspace in compositional datasets with structural zeros Journal: Computational Statistics & Data Analysis Francesco Porro, Fabio Rapallo, Sara Sommariva Abstract In real world applications dealing with compositional datasets, it is easy to face the presence of structural zeros. The latter arise when, due to physical limitations, one or more variables are intrinsically zero for a subset of the population under study. The classical Aitchison approach requires all the components of a composition to be strictly positive, since the adaptation of the most widely used statistical techniques to the compositional framework relies on computing the logratios of these components. Therefore, datasets containing structural zeros are usually split in two subsets, the one containing the observations with structural zeros and the one containing all the other data. Then statistical analysis is performed on the two subsets separately, assuming the two datasets are drawn from two different subpopulations. However, this approach may lead to incomplete results when the split into two populations is merely artificial. To overcome this limitation and increase the robustness of such an approach, we introduce a statistical test to check whether the first K K principal components of the two datasets generate the same vector space. An approximation of the corresponding null distribution is derived analytically when data are normally distributed on the simplex and through a nonparametric bootstrap approach in the other cases. Results from simulated data demonstrate that the proposed procedure can discriminate scenarios where the subpopulations share a common subspace from those where they are actually distinct. The performance of the proposed method is also tested on an experimental dataset concerning microbiome measurements. 1 Introduction The problem we deal with in this paper falls in the framework of dimensionality reduction for compositional data with structural zeros. In recent decades, the number of analyses dealing with compositional data has been largely increased. Compositional data arise in contexts where the relevant information lies in the proportions among the observed variables and not in their values or their sum. Possible fields of application include tourism ( Grifoll et al. 2019 ) , finance ( Fiori and Porro 2023 ) , microbiome analysis ( Tsilimigras and Fodor 2016 ) , pattern recognition ( Lu et al. 2024 ) , geochemistry and analytical chemistry ( Rieser and Filzmoser 2023 ; Mert et al. 2015 ) . At the core of compositional data analysis lies the definition of compositions. A composition is a real-valued vector having all strictly positive components that sum to a fixed value \kappa . A suitable space to contain all the compositions with D parts is the simplex, defined by: \mathbb{S}^{D}=\left\{\mathbf{x}=(x_{1},x_{2},\dots,x_{D})\;:\;x_{i}>0,\forall i;\;\sum_{i=1}^{D}x_{i}=\kappa\right\}. (1) In the remaining of the paper we will assume \kappa=1 . This is a common choice in compositional data analysis as it allows to identify a composition with a vectors of proportions that sum to 1. A typical compositional dataset \mathcal{X} is a matrix with n rows and D columns collecting a sample of n observations, each one being a D -part composition: \begin{split}&\qquad\qquad\qquad\mathcal{X}=(\mathbf{x}_{1},\mathbf{x}_{2},\dots,\mathbf{x}_{n})^{\prime},\;\mbox{where:}\\ &\mathbf{x}_{i}=(x_{i1},x_{i2},\dots,x_{iD})\in\mathbb{S}^{D},\;\sum_{j=1}^{D}x_{ij}=1\;\;\;i=1,2,\dots,n.\end{split} (2) The standard statistical descriptive measures based on the real Euclidean geometry can lead to erroneous conclusions when applied to compositional datasets ( Pawlowsky-Glahn et al. 2015 ; Mert et al. 2015 ; Grifoll et al. 2019 ) . This issue is usually overcome through the so-called principle of working in coordinates ( Mateu-Figueras et al. 2011 ; Grifoll et al. 2019 ) : a proper transformation is defined to map each composition into a vector of coordinates belonging to suitable spaces equipped with an Euclidean structure. Then, standard statistical approaches, such as e.g. Principal Component Analysis (PCA) for dimensionality reduction, can be applied to the transformed data. Many transformations based on the logratios have been proposed, among which the most common ones are the additive logratio (alr), the centered logratio (clr), and the isometric logratio (ilr) ( Aitchison 1982 ; Pawlowsky-Glahn et al. 2015 ; Egozcue et al. 2003 ; Mateu-Figueras et al. 2011 ) . All these three transformations are based on the ratios of logarithms of parts belonging to a composition. From a theoretical perspective, this does not cause issues since, by definition of composition, and also as showed in the simplex formula in Eq. ( 1 ), all the parts of a composition must be greater than zero. The point is that, unfortunately, in many real world applications, the present of a null part can occur. In those cases, the aforementioned transformations cannot be applied, so new procedures must be considered. As detailed in Pawlowsky-Glahn et al. 2015 and Martin-Fernandez et al. 2012 , there are distinct kinds of zeros. In this paper we focus on structural zeros , which are actual zeros, representing the absence of the phenomenon under analysis. As an example, in a study on monthly expenditure of a set of families, the proportion of expenditure in children school services in families without children is a structural zero. Structural zeros are different from counting zeros , which are caused by sampling issues of an unobserved part, or from rounded zeros , that are due to a measurement under a certain threshold ( Pawlowsky-Glahn et al. 2015 ; Kim et al. 2024 ) . For a detailed review on the comparison of zero replacement strategies for compositional data see Lubbe et al. 2021 . While, after making some considerations and assumptions, it can sound reasonable to replace the counting and the rounded zeros with a certain (small) value \epsilon ( Lubbe et al. 2021 ; Filzmoser et al. 2018 ) , this procedure does not seem acceptable when dealing with structural zeros. Indeed, in this case a widely used approach consists in splitting the compositional dataset in two subsamples, one collecting the composition with structural zeros and one with all the remaining data, and assuming they have been sampled from different populations ( Pawlowsky-Glahn et al. 2015 ) . This approach suggests then to treat the two subsamples differently: in the first one only the subcompositions of the non-null parts are retained; in the second one the whole compositions are taken in consideration. Without loss of generality, in the remaining of the paper we will denote the two subsamples with (\mathcal{Y},0) and \mathcal{Z} , respectively. The rationale behind this classical approach is that the null parts can be omitted in the subsample with structural zeros and logratio transformations can be applied to \mathcal{Y} . When performing dimensionality reduction with PCA, this approach will result in two independent analyses for the two subsamples. However, this may be limiting because, despite the structural zeros, the two subsamples may come from an unique population, and the distinction in two subpopulation can be misleading. From a statistical (or better geometrical) perspective, this can be represented by the situation where the two subsamples still share a common subspace that would allow to represent the whole dataset in the same geometrical space and support classification or stratification studies involving the whole population. In this paper we overcome this limitation by presenting an hypothesis testing procedure to check whether such a common subspace exists. The paper is organized as follows. In Section 2 we revise the tools of compositional data analysis needed in our work, including the

Read the complete text