Feature aware covariance estimation, with application to mixtures of chemical exposures

Elizabeth Bersson, Kate Hoffman, Heather M. Stapleton, David B. Dunson · 2025

Read Feature aware covariance estimation, with application to mixtures of chemical exposures by Elizabeth Bersson, Kate Hoffman, Heather M. Stapleton, David B. Dunson (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08220.txt.

Introduction

Elizabeth Bersson, Kate Hoffman, Heather Stapleton, and David Dunson improve estimates of how chemical exposures vary together in two thousand twenty-five. Their test case is a study of toddlers' contact with flame-retardant-like chemicals indoors. Small samples make raw co-variation estimates shaky, and common Bayesian tools shrink them too far toward zero.

Their method is a factor model that also reads each chemical's traits, such as its class and structure. Those traits guide the shrinkage toward richer patterns rather than a flat diagonal. Grouping chemicals by class, the older fix, can hide fine links. The feature-aware route keeps detail while still steadying the estimate, as the toddler data show.

Catalog record

CREATORElizabeth Bersson, Kate Hoffman, Heather M. Stapleton, David B. Dunson
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-08220

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Feature aware covariance estimation, with application to mixtures of chemical exposures Elizabeth Bersson, Kate Hoffman, Heather M. Stapleton, David B. Dunson Abstract The motivation of this article is to improve inferences on the covariation in environmental exposures, motivated by data from a study of Toddlers Exposure to SVOCs in Indoor Environments (TESIE). The challenge is that the sample size is limited, so empirical covariance provides a poor estimate. In related applications, Bayesian factor models have been popular; these approaches express the covariance as low rank plus diagonal and can infer the number of factors adaptively. However, they have the disadvantage of shrinking towards a diagonal covariance, often under estimating important covariation patterns in the data. Alternatively, the dimensionality problem is addressed by collapsing the detailed exposure data within chemical classes, potentially obscuring important information. We apply a feature aware covariance regression extension of Bayesian factor analysis, which improves performance by including information from features summarizing properties of the different exposures. This approach enables shrinkage to more flexible covariance structures, reducing the over-shrinkage problem, as we illustrate in the TESIE data using various chemical features. , , , and ?? Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, ?? ?? Nicholas School of the Environment, Duke University, ??; ?? ?? Department of Statistical Science, Duke University, ?? 1 Introduction Many environmental health studies are conducted that gather measurements of chemical exposures from multiple exposure pathways, often within a relatively small pool of subjects. In general, the chemicals targeted in these studies are suspected to have an impact on health, and understanding the health risks of these simultaneous exposures, or mixtures, is a key objective of public health initiatives ( NIEHS, 2012 , e.g., ) . Due to synergistic and antagonistic interaction effects, the impact of chemical exposures varies depending on the mixture arrangement, and, as such, understanding patterns of variation among exposures is pertinent. In this work, we aim to improve the accuracy of covariance estimation for exposures measured in the study of Toddlers Exposure to SVOCs in Indoor Environments (TESIE) ( Hoffman et al., 2018 ) . Semi-volatile organic compounds (SVOCs) are widely used in everyday consumer products such as construction materials and household items, including furniture and cleaning products, and personal care products such as nail polish and shampoo. Although the health effects resulting from mixtures of exposures are not yet fully understood, there exists a wide array of accessible auxiliary information regarding the individual chemicals. In general, for example, chemical properties such as vapor pressure and aqueous solubility are readily available publicly from reputable sources, including the US National Institutes of Health ( Kim et al., 2023 ) and the US Environmental Protection Agency ( U.S. Environmental Protection Agency, ) . For the focus chemicals in the TESIE study, much auxiliary information is known, including chemical class, common use cases, and chemical molecular properties. Moreover, each vector of exposure measurements has an implicit matrix structure consisting of exposure measurement tool by chemical, information that would ideally be incorporated into a statistical analysis. In fact, in practice, this auxiliary information is often used by experts to intuit or describe some scientific or practical differences between exposures. In this work, we formalize this practice by using these auxiliary data, or outcome features, to improve covariance estimation accuracy by incorporating them into a modeling framework. Formally, we define outcome features to be predictors or covariates that vary with the outcome index instead of the sample index. In general, accurate covariance estimation is a challenging objective in high-dimensional settings. For example, a naive approach estimates a population covariance matrix with the sample covariance matrix. However, unless the sample size is appreciably larger than the covariance dimension, the sample covariance matrix will be unstable ( Johnstone, 2001 ) . Whats more, the sample covariance matrix will not be invertible if there are more variables than the number of samples. This is problematic as the inverse is required for many statistical tasks, including, for example, classification ( Friedman, 1989 ) and hypothesis testing ( Mardia et al., 1979 , §5.3) . For these reasons, among others, analyzing all available data jointly in an exposure mixture analysis may be infeasible with naive statistical methods. Consequently, in practice, scientists will implicitly use information from outcome features to partition the variables in a dataset into subsets to be analyzed separately. It is common, for example, to analyze exposure mixture data distinctly for each chemical class, as in, for example, Liu et al. (2023) ; James-Todd et al. (2017) . With a Gaussian sampling model assumption, this corresponds to imposing an assumption of zero correlation across classes conditional on class-specific modeling assumptions, or, a block diagonal covariance matrix for all variables. More comprehensive approaches have been developed that utilize the outcome feature information that describes distinct categorical groupings of variables ( Bao et al., 2024 ) . In analyzing exposure mixtures, latent factor models are increasingly utilized ( Ferrari and Dunson, 2021 ; Roy et al., 2021 ) . A latent factor model decomposes an unstructured covariance matrix as the sum of a diagonal variance matrix and a possibly low-rank covariance matrix. Due to correlation among exposures, a small number of factors may represent the covariance well, which yields a reduction in the number of unknown parameters to be estimated and, in turn, improved precision. In addition, this decomposition allows inversion of the covariance matrix in a regime with more variables than samples. In a Bayesian framework, state-of-the-art methods have been developed that allow for uncertainty of the dimension of the low-rank covariance term. Some examples include Frühwirth-Schnatter et al. (2025) ; Legramanti et al. (2020) ; Bhattacharya and Dunson (2011) . These approaches assume exchangeability with respect to the order of the feature variables. Moreover, they have a mean of zero and hence often shrink the factor loading matrix strongly towards a zero-matrix. This effectively shrinks the covariance matrix towards a diagonal structure, which may not represent the population well. Recently, non-exchangeable approaches have been developed that use outcome feature data to inform the sparsity structure of a covariance matrix in a latent factor model framework ( Schiavon et al., 2022 ) and of a precision matrix in a graphical modeling framework ( Xi and Ruffieux, 2024 ) . These methods, similar to the approach we propose, are motivated by the notion that variables with similar outcome features should have similar covariation patterns. However, these approaches, like the other popular factor model priors, shrink the covariance matrix towards a diagonal form. We propose a method for high-dimensional covariance estimation that utilizes auxiliary information on the outcome variables to inform a covariance structure to shrink an unstructured population covariance matrix toward. In particular, we detail a prior specification that decomposes an unstructured covariance matrix as the sum of a diagonal variance matrix and a possibly low-rank covariance matrix that is shrunk towards the matrix-square of the linear predictor of a matrix-variate regression based on the outcome features. We detail how the datatype of an outcome feature informs the centering of the induced covariance prior. Furthermore, this work uses a factor model representation to flexibly incorporate dimension reduction. As such, our approach couples dimension reduction with structured

Read the complete text