Group-Aware Matrix Estimation and Latent Subspace Recovery
Hamza Golubovic, Matthew Shen, Genevera I. Allen, Tarek M. Zikry · 2026
Read Group-Aware Matrix Estimation and Latent Subspace Recovery by Hamza Golubovic, Matthew Shen, Genevera I. Allen, Tarek M. Zikry (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20559.txt.
Introduction
Hamza Golubovic and three colleagues offer GAME, a way to fill in missing cells in tables where rows fit many groups at once. Usual low-rank tools use one shared shape and can blur group traits, most of all when some groups have few data points. GAME adds penalties on group parts that overlap, so linked groups share facts yet keep their own shape. The authors prove bounds on rebuild error and on how well group shapes are found.
Catalog record
| CREATOR | Hamza Golubovic, Matthew Shen, Genevera I. Allen, Tarek M. Zikry |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105046 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20559
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Group-Aware Matrix Estimation and Latent Subspace Recovery Hamza Golubovic, Matthew Shen, Genevera I. Allen, Tarek M. Zikry Abstract Modern matrix completion problems often involve heterogeneous data whose rows simultaneously belong to many meta-categories, such as demographic and age groups in recommendation systems, or region and recording session labels in neural electrophysiological experiments. Standard low-rank estimators impose a single global latent geometry, which can recover average structure but may smooth away subgroup-specific variation, especially when observations are unevenly distributed across groups. We introduce Group-Aware Matrix Estimation (GAME), a convex estimator for overlapping subgroup-wise low-rank matrix estimation. GAME regularizes category-specific submatrices through overlapping nuclear-norm penalties, allowing related groups to borrow information while preserving local latent structure in a shared coordinate system. We provide finite-sample guarantees for both reconstruction error and subgroup-specific subspace recovery, showing how performance depends on sampling density, subgroup rank, and overlap structure. Experiments on synthetic, recommendation, ecological, and neuroscience datasets show that GAME is most beneficial in structured missingness regimes, where subgroup-aware regularization improves both reconstruction accuracy and latent subspace fidelity. Across these benchmarks, GAME is competitive or best among global low-rank, side-information, and modern imputation baselines, with the largest gains when subgroups exhibit distinct low-rank structure. 1 Introduction In recommendation systems, users may belong to overlapping demographic groups such as age, gender, and occupation ( 25 ) . In biological, experimental, and longitudinal studies, samples may be indexed by subject, batch, session, spatial region, or other partially overlapping sources of variation ( 46 ; 15 ) . In such settings, the goal is often not only to reconstruct missing entries accurately on average, but also to preserve subgroup-specific latent structure that may be scientifically or operationally important. Standard nuclear-norm estimators impose a single global low-rank penalty ( 11 ) , which can smooth away subgroup-specific variation - especially for groups that are unevenly or weakly observed, where faithful estimation often matters most. More broadly, heterogeneous data need not conform to one shared low-rank geometry; different subgroups may exhibit local low-dimensional structure that is related through overlap but not identical ( 11 ) . This motivates an overlap-aware estimator that shares information across groups while preserving local structure. In this work, we propose Group-Aware Matrix Estimation (GAME), a convex framework for heterogeneous matrix estimation with overlapping meta-categories. GAME (Figure 1 ) balances faithful reconstruction of the observed entries with nuclear-norm regularization on meta-category-defined submatrices, allowing local low-rank structure to be learned within groups while overlap propagates information across them. This yields a single coherent estimate that borrows strength across groups without forcing all groups into the same latent subspace. Figure 1 : Overview of motivating group-aware matrix estimation in neuroscience. Brain-wide Neuroxpixel recordings measure single-neuron temporal responses to stimuli in mice and monkeys, but can only measure a small number of brain regions at once, leaving large block-missingness across recording sessions and brain regions. We develop Group Aware Matrix Estimation (GAME) to impute missing region dynamics and decompose variability across meta-categories such as region and session. GAME is a general estimator for overlapping subgroup-wise low-rank structure; it is not restricted to settings with an explicit block-sampling model. However, its inductive bias is most beneficial when subgroups exhibit distinct low-rank structure. Structured missingness is one important instance: when some subgroups are weakly observed, overlap allows underrepresented groups to borrow information without being smoothed into a single global estimate. To optimize the GAME objective at scale, we use the proximal average framework ( 4 ; 55 ) , which avoids the auxiliary-variable and consensus overhead of ADMM in high-category settings ( 7 ) . Beyond scalable optimization, GAME also supports analysis of subgroup-specific latent geometry: by regularizing each subgroup through an overlapping nuclear norm, the estimator supports both reconstruction and local subspace recovery. We evaluate GAME on synthetic data with hierarchical group structure, MovieLens-100k ( 25 ) under global and block-wise missingness and meta-category misspecification, multi-label birdsong classification from the BirdSet benchmark ( 18 ; 38 ) , and a scientific case study on multi-session Neuropixel recordings ( 15 ) . Across these settings, GAME performs competitively or best across all settings, with the largest margins when subgroups exhibit distinct low-rank structure or when the goal is to recover local latent geometry. Contributions Together, these ideas lead to four main contributions: • A subgroup-aware convex estimator for heterogeneous matrix estimation. We introduce GAME, which promotes overlapping subgroup-wise low-rank structure while maintaining a shared coordinate system across the full matrix. • Scalable optimization without consensus overhead. We develop a proximal-averaging solver for the GAME objective that is practical in settings with many overlapping categories. • Provable reconstruction and subspace fidelity under overlap. We provide finite-sample guarantees for both reconstruction error and subgroup-specific subspace recovery, clarifying how performance depends on sampling, rank, and overlap structure. • Empirical validation on synthetic and real datasets. We show that GAME performs competitively or better than benchmark methods across diverse settings, with the largest gains in structured missingness regimes. On Neuropixels data, GAME recovers region-specific latent dynamics, illustrating value beyond aggregate imputation accuracy. The remainder of the paper develops the formulation, optimization, and theory, followed by experiments on synthetic and real data. 2 Related Work 2.1 Matrix Completion with Side Information Low-rank matrix completion has been extensively studied as a framework for recovering low-rank matrices from partial observations. Classical formulations rely on the assumption that the target matrix is globally low-rank and can be recovered via a convex relaxation using the nuclear norm ( 11 ; 39 ) . Non-convex approaches, such as alternating least squares (ALS) ( 26 ; 31 ) have also been widely adopted for their computational efficiency on high-dimensional matrices. While these models enjoy strong theoretical guarantees under incoherence and random sampling assumptions ( 10 ; 33 ) , they treat all rows and columns equally, and do not incorporate meta (i.e. “side”) information that may be readily available in real-world applications. Several methods incorporate side information —row or column features—into the completion problem. Note that side information is analogous to meta-category . Inductive Matrix Completion (IMC) ( 27 ) assumes that the target matrix admits a factorization of the form \mathbf{X}\approx\mathbf{AMB}^{\top}, where \mathbf{A} and \mathbf{B} are known feature matrices and \mathbf{M} is a low-rank parameter matrix to be learned. The feature matrices may contain one-hot encodings of categorical information or singular vectors of a cheaply completed matrix approximation of \mathbf{X} . Similar to IMC, Maxide ( 50 ) exploits side information by restricting the target matrix to lie in the subspaces spanned by known feature matrices, but penalizes the completion problem with a lower-dimensional trace-norm, yielding substantial computational and sample-complexity gains when the side information is well-aligned with the latent structure. DirtyIMC ( 16 ) addresses noisy or incomplete side information by augmenting IMC with a low-rank residual term, while FNNM ( 51 ) instead decomposes the target into a globally low-rank component and a sparse component tied to the side information, balancing global and local structure via nuclear norm and \ell_{1} regularization jointly. ( 14 ) observe that when side information is incomplete, the component of the target matrix lying outside the available feature subspaces lacks any inherent low-rank structure and must be explicitly regularized, proposing to penalize the nuclear norm