Federated Imputation under Heterogeneous Feature Spaces *Co-first authors.

Imane Hocine * 1 , Chaimaa Medjadji * 1 , Sylvain Kubler 1 2 , Grégoire Danoy 1 2 , Yves Le Traon 1 2 · 2026

Read Federated Imputation under Heterogeneous Feature Spaces *Co-first authors. by Imane Hocine * 1 , Chaimaa Medjadji * 1 , Sylvain Kubler 1 2 , Grégoire Danoy 1 2 , Yves Le Traon 1 2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16099.txt.

Introduction

Hocine and four colleagues propose FedHF-Impute, a federated imputation method for clients whose feature sets only partly overlap. Standard averaging transfers little across weakly overlapping or disjoint feature groups. Their shared global feature graph passes information between statistically related features, even ones never seen together locally. On simulated partial overlap, it beat federated baselines by 26.9 percent on SECOM and 8.4 percent on AirQuality.

Catalog record

CREATORImane Hocine * 1 , Chaimaa Medjadji * 1 , Sylvain Kubler 1 2 , Grégoire Danoy 1 2 , Yves Le Traon 1 2
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36090
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16099

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Federated Imputation under Heterogeneous Feature Spaces *Co-first authors. Imane Hocine * 1 , Chaimaa Medjadji * 1 , Sylvain Kubler 1 2 , Grégoire Danoy 1 2 , Yves Le Traon 1 2 Abstract Federated Learning (FL) enables collaborative training across decentralized clients, but most methods assume aligned feature schemas, an assumption that rarely holds in tabular settings where clients observe only partially overlapping feature subsets. In these heterogeneous feature spaces, parameter-averaging methods (e.g., FedAvg) transfer little information across weakly overlapping or disjoint feature groups, limiting their effectiveness for federated imputation. To overcome this, we propose FedHF-Impute , a federated imputation framework that separates structural feature unavailability from conventional missingness and uses a shared global feature graph to propagate information across statistically related features through message passing. This enables indirect cross-client knowledge transfer—even when features are never jointly observed locally—while preserving standard federated communication. Under simulated partial schema overlap on the SECOM and AirQuality datasets, FedHF-Impute improves imputation accuracy (RMSE) over FL baselines by 26.9%, and 8.4% respectively, while achieving comparable performance on PhysioNET, with only a 0.3% difference relative to the best baseline. I Introduction Federated learning (FL) has emerged as a powerful paradigm for collaboratively training machine learning (ML) models across distributed clients while preserving data locality and privacy. Classical horizontal FL assumes that all clients share an identical feature space, enabling direct parameter aggregation, such as FedAvg. However, recent surveys on heterogeneous FL [ 32 , 29 , 30 ] indicate that this assumption is frequently violated in practice, as real systems often differ in measurement pipelines, sensor configurations, and institutional data schemas. In such scenarios, certain features are structurally unavailable on some clients. This violates the aligned-schema assumption foundational to most FL algorithms and leads to ill-posed aggregation when feature indices no longer correspond semantically. Recent work such as FLIC [ 27 ] demonstrates that heterogeneous feature representations require explicit alignment or transformation even for standard predictive tasks. More recent studies [ 30 , 31 ] show that heterogeneity in feature spaces, data distributions, or temporal patterns can severely degrade both optimization stability and global model performance. This motivates a clear separation between temporary missingness [ 43 ] and structural unavailability [ 42 ] . Temporary missingness occurs when a feature is observable locally but has missing entries, whereas structural unavailability occurs when a client never measures that feature at all. Existing federated imputation methods primarily address temporary missingness and implicitly assume aligned schemas, limiting their applicability to realistic heterogeneous environments. We address federated imputation by decoupling global feature semantics from local client schemas. Rather than tying features to local index positions, we model them as shared global entities linked by a global feature graph that captures statistical dependencies. This enables message passing and cross-client knowledge transfer, even between features never jointly observed on any client. Building on this idea, we introduce FedHF-Impute , a federated imputation framework that combines global feature-graph reasoning with standard FL optimization. The graph is built once from distributed statistics sent by the clients, then shared with all of them without adding training-time communication overhead. Clients perform local imputation using graph-informed feature embeddings, while the server aggregates parameters with FedAvg. FedHF-Impute distinguishes structural feature unavailability from missingness, supports indirect estimation of never co-observed feature interactions, and remains fully compatible with standard federated communication protocols. Paradigm Method Schema Heterogeneity Support Feature-Dependency Modeling Graph-Based Propagation Centralized MICE [ 2 ] – ✓ ✗ DAE [ 1 ] – ✓ ✗ Transformer [ 4 ] – ✓ ✗ GAIN [ 3 ] – ✓ ✗ NewImp [ 33 ] – ✓ ✗ Federated Fed-Mean [ 5 ] ✗ ✗ ✗ Fed-DAE [ 5 , 1 ] ✗ ✓ ✗ Fed-Transformer [ 5 , 4 ] ✗ ✓ ✗ ED-FedImpute [ 36 ] ✗ ✓ ✗ VFL-KNN-Impute [ 34 ] ✓ ✗ ✗ FedFeatGen [ 35 ] ✓ ✓ ✗ FedHF-Impute (ours) ✓ ✓ ✓ TABLE I: Comparison of representative centralized and federated imputation methods. Schema Heterogeneity Support denotes the ability to operate under partially overlapping feature spaces across clients (e.g., vertical FL or missing modalities). Feature-Dependency Modeling refers to capturing inter-feature (or cross-modality) relationships beyond independent per-feature estimation. Graph-Based Propagation indicates whether feature interactions are explicitly structured and propagated through a learned graph. Green checkmarks ( ✓ ) indicate explicit support, red crosses ( ✗ ) denote absence, and – indicates that schema heterogeneity is not applicable or cannot be meaningfully assessed for centralized methods. We evaluate FedHF-Impute across multiple tabular datasets with controlled schema heterogeneity and show that it consistently outperforms existing federated and centralized imputation baselines. These findings align with recent observations that feature-space heterogeneity significantly impairs traditional FL optimization [ 32 , 30 ] , underscoring the importance of structured feature-level modeling in next-generation federated systems. The remainder of this paper is organized as follows. Section II reviews related work on FL with heterogeneous feature spaces and existing imputation approaches. Section III presents the proposed FedHF-Impute framework, including the feature-centric modeling formulation, construction of the global feature graph, and the federated training procedure. Section IV describes the experimental setup, datasets, and evaluation protocol used to assess performance under varying degrees of schema heterogeneity, while the experimental results, including comparisons with baseline methods are reported in Section V . Conclusion follows in Section VI . II Related work Imputation in FL environments intersects classical statistical methods, deep generative models, distributed optimization under non-IID data, and emerging techniques designed to address heterogeneous feature spaces. This section reviews these areas and situates FedHF-Impute within the broader landscape of federated and heterogeneous-feature learning. Classical imputers such as mean imputation, k NN, and MICE [ 2 ] have long been used for tabular datasets but struggle to capture nonlinear or high-dimensional dependencies. Deep neural imputers address these limitations using self-supervised reconstruction (DAE [ 1 ] ) or adversarial objectives (GAIN [ 3 ] ). Variational models such as MIWAE [ 6 ] support probabilistic imputation under missing-at-random assumptions, while time-series models like BRITS [ 7 ] , SAITS [ 8 ] , and CSDI [ 9 ] capture temporal or score-based dependencies. Transformer-based tabular models (e.g., TabTransformer [ 10 ] ) further demonstrate robustness to irregular missingness. Graph-based imputers such as GRIN [ 11 ] , IGRM [ 12 ] , and EGG-GAE [ 13 ] introduce relational inductive bias but still assume a globally aligned schema. Recent diffusion-based imputers further advance centralized reconstruction quality. NewImp formulates imputation as a negative-entropy regularized Wasserstein gradient flow, improving diffusion-based inference of missing values in tabular data [ 33 ] . These centralized architectures can tolerate substantial missingness via masking, attention mechanisms, or reconstruction modules. Moreover, recent work in time-series forecasting shows that centralized attention models can operate with partially observed variable subsets, for example via variable-reconstruction flows [ 39 ] or impute-then-forecast pipelines [ 40 ] . However, these approaches remain largely signal-centric and do not exploit external semantic or operational metadata that could guide valid conditioning context. Addressing this limitation, Vision [ 44 ] introduces a metadata-governed paradigm that combines knowledge graphs, diffusion-based imputation, and LLM-based orchestration to improve the quality, governance, and explainability of time series imputation. Nevertheless, such models still assume a globally pooled and

Read the complete text