FedSPDnet: Geometry-Aware Federated Deep Learning with SPDnet

Thibault Pautrel 1 , Florent Bouchard 1 , Ammar Mian 3 , Guillaume Ginolhac 3 · 2026

Read FedSPDnet: Geometry-Aware Federated Deep Learning with SPDnet by Thibault Pautrel 1 , Florent Bouchard 1 , Ammar Mian 3 , Guillaume Ginolhac 3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22494.txt.

Introduction

Pautrel and three colleagues offer two ways to train a shared neural model across separate sites without breaking its curved geometry. Its target, SPDnet, works with matrices where plain averaging breaks a key right-angle rule. ProjAvg projects plain averages back onto the allowed curved surface, while RLAvg averages in flat tangent space and maps the result back. Both stay cheap and work with any optimizer. Brain-signal tests show the approach beats federated EEGnet on score and steadiness while sending fewer values per round.

Catalog record

CREATORThibault Pautrel 1 , Florent Bouchard 1 , Ammar Mian 3 , Guillaume Ginolhac 3
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24637
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.22494

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FedSPDnet: Geometry-Aware Federated Deep Learning with SPDnet Thibault Pautrel 1 , Florent Bouchard 1 , Ammar Mian 3 , Guillaume Ginolhac 3 Abstract We introduce two federated learning frameworks for the classical SPDnet model operating on symmetric positive definite (SPD) matrices with Stiefel-constrained parameters. Unlike standard Euclidean averaging, which violates orthogonality, our approach preserves geometric structure through two efficient aggregation strategies: ProjAvg, projecting arithmetic means onto the Stiefel manifold, and RLAvg, approximating tangent-space averaging via retractions and liftings. Both methods are computationally efficient, independent of the optimizer, and enable scalable federated learning for signal processing applications whose features are SPD matrices. Simulations on EEG motor imagery benchmarks show that FedSPDnet outperforms federated EEGnet in F1 score and robustness to federation and partial participation, while using fewer parameters per communication round. I Introduction Federated learning (FL) enables collaborative model training without centralizing raw data, typically by iteratively averaging parameters on a central server as in FedAvg [ 23 , 25 , 20 ] . Subsequent refinements such as FedProx [ 20 , 26 ] and SCAFFOLD [ 14 ] improve robustness under data heterogeneity and client drift, but remain limited to Euclidean parameter spaces and do not extend to non-Euclidean geometries. In parallel, the last decade has seen a surge of interest in Riemannian optimization, which generalizes classical optimization to parameters living on manifolds [ 2 , 5 ] . Such techniques are crucial for learning problems with geometric constraints, including low-rank matrix factorization, dimensionality reduction, and orthogonal parameterizations. In deep learning, Riemannian models have proven particularly effective when operating on structured data such as symmetric positive definite (SPD) covariance matrices, leading to architectures like SPDnet [ 12 ] . SPDnet integrates bilinear mappings on the Stiefel manifold with nonlinear eigenvalue rectification, ensuring that intermediate representations remain SPD while reducing dimensionality in a geometry-preserving way. This architecture has proven its effectiveness in several applications such as micro-Doppler radar [ 6 ] , electroencephalography [ 16 ] , and ground-penetrating radar [ 13 ] . Some works [ 18 , 27 , 10 , 11 ] have proposed adapting federated learning architectures to Riemannian manifolds, but these studies are fairly general and do not concern the SPDnet network. In this paper, we therefore propose new federated architectures that assume that all clients use the SPDnet network. To develop a manifold-based federated learning model, the main challenge lies in aggregating parameters: while local training on clients leverages optimization methods adapted to the manifold, the server-side averaging step must also be designed to obtain a result that belongs to the manifold. The optimal solution is therefore to use a Riemannian mean [ 5 ] , which allows to obtain the barycenter of a set of parameters belonging to the specific manifold. Unfortunately, this step is tricky for SPDnet. This is because SPDnet network parameters are mainly orthogonal matrices that belong to the Stiefel manifold. However, it is well known [ 4 ] that calculating the Riemannian mean in this manifold is computationally expensive and therefore impossible to use for large-scale federated learning. Inspired by the geometric tools from [ 4 ] , we propose two lightweight, geometry-preserving aggregation strategies for SPDnet: (i) ProjAvg, which computes Euclidean averages of local weights and maps them back onto the Stiefel manifold via polar decomposition, and (ii) RLAvg, which approximates tangent-space Riemannian averaging using retractions and liftings. Both methods are computationally efficient, simple to implement, and guarantee that Stiefel constraints are preserved throughout training. By combining strong geometric motivations with practical algorithmic design, our work proposes a scalable deployment of SPDnet in federated learning applications. In particular, the proposed architecture is more robust than the one proposed in [ 10 ] because it does not depend on the local optimizer used in the clients. Numerical experiments on real EEG data show that the performance of our federated models matches that of a centralized model for a small number of clients. II Background This section presents the key elements that are needed to develop our proposed federated learning method adapted to the SPDnet architecture. Since SPDnet weights are orthogonal, we first introduce Riemannian geometry and optimization on the Stiefel manifold. Then, we provide details on the SPDnet architecture. II-A Riemannian geometry and optimization on Stiefel The Stiefel manifold [ 2 , 5 ] is defined as \textrm{St}_{p,k}=\{\bm{W}\in\mathbb{R}^{p\times k}:\,\bm{W}^{\top}\bm{W}=\bm{I}_{k}\} . At \bm{W}\in\textrm{St}_{p,k} , the tangent space is T_{\bm{W}}\textrm{St}_{p,k}=\{\bm{X}\in\mathbb{R}^{p\times k}:\,\bm{W}^{\top}\bm{X}+\bm{X}^{\top}\bm{W}=\bm{0}\} . We endow it with the Euclidean metric: for \bm{X},\bm{Y}\in T_{\bm{W}}\textrm{St}_{p,k} , \langle\bm{X},\bm{Y}\rangle_{\bm{W}}=\tr(\bm{X}^{\top}\bm{Y}) . From there, in the context of federated learning, we need geometrical tools on \textrm{St}_{p,k} to: (i) perform Riemannian optimization, and (ii) aggregate points on \textrm{St}_{p,k} . Concerning the optimization of a cost function, one needs the Riemannian gradient to obtain a descent direction on the tangent space and a retraction to get a new iterate on the manifold from it. Given a cost function f:\textrm{St}_{p,k}\to\mathbb{R} , the Riemannian gradient \mathrm{grad}f(\bm{W}) at \bm{W} is the unique tangent vector such that, \forall\bm{X}\in T_{\bm{W}}\textrm{St}_{p,k} , \langle\mathrm{grad}f(\bm{W}),\bm{X}\rangle_{\bm{W}}=\diff f(\bm{W})[\bm{X}], where \diff f(\bm{W})[\bm{X}] denotes the directional derivative of f at \bm{W} in direction \bm{X} . For \textrm{St}_{p,k} , it can be obtained from the Euclidean gradient \nabla f(\bm{W}) through \mathrm{grad}f(\bm{W})=P_{\bm{W}}(\nabla f(\bm{W})) , where P_{\bm{W}}:\mathbb{R}^{p\times k}\to T_{\bm{W}}\textrm{St}_{p,k} is the orthogonal projection [ 2 , 5 ] P_{\bm{W}}(\bm{X})=\bm{X}-\frac{1}{2}\bm{W}(\bm{W}^{\top}\bm{X}+\bm{X}^{\top}\bm{W}). (1) On Stiefel, an advantageous retraction R_{\bm{W}}:T_{\bm{W}}\textrm{St}_{p,k}\to\textrm{St}_{p,k} at \bm{W} is [ 2 , 5 ] R_{\bm{W}}(\bm{X})=\mathcal{P}(\bm{W}+\bm{X})=\mathrm{uf}(\bm{W}+\bm{X}), (2) where \mathcal{P}:\mathbb{R}^{p\times k}\to\textrm{St}_{p,k} is the projection on Stiefel obtained by taking the orthogonal factor of the polar decomposition. To aggregate points on a Riemannian manifold, the natural solution is to exploit the Riemannian mean. To be able to compute it, one needs three elements: the Riemannian exponential and logarithm mappings, and the Riemannian distance [ 2 , 5 ] . These three objects rely on geodesics, which generalize the concept of straight lines on the manifold. Unfortunately, for \textrm{St}_{p,k} , the Riemannian logarithm and distance are unknown. Hence, the Riemannian mean is not available and another solution needs to be found to aggregate points. It will be the contributions of Section III-B . II-B SPDnet architecture SPDnet [ 12 ] is a lightweight deep learning architecture (see Figure 1 ) operating on SPD (covariance) matrices in a SPD-preserving way while reducing dimension thanks to BiRe blocks. Such blocks combine a BiMap layer, performing bilinear projection for dimensionality reduction: \bm{\bar{\Sigma}}_{\ell}=\bm{W}_{\ell}^{\top}\bm{\Sigma}_{\ell-1}\bm{W}_{\ell},\,\bm{W}_{\ell}\in\textrm{St}_{d_{\ell-1},d_{\ell}}, and a ReEig layer inducing non-linearity by eigenvalues rectification: \bm{\Sigma}_{\ell}=\bm{U}\max(\varepsilon\bm{I}_{d_{\ell}},\bm{\Lambda})\bm{U}^{\top},\,\bm{\bar{\Sigma}}_{\ell}=\bm{U}\bm{\Lambda}\bm{U}^{\top}. After L BiRe blocks, the representation \bm{\Sigma}_{L-1} is mapped from the SPD manifold to the Euclidean space through the LogEig layer \bm{\Sigma}_{L}=\bm{U}\log(\bm{\Lambda})\bm{U}^{\top},\,\bm{\Sigma}_{L-1}=\bm{U}\bm{\Lambda}\bm{U}^{\top} and finally fed to a softmax classifier via half-vectorization, \hat{y}=\text{softmax}(\bm{\xi}\mathrm{vech}(\bm{\Sigma}_{L})+\bm{\beta}),\,\bm{\xi}\in\mathbb{R}^{K\times\nicefrac{{d_{L}(d_{L}+1)}}{{2}}},\,\bm{\beta}\in\mathbb{R}^{K}, where K is the number of classes. The learnable parameters are \theta=(\bm{W}_{1},\dots,\bm{W}_{L},\bm{\xi},\bm{\beta}). Input \bm{\Sigma}_{0}\in\mathcal{S}_{d_{0}}^{++} BiMap \bm{W}_{1} ReEig( \varepsilon ) BiRe block 1 \cdots BiMap \bm{W}_{L} ReEig( \varepsilon ) BiRe block L LogEig softmax \bm{\xi},\bm{\beta} vech Output \hat{y} Figure 1: General SPDnet architecture [ 12 ] : a chain of L stacked BiRe ( BiMap + ReEig ) blocks, followed by LogEig mapping to Euclidean space and a fully connected softmax classifier. Learnable parameters are Stiefel weights \bm{W}_{1},\dots,\bm{W}_{L} and Euclidean weights \bm{\xi} , and bias \bm{\beta} . III Federated Learning with SPDnet Architecture In this section, we give the main contribution of the paper: a new federated learning framework adapted

Read the complete text