Federated Nonlinear System Identification

Omkar Tupe* [email protected], Max Hartman* [email protected], Lav R. Varshney [email protected], Saurav Prakash [email protected] · 2025

Read Federated Nonlinear System Identification by Omkar Tupe* [email protected], Max Hartman* [email protected], Lav R. Varshney [email protected], Saurav Prakash [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15025.txt.

Introduction

Factories and farms may want one shared model of a machine's behavior without pooling their raw data. Omkar Tupe, Max Hartman, Lav Varshney, and Saurav Prakash studied that task in 2025 for nonlinear systems, in a federated setup where each client keeps its data and shares only model updates. They treat systems whose behavior is a weighted mix of known nonlinear features.

Their theory shows the shared estimate improves as more clients join, at a rate matching the centralized case up to a constant set by the feature choice. Experiments on pendulum and drone-like systems backed the theory under varied noise. Choosing features that excite the system well was key to good results.

Catalog record

CREATOROmkar Tupe* [email protected], Max Hartman* [email protected], Lav R. Varshney [email protected], Saurav Prakash [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15025

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Federated Nonlinear System Identification Omkar Tupe* [email protected], Max Hartman* [email protected], Lav R. Varshney [email protected], Saurav Prakash [email protected] Abstract We consider federated learning of linearly-parameterized nonlinear systems. We establish theoretical guarantees on the effectiveness of federated nonlinear system identification compared to centralized approaches, demonstrating that the convergence rate improves as the number of clients increases. Although the convergence rates in the linear and nonlinear cases differ only by a constant, this constant depends on the feature map ϕ \phi , which can be carefully chosen in the nonlinear setting to increase excitation and improve performance. We experimentally validate our theory in physical settings where client devices are driven by i.i.d. control inputs and control policies exhibiting i.i.d. random perturbations, ensuring non-active exploration. Experiments use trajectories from nonlinear dynamical systems characterized by real-analytic feature functions, including polynomial and trigonometric components, representative of physical systems including pendulum and quadrotor dynamics. We analyze the convergence behavior of the proposed method under varying noise levels and data distributions. Results show that federated learning consistently improves convergence of any individual client as the number of participating clients increases. † † footnotetext: * denotes equal contribution 1 Introduction Dynamical system models describe how a system evolves over time based on its current state, control inputs, and external disturbances. These models are central to fields including control theory, physics, and robotics ( Willems 1989 ) . A common class of such systems is linear time-invariant (LTI) systems, where the next state and output are linear functions of the current state and input, governed by parameters that remain constant over time ( Sibai & Mitra 2018 ) . In contrast, nonlinear systems allow these dependencies to be governed by nonlinear functions, offering more accurate representations for many real-world systems with complex or nonstationary behavior ( Guckenheimer & Holmes 2013 ; Jiang & Lai 2019 ) . Figure 1: Federated learning framework for nonlinear dynamical system identification involving M clients which are similar but non-identical in nature and a central server. In each global communication round r , client C_{i} receives the global model \theta_{s} performs local updates using its own trajectories data, and transmits the locally updated model \theta_{i} back to the server. The server then aggregates the models to obtain an updated global model for the next round. System identification is the process of learning dynamical models from input and output data. In this way, one can learn the dynamics of a system in a data-driven way, without explicit physical derivations. It is often used to learn dynamical systems in the real world, where exact dynamics are unknown, with applications including robotics, fluid dynamics, and physics ( Sarkar et al. 2021 ; Venkatesh & Dahleh 2002 ) . Traditional approaches for system identification typically assume access to centralized datasets. However, in modern deployments—such as multi-robot systems, sensor networks, and connected vehicles—data is naturally distributed across many devices. Transmitting all data to a central location is often impractical due to privacy, bandwidth, or energy limitations. To address these challenges, we consider federated system identification, which is emerging as a privacy-preserving alternative. In this paradigm, multiple clients collaboratively learn a model without sharing raw data, communicating only model updates. Prior work has explored federated identification for LTI systems ( Wang et al. 2023 ) , demonstrating convergence benefits that scale with the number of participating clients. However, this line of work is restricted to linear models, which fundamentally limits its applicability. In this paper, we study the problem of federated nonlinear system identification. We consider a setting where M distributed clients each observe trajectory data from potentially different nonlinear dynamical systems that nonetheless belong to the same underlying family (see Figure 1 ). Dynamical systems at clients exhibit heterogeneity, modeled via a heterogeneity parameter \epsilon . This setup captures realistic scenarios such as learning dynamics across a fleet of heterogeneous robots or drones—each operating under different conditions due to hardware differences, controller tunings, or external disturbances. The goal is to identify a shared nonlinear model that generalizes across these clients while respecting local variability and preserving data privacy. 1.1 Key Contributions (a) (b) (c) Figure 2: Impact of client count and heterogeneity on federated nonlinear system identification. (a) Estimation error versus number of clients M at fixed trajectories per client N_{i}=10 and heterogeneity bound \epsilon=0.01 ; (b) Estimation error versus M for the same N_{i} with \epsilon=5 , illustrating increased model-mismatch tolerance; (c) Estimation error as a function of \epsilon for fixed M and N_{i} , showing sensitivity of global model accuracy to client-level parameter variations. • Nonlinear framework. We consider linearly parameterized nonlinear dynamical systems, with a focus on the widely used piecewise affine (PWA) model for representing nonlinear dynamics ( Mania et al. 2022 ; Musavi et al. 2024 ) . In PWA models, state transitions are expressed as linear functions of nonlinear feature embeddings of state-input pairs. While prior work has explored federated system identification of linear dynamical systems, to the best of our knowledge, this work develops the first federated learning framework for system identification of PWA-based nonlinear dynamical systems. • Theoretical analysis. We theoretically analyze the convergence of the federated nonlinear system identification problem. Our results show that clients benefit significantly by collaborating through federated learning. Particularly, we show that the convergence error decreases as \mathcal{O}(1/\sqrt{M}) , where M is the number of clients, thus having significant improvement in convergence as more clients collaborate. Additionally, our results theoretically characterize how heterogeneity across clients impacts the convergence error. • Experimental analysis. To corroborate our theoretical results, we conduct extensive experiments analyzing the convergence behavior of our approach as a function of the total number of participating clients, the number of local samples at each client, as well the heterogeneity of dynamical systems across clients. We preview some results in Figure 2 , which are based on real-world pendulum dynamics. Complete details are provided in Section 4 . • Algorithm validation. Our experiments demonstrate that our federated approach achieves improved convergence rate compared to a single-client system, while offering the additional advantage of client data privacy. 2 Related Works 2.1 System Identification Ljung 1998 provides an overview of mathematical methods for building models of dynamical systems using input and output signal measurements, focusing on how parameter estimation techniques can be applied to characterize system behavior in both time and frequency domains. This approach is instrumental in transforming observed data into predictive models, supporting applications in signal processing and control. Jedra & Proutiere 2020 present a robust finite-time error bound for identifying stable linear systems using the ordinary least-squares (OLS) estimator. Simchowitz et al. 2018 also analyze OLS identification from a single trajectory for stable and marginally stable linear time-invariant systems, using the block-martingale small-ball method to address mixing dependencies and establish nearly optimal estimator rates for a wide class of linear time series. While deriving tight, regime-specific finite-time error rates for OLS identification of general linear systems, Sarkar & Rakhlin 2019 establish that OLS is optimally consistent only under specific regularity conditions, unifying previous results across all spectral regimes. However, this approach struggles with nonlinear or complex signal structures, often requiring significant computational resources and large datasets to achieve reliable identification. 2.2 Federated Learning Federated learning is

Read the complete text