Propius: A Platform for Collaborative Machine Learning across the Edge and the Cloud
Eric Ding, Cornell University · 2025
Read Propius: A Platform for Collaborative Machine Learning across the Edge and the Cloud by Eric Ding, Cornell University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19617.txt.
Introduction
Eric Ding proposes Propius, a platform for running collaborative machine learning jobs across edge devices and the cloud. Collaborative training lets many machines learn together without centralizing private data, but most research teams hand-build a one-off server system for each project. Such systems do not scale or transfer between projects.
Propius splits into a control plane, which shares resources among several jobs under configurable policies, and a data plane, which handles model sharing and result collection at scale. It adapts to the varied speeds of client machines. In evaluations it beat existing resource management approaches on utilization, throughput, and job completion time, with utilization improving by up to a factor close to two.
Catalog record
| CREATOR | Eric Ding, Cornell University |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-19617
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Propius: A Platform for Collaborative Machine Learning across the Edge and the Cloud Eric Ding, Cornell University Abstract Collaborative Machine Learning is a paradigm in the field of distributed machine learning, designed to address the challenges of data privacy, communication overhead, and model heterogeneity. There have been significant advancements in optimization and communication algorithm design and ML hardware that enables fair, efficient and secure collaborative ML training. However, less emphasis is put on collaborative ML infrastructure development. Developers and researchers often build server-client systems for a specific collaborative ML use case, which is not scalable and reusable. As the scale of collaborative ML grows, the need for a scalable, efficient, and ideally multi-tenant resource management system becomes more pressing. We propose a novel system, Propius, that can adapt to the heterogeneity of client machines, and efficiently manage and control the computation flow between ML jobs and edge resources in a scalable fashion. Propius is comprised of a control plane and a data plane. The control plane enables efficient resource sharing among multiple collaborative ML jobs and supports various resource sharing policies, while the data plane improves the scalability of collaborative ML model sharing and result collection. Evaluations show that Propius outperforms existing resource management techniques and frameworks in terms of resource utilization (up to 1.88 × 1.88\times ), throughput (up to 2.76 × 2.76\times ), and job completion time (up to 1.26 × 1.26\times ). 1 Introduction Collaborative Machine Learning is a paradigm in the field of distributed machine learning, designed to address the challenges of data privacy issues. Computation tasks are distributed over client edge devices (mobile phones, IoT devices) and silos (companies, hospitals) for machine learning and data analysis. Collaborative ML can be viewed as a superset of Federated Learning (FL) [ 5 ] . Collaborative ML enables privacy-preserving and affordable ML, and unlocks huge amounts of private data for training by moving the models to the client side. These benefits are becoming more prominant in the age of generative AI, as limited public-accessible data are available for generative model training, and concerns about privacy are growing. With collaborative ML, developers can have the access to an increasing amount of private data for building better models in terms of accuracy and customization. As main collaborative ML workload is performed on client devices with client data, it is also natural for clients to continue use trained local model for inference with better customization and privacy. However, the large volume and heterogeneity nature of the client machines lead to challenges in device resource management. Collaborative ML developers usually need to build custom server-client protocols and softwares to implement custom algorithm to enforce client selection logic, which is time-consuming and cost-prohibitive. If individual job framework requires a fixed set of resource due to the lack of resource management, client resources could be underutilized, as some jobs may not be able to fully utilize the resources allocated to them. Resource sharing could be beneficial in improving resource utilization, but it could also lead to resource contention and thus long training time, as multiple collaborative ML jobs are running on the same client corpus, requesting resources with the best performance and source data quality. On top of the resource management issues present in collaborative ML, ML plan (weights, training parameters) delivery and result collection (gradients, output of model) across large number of jobs and clients present a scalability challenge. Typical number of simultaneously participating clients required for a single job could be in the order of tens to tens of thousands. Also, low bandwidth network between client edge devices and parameter servers leads to long communication latency, creating model update and compute ramp-up delay. Existing resource management techniques and frameworks fail to rise up to the challenge. Conventional resources in the cloud (GPUs in data centers, data lakes) often have better characteristics than client machines in terms of availability and capacity. Federated learning frameworks (Flame [ 1 ] , FedScale [ 4 ] , etc.) mostly focus on optimizing single-job training performance, and do not consider the resource management and sharing among multiple jobs. To solve these problems, we propose a novel system, Propius, that can adapt to the heterogeneity of client machines, and efficiently manage and control the computation flow between ML jobs and edge resources in a scalable fashion. Propius is comprised of a control plane and a data plane. We propose a novel control plane design where the scheduling mechanism is tailored to heterogeneous and transcient resources in collaborative ML setting. Contrary to traditional resource scheduling system where resources are generally static and long-lived, Propius resources, such as edge devices, are short-lived and dynamic. This challenge is addressed by the soft-state design principle of the scheduler, where only the states of clients in a sliding window are maintained in the system. Most of the scheduling states and decisions are mounted on the job framework ends, whose states and scale are more stable and manageable. Specifically, there are two modes of scheduling in Propius scheduler, which scheduling policy plugins can choose from: (1) online scheduling, and (2) small-batch scheduling. Propius data plane enables scalable collaborative ML plan sharing and result collection for large number of jobs and clients. Optimization algorithms for collaborative ML, such as FedAvg [ 5 ] , are supported in Propius data plane, as long as they satisfy associativity and communitivity. In summary, Propius provides several benefits: it 1. Hides the details of heterogeneous client resource management so developers can focus on developing learning and analytics models and algorithms instead. 2. Avoids allocation conflict and maximizes resource utilization by coordinating among multiple collaborative ML jobs. 3. Allows jobs to cherry-pick desired amount of resources in terms of device system attributes. 4. Supports various scheduling algorithms for different performance objectives. 2 Propius Overview Propius consists of two main components: the control plane and the data plane. The control plane is responsible for managing the job and client requests, and providing coordination during the resource allocation process. The data plane is responsible for distributing execution planes from the cloud to geo-distributed clients, collecting updates or outputs from clients, and performing reduction operation during results collection. Fig. 1 shows the architecture of Propius. Propius is designed to support a wide range of job frameworks, as long as they fall into the category of server-client topologies and adopt round-based communication pattern where there are a one-to-all model plan distribution phase and a all-to-one reduction (aggregation) phase in each round. Propius does not support hybrid topologies where clients communicate with each other [ 1 ] . Through Propius data plane, individual job framework has the access to current round results computed by the data plane through a simple API call. Each job framework needs to provide a reducer plugin for the data plane to use during the reduction phase. All the reduction computation from the contributions of all selected clients for the current round and communications are offloaded to the data plane, and job frameworks are only responsible for the model update step at the end of each round for better customization and generalizability of the data plane. However, the convenience comes at a cost. Job frameworks do not have access to individual