Two Teachers Better Than One: Hardware-Physics Co-Guided Distributed Scientific Machine Learning
Yuchen Yuan *† 1 , Junhuan Yang † 1 , Hao Wan 1 , Yipei Liu 1 , Hanhan Wu 1 , Youzuo Lin 2 , and Lei Yang * 1 · 2026
Read Two Teachers Better Than One: Hardware-Physics Co-Guided Distributed Scientific Machine Learning by Yuchen Yuan *† 1 , Junhuan Yang † 1 , Hao Wan 1 , Yipei Liu 1 , Hanhan Wu 1 , Youzuo Lin 2 , and Lei Yang * 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09032.txt.
Introduction
Yuchen Yuan and colleagues distribute scientific machine learning across devices with hardware and physics guidance. Centralized models demand raw data aggregation at one node, costing latency and energy, while general-purpose models break physical principles. Their EPIC encodes lightly on end devices and decodes centrally with physics awareness, sending compact features instead of raw data and cutting latency and energy sharply while keeping fidelity.
Catalog record
| CREATOR | Yuchen Yuan *† 1 , Junhuan Yang † 1 , Hao Wan 1 , Yipei Liu 1 , Hanhan Wu 1 , Youzuo Lin 2 , and Lei Yang * 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35630 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.09032
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Two Teachers Better Than One: Hardware-Physics Co-Guided Distributed Scientific Machine Learning Yuchen Yuan *† 1 , Junhuan Yang † 1 , Hao Wan 1 , Yipei Liu 1 , Hanhan Wu 1 , Youzuo Lin 2 , and Lei Yang * 1 Abstract . Scientific machine learning (SciML) is increasingly applied to in-field processing, controlling, and monitoring; however, wide-area sensing, real-time demands, and strict energy and reliability constraints make centralized SciML implementation impractical. Most SciML models assume raw data aggregation at a central node, incurring prohibitively high communication latency and energy costs; yet, distributing models developed for general-purpose ML often breaks essential physical principles, resulting in degraded performance. To address these challenges, we introduce EPIC, a hardware- and physics-co-guided distributed SciML framework, using full-waveform inversion (FWI) as a representative task. EPIC performs lightweight local encoding on end devices and physics-aware decoding at a central node. By transmitting compact latent features rather than high-volume raw data and by using cross-attention to capture inter-receiver wavefield coupling, EPIC significantly reduces communication cost while preserving physical fidelity. Evaluated on a distributed testbed with five end devices and one central node, and across 10 datasets from OpenFWI, EPIC reduces latency by 8.9 × \times and communication energy by 33.8 × \times , while even improving reconstruction fidelity on 8 out of 10 datasets. 1. Introduction With the rapid advancement of AI for science, scientific machine learning (SciML) is increasingly adopted to support monitoring and decision-making in real-world applications. However, when these SciML models transition from laboratory studies to field-scale deployments, they need to process continuous streams of high-resolution sensor data while meeting constraints on communication bandwidth, energy consumption, latency, and reliability. These practical requirements challenge many assumptions underlying current SciML workflows and necessitate a rethinking of how to design, deploy, and manage SciML models efficiently in the field. Most existing SciML studies [ 10 , 14 , 26 , 25 ] , whether explicitly or implicitly, follow a centralized design, assuming that raw measurements collected across distributed sensors are transmitted to a central server for inference. Data communication in such a scheme can easily become a performance bottleneck: high-rate sensor streams quickly saturate the limited bandwidth, and long-distance data transfer introduces substantial latency and energy overhead. Moreover, these studies make the ideal assumption that all data can reach the central node, and that a single point of failure can compromise the entire model, which is critically vulnerable in remote or harsh environments. As a result, existing centralized SciML approaches are poorly suited for wide-area, real-time scientific deployments. Inspired by advances in edge computing [ 13 , 11 , 21 , 24 ] , moving computation closer to data sources offers a promising solution to alleviate the communication bottlenecks. However, simply applying existing ML designs in a distributed manner is nontrivial: many SciML tasks rely on global physical coupling, and partitioning computation across devices can violate these physical dependencies, severely degrading inference quality. To better understand the practical needs and challenges of deploying SciML in the field, this paper takes full-waveform inversion (FWI) — a physics-governed inverse problem — as a vehicle to examine design choices of different distributed computing paradigms and their limitations. FWI reconstructs subsurface velocity models by repeatedly simulating seismic wave propagation governed by partial differential equations (PDEs), which was initially used in geoscience [ 17 , 15 ] . In recent years, data-driven FWI has emerged to address the computational inefficiency of physics-driven FWI and has been applied to other acoustic imaging applications, such as ultrasound in healthcare [ 8 , 12 , 22 ] . Like other SciML methods, data-driven FWI (e.g., the representative InversionNet [ 20 ] ) assumes a centralized design with ideal execution environments. In this paper, we evaluate the centralized InversionNet [ 20 ] on a distributed computing testbed using wireless communication, which is often required because wired infrastructure is unavailable in remote or harsh environments such as deserts or the open ocean. Results from an emulated 4G environment validate our hypothesis that communication becomes a performance bottleneck, accounting for up to 93% of total latency. We also assess two off-the-shelf distributed ML approaches, including a Federated Learning-style Approach (FLA) [ 9 ] and a Split Learning-style Approach (SLA) [ 3 ] , both of which suffer significant performance degradation. We investigate the root causes and find that the distributed waveforms from different end devices are highly correlated, making FLA ineffective; moreover, these correlations are highly position-dependent and not equally informative across receivers, making SLA ineffective. To address the challenges posed by both communication bottlenecks and physical violations, we propose EPIC, an E dge-compatible and P hysics- I nformed distributed S c iML framework. The core component in EPIC is a physics-informed distributed neural network, referred to as EPIC-Net, which interoperates with additional system-level deployment and management modules to address practical challenges in the field. EPIC-Net decomposes the inversion pipeline into a lightweight local encoding on end devices to extract compact features and a physics-informed decoding for reconstruction at the central node. As such, the communication bottleneck can be addressed by transmitting compact features (i.e., latent) instead of raw data; moreover, a cross-attention mechanism [ 6 ] at the central node ensures that feature fusion captures spatial coupling of wavefields across receivers. Main contributions : • We devise a hardware-physics co-guided distributed SciML model, namely EPIC-Net, addressing communication bottlenecks while adhering to underlying physical principles. • We develop the holistic EPIC framework, enabling efficient deployment and robust run-time of EPIC-Net onto resource-constrained distributed computing infrastructures. • We validate the EPIC framework on a testbed composed of end devices, demonstrating significant reductions in latency and communication cost, while maintaining high inference accuracy and robustness under network variability. EPIC is evaluated on a distributed testbed with five end devices and one central node, using 10 datasets from OpenFWI [ 2 ] for inversion fidelity test. Results show that EPIC can achieve up to 8.9 \times and 33.8 \times reductions in latency and communication energy, respectively, compared with a conventional centralized baseline. Notably, EPIC also improves reconstruction fidelity on 8 out of 10 datasets, with performance on the remaining 2 datasets only marginally lower (by 0.3% SSIM). We attribute this unexpected gain to the hardware-physics co-guidance, which regularizes the network toward physically consistent solutions. 2. Challenge and Hardware-Physics Guidance 2.1 Challenge: Communication latency can become bottleneck in the centralized in-field scientific machine learning We built a hardware testbed of six devices, as shown in Figure 1 (a), including (1) five end devices (\mathcal{D}_{1},\ldots,\mathcal{D}_{5}) that collect input sensor data and (2) one central device ( \mathcal{D}_{c} ) that generates the final output velocity map. The testbed can run under Wi-Fi through a gigabit router for communication; it also emulates a high-quality 4G cellular network by limiting the upload bandwidth to 15 Mbps, setting a 50ms latency, and a 0.5% packet loss rate [ 4 ] . Figure 1 . In-house testbed and latency breakdown of centralized InversionNet [ 20 ] across two network settings. To identify the performance bottleneck, we measure the proportion of time spent on computation and communication across devices, as reported in Figure 1 (b)(c), for real-world Wi-Fi and 4G emulation settings. By deploying InversionNet [ 20 ]