Design-Space Exploration of Distributed Neural Networks in Low-Power Wearable Nodes
Meghna Roy Chowdhury, Ming-Che Li, Archisman Ghosh · 2025
Read Design-Space Exploration of Distributed Neural Networks in Low-Power Wearable Nodes by Meghna Roy Chowdhury, Ming-Che Li, Archisman Ghosh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-14540.txt.
Introduction
Meghna Roy Chowdhury and four co-authors present DistNN in 2025, a framework that splits neural network inference between a wearable and a nearby phone. Wearables for health and vision need smart models that exceed their tiny memory and energy budgets. Cloud offloading adds delay and privacy risk.
DistNN runs early network layers on the ultra low power wearable node. Intermediate features then go to a resource rich hub such as a smartphone for the remaining layers. Splitting keeps raw sensor data local longer and cuts wearable load. Shrinking the model alone, the TinyML route, can sacrifice accuracy and still strain memory on vision tasks. The design space study maps where each layer split balances accuracy, energy and latency best.
Catalog record
| CREATOR | Meghna Roy Chowdhury, Ming-Che Li, Archisman Ghosh |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-14540
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Design-Space Exploration of Distributed Neural Networks in Low-Power Wearable Nodes Meghna Roy Chowdhury, Ming-Che Li, Archisman Ghosh Abstract Wearable devices are revolutionizing personal technology, but their usability is often hindered by frequent charging due to high power consumption. This paper introduces Distributed Neural Networks (DistNN), a framework that distributes neural network computations between resource-constrained wearable nodes and resource-rich hubs to reduce energy at the node without sacrificing performance. We define a Figure of Merit (FoM) to select the optimal split point that minimizes node-side energy. A custom hardware design using low-precision fixed-point arithmetic achieves ultra-low power while maintaining accuracy. The proposed system is ∼ 1000 × \sim\!1000\times more energy efficient than a GPU and averages 11 × 11\times lower power than recent machine learning (ML) ASICs at 30 fps. Evaluated with CNNs and autoencoders, DistNN attains SSIM of 0.90 for image reconstruction and 0.89 for denoising, enabling scalable, energy-efficient real-time wearable applications. I Introduction TABLE I: Machine Learning Techniques and Their High Computation Cost. ML Technique Application Model # Layers # Parameters Deep Neural Networks (DNN) Image Classification ResNet-50 50 25 million VGG-16 16 138 million Object Detection YOLOv3 106 62 million Mobile Net v2 53 3.5 million Autoencoders (AE) Anomaly Detection Denoising AE 20 1–2 million Image Denoising U-Net 23 31 million Dimensionality Reduction Variational AE 20 1 Generative Adversarial Network (GAN) Super Resolution SR-GAN 21 2 million Image to image translation Pix2Pix 15–20 11.5 million Image Synthesis BigGAN 256 112 million Vision Transformers (ViT) Image Classification ViT-B 12 86 million Object Detection DETR 24 41 million Image Segmentation Swin Transformer 12 60 million The Internet of Things (IoT) has experienced exponential growth over the past decade, driven by significant advancements in various domains. In fact, a recent survey showed that the number of IoT devices is expected to reach billions, with the rapid expansion and significant impact of IoT technologies on modern life [ 1 ] . A subsection of IoT, known as the Internet of Bodies (IoB), is also becoming increasingly popular with the advent of sophisticated wearable devices with enhanced functionality and great user experience. IoB leverages low-power sensing and communication technologies like Bluetooth Low Energy (BLE), Zigbee, and Near-Field Communication (NFC) to enable seamless data exchange and integration. Fig. 1: Challenges in wearable nodes and ML hardware: limitations in battery life, memory, and power consumption. DistNN addresses these by offloading computational tasks to resource-rich hubs while maintaining low-power operation at the node. Another factor that has enhanced IoB & IoT functionalities and robustness in recent years is ML. For example, smart home systems use ML-based recommendation systems to learn user preferences, and industrial IoT relies on ML-based predictive models to forecast equipment failures and reduce downtime. In IoB, wearable devices use ML algorithms to analyze physiological data such as heart rate, sleep patterns, and physical activity to provide tailored health insights, detect irregularities like arrhythmias in real-time, and even predict potential health risks, enabling timely medical intervention. Computer vision has also gained immense importance within the wearable device landscape. Advanced ML techniques like Deep Neural Networks (DNN), Autoencoders (AE), Generative Adversarial Networks (GAN), and Vision Transformers (ViT) have played crucial roles in enabling real-time inferences for a wide range of computer vision applications. In the automotive industry, DNNs improve vehicle safety and autonomy by enhancing image recognition in IoT systems. Similarly, AEs, ViTs, and GANs are used in smart glasses for tasks like image reconstruction, segmentation, and generation. Despite being ubiquitous, most wearable IoT and IoB devices face challenges with battery life, disrupting both user experience and device usability. As shown in Fig. 1 , everyday state-of-the-art wearable devices such as smartwatches, fitness trackers, earbuds, and smart glasses, while featuring good form factors and advanced functionality, require frequent charging. This limitation arises because the integrated circuits within these devices must simultaneously support high processing power and minimal energy consumption. For instance, smartwatches typically last around 18 hours without continuous use, AirPods provide an average battery life of 4–5 hours, and the latest smart glasses sustain only 30–40 minutes of continuous data streaming [ 2 , 3 ] . The challenges are further compounded when incorporating machine learning (ML) functionalities. Although it helps increase the device’s functionalities, ML algorithms are computationally intensive and require significant processing power. Furthermore, these algorithms are designed to run on powerful hardware equipped with multiple GPUs, consuming hundreds of watts, which are unsuitable for the area and resource-constrained nature of wearable devices [ 4 ] . Table I illustrates various ML techniques and the large number of parameters associated with commonly used models. Two main approaches that have addressed the challenges of deploying ML models on resource-constrained systems are TinyML and Data Offloading. TinyML involves optimizing traditional NN models for devices with limited computational, memory, and power capabilities. Using libraries like TensorFlow Lite and MicroTensor, these models achieve significant reductions in complexity through techniques like quantization and pruning, enabling deployment on microcontroller units. While TinyML supports ultra-low-power (ULP) operation, it often sacrifices accuracy, making it less suitable for complex tasks. Data offloading addresses this limitation by transmitting raw data to centralized infrastructures, such as cloud servers, via over-the-air communication. These systems handle computationally intensive tasks, reducing the processing burden on edge devices. However, this approach has drawbacks, including increased latency, potential data loss, and privacy risks. Recent advances in distributed ML and edge-cloud integration aim to mitigate these challenges by balancing local and remote processing. Further technical details on these solutions, including performance metrics and trade-offs, are discussed in Section II . The existing literature on offloading primarily focuses on classification tasks, which involve dimension reduction. However, machine vision problems, especially using AE, encounter varying data volumes. Additionally, these studies lack data on the power consumption of wearable nodes and emphasize efficient processing on resource-rich hubs. The contribution of this work is as follows: 1. Introduction of the Distributed Neural Network (DistNN) Framework: We present a novel framework for distributed neural networks that strategically divides computations among ultra-low-power wearable nodes and resource-rich hubs. This framework helps enhance battery life and reduce the need for frequent charging by offloading computationally demanding tasks to hubs. It ensures real-time performance while preserving inference accuracy and demonstrates scalability across various neural network (NN) architectures, including CNNs and AEs. Fig. 2: Trade-off between computational efficiency (FLOPs) and accuracy for DNN and TinyML models in ImageNet classification. 2. Development of an Optimal Distribution Point Framework: A FoM is formulated based on data volume (DV) and computational cost (CC) to optimize neural network split points. This trade-off efficiently balances computational load and communication energy. The methodology is validated on complex machine vision tasks, such as image reconstruction and denoising, with high-quality outputs and SSIM scores of 0.9 and 0.89, respectively. 3. Custom Hardware Design for Wearable Nodes: We build a complete low-power hardware system for machine-vision that can be used in wearable nodes. The system incorporates 8-bit fixed-point arithmetic, significantly reducing energy consumption compared to general-purpose GPUs and ML ASICs. A custom MAC unit is integrated within the system achieves 1.2 pJ at 100 MHz while maintaining 30 fps computational performance. 4. Energy-Efficient Communication and Memory Management: The study formalizes conditions for DistNN to be effective based on