FedADAS: Communication-Efficient Federated Distillation for On-Device Driver Yawn Recognition in Vehicular Networks

Ahmed Mujtaba, Gleb Radchenko, Marc Masana, Radu Prodan · 2026

Read FedADAS: Communication-Efficient Federated Distillation for On-Device Driver Yawn Recognition in Vehicular Networks by Ahmed Mujtaba, Gleb Radchenko, Marc Masana, Radu Prodan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-19480.txt.

Introduction

Mujtaba and team present FedADAS, letting cars learn driver-yawn detection together without sharing raw data or matching models. Each vehicle swaps only soft logits on a shared public set, so models can differ to fit local limits. An edge yawn pipeline offers a 99.7 megabyte version scoring 98.3 percent F1 in under two milliseconds, and a 0.6 megabyte version training an epoch in about six minutes. With up to 115 clients it beats standard federated learning while cutting communication cost by up to 9974 times.

Catalog record

CREATORAhmed Mujtaba, Gleb Radchenko, Marc Masana, Radu Prodan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35094
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.19480

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FedADAS: Communication-Efficient Federated Distillation for On-Device Driver Yawn Recognition in Vehicular Networks Thanks: This paper is accepted in the 28th International Conference on Pattern Recognition (ICPR) 2026. Ahmed Mujtaba, Gleb Radchenko, Marc Masana, Radu Prodan Abstract Driver fatigue is a critical safety concern in advanced driver assistance systems. Driver monitoring models trained off-site on static datasets adapt poorly to real-world conditions, while standard federated learning imposes high communication overhead, assumes homogeneous architectures, and struggles with personalized driver data. We present FedADAS, a federated distillation framework enabling collaborative on-device learning across heterogeneous vehicular networks. FedADAS enables full model heterogeneity by exchanging only soft logits on a shared public dataset, allowing each vehicle to run a customized model tailored to its computational constraints. Additionally, we introduce a yawn recognition pipeline supporting training and inference on edge devices that provides two robust architectures: Performance-Efficient ( 99.7 99.7 MB) achieving 98.3 98.3 % F1-score with 1.99 1.99 ms inference time on a Jetson NANO, and a Memory-Efficient ( 0.6 0.6 MB) that trains an epoch in 6.12 6.12 minutes on a Jetson AGX Orin. In experiments with up to 115 edge clients, FedADAS significantly outperforms traditional federated learning approaches at higher client participation, achieving up to 9974 9974 × \times reduction in communication cost while maintaining a superior tradeoff between personalization and generalization under extreme data heterogeneity, demonstrating its suitability for real-world deployment. Code is available at https://opensource.silicon-austria.com/mujtabaa/fedadas . 1 Introduction Computer vision, powered with deep learning (DL) models, plays a crucial role in advanced driver assistance systems by interpreting conditions in and around the vehicle and triggering safety interventions. In-cabin monitoring systems and driver monitoring systems (DMS) are key ADAS applications that assess the driver and passenger’s state and behavior to ensure safety and improve the driving experience [ 24 ] . Driver fatigue detection is a core DMS feature that helps prevent road accidents since fatigue significantly impairs a driver’s alertness and reaction time [ 2 ] . DL–based perception models are widely employed in DMS to detect indicators of driver fatigue, including facial cues, head pose, gaze direction, and eye opening and closure patterns [ 24 ] . To enable in-vehicle decisions and ensure low-latency responses, DMS perception models must adapt to the energy and performance constraints of the edge computing nodes installed in vehicles, reducing reliance on cloud platforms. Recent DMS research emphasizes optimized DL models to enable real-time, low-latency on-board inference, reducing dependence on cloud connectivity and supporting continuous in-vehicle operation [ 24 ] . However, these models are still trained off-site on static datasets, limiting their adaptability to the diverse conditions encountered in real-world driving environments. Repeatedly fine-tuning the models to real-driving environments through on-device learning also entails the risk of overfitting on local data. Federated learning (FL) [ 20 ] enables edge nodes to collaboratively train generalized DL models on locally available data by exchanging model parameters with a central server, which aggregates and redistributes updated models globally, allowing their continuous improvement across the fleet. However, several critical obstacles in edge-based vehicular settings prevent the adoption of FL. 1. Device heterogeneity , unable to host a common DL model architecture compatible with FL, or incurring unacceptably high local training time. 2. Communication overhead for frequent exchange of model parameters, critical on vehicles with limited or low-power hardware connectivity [ 14 ] . 3. Non-independent and identically distributed (non-IID) local data due to driver-specific behavior, sensor performance, and environment conditions, complicating global model convergence. Federated distillation (FD) [ 15 ] addresses the challenges of FL by eliminating the requirement of sharing a common DL model architecture, enabling edge devices to run a customized model adapted to their resource capabilities. To transfer knowledge, FD clients share only model outputs ( logits ) on a common public dataset, significantly reducing communication overhead [ 22 ] . This works makes the following technical contributions: • We present FedADAS , a first FD-based framework for collaborative learning among vehicular networks with complete model heterogeneity. FedADAS enables vehicles to train local DL models collaboratively by sharing logits on a shared public dataset with the server for aggregation. The aggregated logits on the server act as an ensemble knowledge for the vehicles in distilled form. A scalability test with over 100 vehicles for a yawn classification task establishes that FedADAS significantly outperforms traditional FL [ 20 ] with nearly 9974 \times communication cost reduction, and provides the best personalization and generalization tradeoff for local DL models in cross-vehicular learning scenarios. • We evaluate FedADAS on driver yawn recognition as a representative DMS classification task; the underlying logit-exchange and KD mechanisms make no task-specific assumptions and are applicable to multi-class perception tasks. Additionally, we introduce a lightweight DMS pipeline for yawn recognition that meets the constraints of edge computing platforms and incorporates two robust yawn classification architectures: Memory-Efficient and Performance-Efficient. We comprehensively evaluate the DMS pipeline using YawDD+ [ 21 ] on NVIDIA Jetson AGX and NANO. Table 1 : Related work summary. Related work Method Model heterogen. Public data Clients Edge train Shared information FedHotpot [ 28 ] FL No No 20 No model params pFedVs [ 17 ] FL No No 20-100 No model params FedLane [ 7 ] FL No No 3 No model params FedBiKD [ 25 ] FL and KD No Yes 20 No model params FedCMD [ 5 ] hybrid FL-KD No Yes 4-30 No model params; soft logits Data-Free [ 16 ] hybrid FL-KD No No 3–10 No model params; interm. features FedDLD [ 30 ] hybrid FL-KD No No 20–50 No model params; soft logits DB-EPFD [ 11 ] hybrid FL-KD Partial No 10–20 No partial model params FedADAS (Ours) FD Yes Yes 3–115 Yes soft logits 2 Related Works Collaborative learning has emerged as a promising approach among vehicles for ADAS [ 13 ] . Existing works summarised in Table 1 employ FL and knowledge distillation (KD) to transfer knowledge among vehicles for different ADAS applications. These works share either: 1. model parameters trained on vehicle local data (used in traditional FL frameworks FedHotpot [ 28 ] , pFedVs [ 17 ] , FedLane [ 7 ] ) requiring all vehicles to share same model architecture for accurate aggregation on server; 2. intermediate features of vehicle local model with identical shapes for accurate aggregation; 3. soft logits produced by vehicle local model on shared unlabeled public data for KD. Hybrid FL-KD frameworks, such as FedBiKD [ 25 ] , FedCMD [ 5 ] , Data-Free [ 16 ] , and FedDLD [ 30 ] , incorporate KD but still require homogeneous DL architectures across clients due to the sharing of model parameters. DB-EPFD [ 11 ] achieves partial model heterogeneity by allowing different decision heads while sharing the same model backbone parameters. None of the prior methods support full model heterogeneity, since they are not designed to operate when each client runs a structurally different architecture. FedADAS is the first FD-based framework to achieve complete model heterogeneity, on-device training on edge hardware, and evaluation at fleet scale up to 115 heterogeneous clients. The contribution is therefore a first validated systems-level realization of FD for vehicular edge AI. Video-based methods for DMS yawn recognition sample consecutive frames

Read the complete text