TActiLE: Tiny Active LEarning for wearable devices

1 st Massimo Pavan*, 2 nd Claudio Galimberti*, 3 rd Manuel Roveri · 2025

Read TActiLE: Tiny Active LEarning for wearable devices by 1 st Massimo Pavan*, 2 nd Claudio Galimberti*, 3 rd Manuel Roveri (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01160.txt.

Introduction

Massimo Pavan, Claudio Galimberti, and Manuel Roveri teach wearable devices to ask for labels wisely. Their 2025 paper sits in TinyML, where small devices run learning on board. On-device learning can tailor models to each user, but labeled data on a wrist or pair of glasses is scarce. Asking users to tag mountains of data drives them away.

Their method, TActiLE, scans the stream of sensor data and picks the few items whose labels would help the model most. It is the first active learning scheme built for the tiny-device setting. Tests on several image data sets check both gains and costs. The authors report it fits the tight budgets of wearables while still lifting model quality.

Catalog record

CREATOR1 st Massimo Pavan*, 2 nd Claudio Galimberti*, 3 rd Manuel Roveri
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-01160

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TActiLE: Tiny Active LEarning for wearable devices Thanks: *Equal contribution 1 st Massimo Pavan*, 2 nd Claudio Galimberti*, 3 rd Manuel Roveri Abstract Tiny Machine Learning (TinyML) algorithms have seen extensive use in recent years, enabling wearable devices to be not only connected but also genuinely intelligent by running machine learning (ML) computations directly on-device. Among such devices, smart glasses have particularly benefited from TinyML advancements. TinyML facilitates the on-device execution of the inference phase of ML algorithms on embedded and wearable devices, and more recently, it has expanded into On-device Learning (ODL), which allows both inference and learning phases to occur directly on the device. The application of ODL techniques to wearable devices is particularly compelling, as it enables the development of more personalized models that adapt based on the user’s data. However, one of the major challenges of ODL algorithms is the scarcity of labeled data collected on-device. In smart wearable contexts, requiring users to manually label large amounts of data is often impractical and could lead to user disengagement with the technology. To address this issue, this paper explores the application of Active Learning (AL) techniques, i.e., techniques that aim at minimizing the labeling effort, by actively selecting from a large quantity of unlabeled data only a small subset to be labeled and added to the training set of the algorithm. In particular, we propose TActiLE, a novel AL algorithm that selects from the stream of on-device sensor data the ones that would help the ML algorithm improve the most once coupled with labels provided by the user. TActiLE is the first Active Learning technique specifically designed for the TinyML context. We evaluate its effectiveness and efficiency through experiments on multiple image classification datasets. The results demonstrate that, within the stringent resource constraints of TinyML and wearables environments, TActiLE outperforms both a simple random selection baseline and more complex Stream Active Learning algorithms, demonstrating its suitability for tiny and wearable devices. I Introduction Tiny Machine Learning (TinyML) is a fast-growing field related to artificial intelligence, focusing on applications and technologies for extremely low-profile devices. It allows to push intelligence to the edge reducing latency, power consumption, and bandwidth usage. TinyML enables efficient inference on low-power devices [ 1 ] , but its capabilities can be further enhanced through On-Device Learning, which allows models to learn and evolve locally. Combining the two paradigms facilitates higher responsiveness, privacy-preserving, and adaptability of the deployed models. TinyML algorithms have been successfully employed in many smart wearable devices, including also smart eyewear [ 5 ] . In this context, On-device Learning techniques are deemed extremely interesting [ 21 ] because they enable the personalization of the models to the data of the final user of the wearable device and consent to continuously update of the model with the most up-to-date data collected directly from the user. In the eyewear context nevertheless, while there is the possibility of acquiring a lot of incoming data from the on-glasses sensors, the limited memory resources do not allow for storing a large amount of data. At the same time, continuously asking for a large amount of feedback from the user with the objective of obtaining labels for the models can be considered a bothersome task that must be reduced to a minimum during the operational life of the device. This task is made even more difficult by the lack of comfortable human-computer interfaces that characterize wearable devices in general and smart eyewear in particular. However, the presence of high-quality annotated data is one of the factors that make the success of deep learning models, and something that can not be ignored when designing On-device Learning algorithms for smart eyewear. For these reasons, Active Learning can be considered an extremely interesting paradigm to apply in the TinyML context. Active learning [ 20 ] is a paradigm comprehending techniques by which a learning algorithm can accurately choose from an unlabeled set, a subset of the data to be labeled and used for training. The scope of these strategies is to reduce data annotation by selecting a subset of all the available samples for the model training, maintaining comparable performances with respect to the case in which the model is trained with the whole set of data. Classical active learning strategies struggle to handle high-dimensional data [ 16 ] and since we focus on a TinyML context, we employed techniques of deep-active learning which are the results of the combination of deep learning and active learning strategies. The main active learning approach suited for this scenario is streaming-based sampling in which the data is scanned sequentially and the decision of taking the sample or discarding is made individually in an online manner, without the possibility of seeing again samples already discarded [ 20 ] . Traditional active learning procedures, usually involve a one-by-one sampling procedure which leads to frequent retrainings, which is inefficient and can lead to overfitting. Morevover, since we are considering a deep learning architecture executing in a resource-constrained environment, we aim to reduce the number of retraining as much as possible. For these reasons, the deep-active learning strategy has to use a batch-based sampling strategy in which a set of samples is selected to be labeled before model retraining. In this paper, we study how known and standard techniques of deep-active learning perform in a TinyML environment and we introduce TActiLE , a novel active learning technique specifically designed for the TinyML context, that can work with two novel batch handling strategies. The paper is organized as follows: in Chapter II we formulate the problem of deep stream active learning, in Chapter III we describe already known important aspects of deep active learning, in Chapter IV we formalize our solutions to address the problem, in Chapter V we show the comparison algorithms for our solutions and the parameters set used, in Chapter VI we show and comment empirical results, in Chapter VII we present the conclusions of the study and explores potential directions for future research. II Problem formulation Let us consider an unlimited stream S=\{(x_{0},y_{0}),(x_{1},y_{1}),\dots\}\subset X\times Y of data elements with relative labels. The initial subset D_{0}=\{(x_{0},y_{0}),\dots,(x_{T},y_{T})\}\subset X_{T}\times Y_{T} , with T\in\mathbb{N} is used as a pre-training set for a deep neural network f_{0}:X\to Y . f_{0} is the initial model used in a deep stream active learning procedure. The set of samples S_{U}=\{x_{T+1},x_{T+2},\dots\} following T , assumed to be collected on-device, is missing the labels which can be queried to an omniscient oracle. The stream S_{U} is the one subjected to the deep active learning procedure which, starting from the use of f_{0} , aims to satisfy the following conditions. At the generic t , given the current model f_{n} trained on the dataset D_{n} , we want to decide whether to add or not x_{t} to the to-be-labeled set K_{n} , in such a way that, at the end of the procedure, the set K_{n} contains the x^{t}_{s} that maximizes, with respect to all the other possible sets that could have been selected, the accuracy of the model f_{n+1} trained on the dataset D_{n+1}=D_{n}\cup K_{n} . We want this selection to be performed in an online fashion, that is by deciding upon each

Read the complete text