MoEMba : A Mamba-based Mixture of Experts for High-Density EMG-based Hand Gesture Recognition

Mehran Shabanpour, Kasra Rad, Sadaf Khademi, Arash Mohammadi · 2025

Read MoEMba : A Mamba-based Mixture of Experts for High-Density EMG-based Hand Gesture Recognition by Mehran Shabanpour, Kasra Rad, Sadaf Khademi, Arash Mohammadi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-17457.txt.

Introduction

Mehran Shabanpour, Kasra Rad, Sadaf Khademi, and Arash Mohammadi present, in twenty twenty-five, a framework to recognize hand gestures from dense muscle signals. Sensors on the skin record electrical activity from muscles. Such signals can reveal motion intent for human-computer interaction. The hard part is that accuracy drops across sessions and across people. Signal variability between sessions can reach forty percent. Their framework, MoEMba, mixes a mixture-of-experts design, where sub-models specialize, with a state-space model that captures time patterns.

Channel attention weighs the many sensor channels, and wavelet features capture patterns at several scales. On a public dense muscle data set, balanced accuracy beat prior state-of-the-art methods. The authors highlight robustness to session shifts and efficient handling of high-dimensional time series.

Catalog record

CREATORMehran Shabanpour, Kasra Rad, Sadaf Khademi, Arash Mohammadi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-17457

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MoEMba : A Mamba-based Mixture of Experts for High-Density EMG-based Hand Gesture Recognition Mehran Shabanpour, Kasra Rad, Sadaf Khademi, Arash Mohammadi Abstract High-Density surface Electromyography (HD-sEMG) has emerged as a pivotal resource for Human-Computer Interaction (HCI), offering direct insights into muscle activities and motion intentions. However, a significant challenge in practical implementations of HD-sEMG-based models is the low accuracy of inter-session and inter-subject classification. Variability between sessions can reach up to 40 % 40\% due to the inherent temporal variability of HD-sEMG signals. Targeting this challenge, the paper introduces the MoEMba framework, a novel approach leveraging Selective State-Space Models (SSMs) to enhance HD-sEMG-based gesture recognition. The MoEMba framework captures temporal dependencies and cross-channel interactions through channel attention techniques. Furthermore, wavelet feature modulation is integrated to capture multi-scale temporal and spatial relations, improving signal representation. Experimental results on the CapgMyo HD-sEMG dataset demonstrate that MoEMba achieves a balanced accuracy of 56.9 % 56.9\% , outperforming its state-of-the-art counterparts. The proposed framework’s robustness to session-to-session variability and its efficient handling of high-dimensional multivariate time series data highlight its potential for advancing HD-sEMG-powered HCI systems. Index Terms —Electromyography, Gesture Recognition, Mixture of Experts, State Space Models, Wavelet Decomposition. I Introduction Surface ElectroMyoGraphy (sEMG) signals [ 1 ] are a promising resource for Human-Computer Interaction (HCI), providing direct insights into muscle activities due to their ability to encapsulate motion intentions [ 2 ] . As such, sEMG-based gesture recognition frameworks emerged as the core technology in developing cutting-edge Muscle-Computer Interfaces (MCIs), facilitating applications ranging from active prostheses [ 3 , 4 , 5 , 6 , 7 ] , wheelchairs [ 8 , 9 ] and exoskeletons [ 10 ] , as well as in neuromuscular diagnosis [ 11 ] , neurorehabilitation [ 12 ] , and video game interactions [ 13 ] . Recent advancements in Artificial Intelligence (AI)-driven solutions have significantly enhanced the development of sEMG-powered MCIs. AI-based MCI tasks range from discrete movement classification and joint angle estimation to force/torque estimation offering significant potential to advance EMG pattern recognition. Despite the recent surge of interest, such models fail to address critical challenges faced in non-ideal, practical conditions, including variations in electrode placement and changes in muscle state both across different subjects and within the same person over time [ 14 , 15 ] . Literature Review: MCI systems commonly rely on a set of standardized functions to represent features from different domains, enhancing the information density embedded in high-density (HD)-sEMG signals, and improving the discrimination of different gestures. The extracted representations can be utilized for sEMG pattern recognition through various classifiers, which are broadly classified into two primary categories: Machine Learning (ML)-based Methods [ 16 ] : ML models rely on feature engineering, where relevant features are designed and extracted manually from signals encompassing three primary categories: time-domain (TD), frequency-domain (FD), and time-frequency domain (TFD) features. TD features [ 6 , 7 ] are derived directly from raw sEMG signals, representing their time-dependent variations, and are particularly beneficial due to their low computational complexity. In contrast, FD features [ 17 ] are obtained through the Fourier transform of the sEMG signal’s autocorrelation function. Building upon these approaches, TFD features [ 18 ] combine both time and frequency information, providing a comprehensive view of the signal’s energy distribution, with wavelet transform being a commonly used technique for this analysis. Despite the availability of various feature extraction techniques, the multidimensional, non-linear and multichannel nature of sEMG coupled with its inherent non-stationary nature, makes this signal challenging for effective training of ML models [ 19 ] . Deep Learning (DL)-driven Models [ 20 ] : DL, on the contrary, is distinguished by its hierarchical architecture. This structure enables the model to progressively extract complex feature representations, automatically capturing underlying patterns and relationships within the data at various levels. The capability of autonomously extracting spatial features made Convolutional Neural Networks (CNNs) [ 21 , 22 ] a leading choice for sEMG gesture recognition in DL-driven models. However, limited receptive fields of CNNs restrict their ability to capture long-range dependencies in sEMG signals, which are inherently sequential time series data. In contrast, Recurrent Neural Networks (RNNs) [ 23 , 24 ] , designed specifically to model temporal relationships and sequential patterns, offer a more suitable approach for analyzing such signals. Consequently, several approaches utilize hybrid CNN-RNN models [ 19 , 25 ] . This combined architecture excels in capturing both spatial and temporal features. On the other hand, transformers offer a compelling alternative with their self-attention mechanism [ 26 , 27 ] , granting global receptive fields and enabling superior capture of cross-time dependencies, addressing the limitations of both CNNs and RNNs in this regard. This global perspective, while advantageous, is computationally expensive. The self-attention mechanism necessitates each element attend to all others, leading to computational overhead that scales quadratically with sequence length [ 25 , 28 ] . Targeted Challenges: Although DL-driven models have achieved remarkable accuracies in intra-session tasks, their performance diminishes in inter-session and inter-subject scenarios [ 29 , 30 ] . In the context of sEMG analysis, these terms describe distinct data collection paradigms: intra-session involves data from a single subject during a continuous recording, inter-session refers to recordings from the same subject across multiple sessions, and inter-subject pertains to data from different individuals. In greater detail, a key challenge in practical implementations is the low accuracy of inter-session and inter-subject classification, with session-to-session variability reaching as high as 10 – 40 %, which arises from the inherent temporal variability of sEMG signals. This variability is influenced by several factors, including muscle condition (fatigue, atrophy, or hypertrophy), changes in skin impedance (such as sweating), anatomical differences among subjects, non-stationarities due to limb positioning and force variations, and electrode drift, all of which contribute to accuracy degradation. Moreover, these factors can introduce considerable inconsistencies in signal patterns across different sessions and individuals, thus complicating the generalization of gesture recognition algorithms [ 20 , 30 , 31 , 32 ] . The challenge of between-session distribution shifts has been conventionally handled through experimental design by developing multi-user and multi-session training protocols, as well as data processing techniques such as data augmentation [ 30 , 31 ] , unsupervised learning, and transfer learning [ 33 , 34 ] with advanced DL architectures. Despite offering improvements in accuracy, these methods often require large amounts of adaptation data [ 28 , 31 , 35 ] . Moreover, sEMG data collection is a time-consuming and resource-intensive process [ 30 , 35 ] , requiring specialized equipment and trained personnel, which further limits the availability of data. Moreover, the significant computational demands of these methods restrict their feasibility for real-time applications, particularly in resource-constrained embedded systems [ 28 , 31 ] . A key consideration, often overlooked in most above-mentioned models, is the inter-channel dependencies inherent in sEMG data. Gesture movements involve complex inter-muscular coordination, which is reflected in the inter-channel relationships captured by the placement of sEMG electrodes. Many models incorrectly apply a channel-independent approach, treating the data as uncorrelated univariate time series and thus neglecting these essential inter-channel relationships [ 25 , 28 , 33 ] . Although some approaches [ 36 , 37 ] attempt to

Read the complete text