Re-evaluating Position and Velocity Decoding for Hand Pose Estimation with Surface Electromyography

Nima Hadidi, Johannes Lee, Ebrahim Feghhi, Michael Yuan, Jonathan C. Kao · 2026

Read Re-evaluating Position and Velocity Decoding for Hand Pose Estimation with Surface Electromyography by Nima Hadidi, Johannes Lee, Ebrahim Feghhi, Michael Yuan, Jonathan C. Kao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08212.txt.

Introduction

Hadidi and colleagues re-evaluate two ways to decode hand poses from surface EMG. The emg2pose benchmark's first baseline found that velocity decoding beats position decoding on accuracy and smoothness. Checking that finding under the same causal protocol, with the same core model but a calmer training recipe, the authors find the losing method was underestimated. It reacts sharply to a previously unswept decoder output scalar. Once tuned, it outperforms the rival method on the Tracking task.

Catalog record

CREATORNima Hadidi, Johannes Lee, Ebrahim Feghhi, Michael Yuan, Jonathan C. Kao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41118
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08212

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Re-evaluating Position and Velocity Decoding for Hand Pose Estimation with Surface Electromyography Nima Hadidi, Johannes Lee, Ebrahim Feghhi, Michael Yuan, Jonathan C. Kao Abstract Recent progress in real-time hand pose estimation from surface electromyography (sEMG) has been driven by the emg2pose benchmark, whose original baseline study concluded that velocity decoding outperforms position decoding in both reconstruction accuracy and trajectory smoothness. We revisit that conclusion under the original causal evaluation protocol. Using the same core architecture but a more stable training recipe, we show that position decoding models were previously underestimated because they are highly sensitive to a previously unswept decoder output scalar and can otherwise collapse into low movement solutions. Once this scalar is tuned, position decoding outperforms velocity decoding on the Tracking task across all three emg2pose generalization conditions, consistent with greater robustness to error accumulation. On the Regression task, the gap between position and velocity decoding is much smaller; instead, the largest gains come from multi-task training with Tracking, suggesting that the Regression objective alone does not sufficiently constrain the learned dynamics. Although position decoding models exhibit greater local jitter, a causal speed-adaptive filter preserves their accuracy advantage while yielding a more favorable smoothness-accuracy tradeoff than velocity decoding. Altogether, our results revise the original emg2pose modeling conclusions and establish a new state of the art among published streaming-compatible models on this benchmark. 1 Introduction Real-time hand pose estimation from surface electromyography (sEMG) is a promising capability for both human-computer interaction and prosthetic control. Recent progress in this area has been enabled by the release of the emg2pose benchmark ( 9 ) , which provides hundreds of hours of paired sEMG-pose recordings from hundreds of users and is the first resource of this scale for continuous hand pose estimation. emg2pose evaluates generalization across held-out users, held-out prompted movement sequences (“stages”), and held-out stages on held-out users, with the last setting being the most relevant for practical deployment. It defines two related tasks. In Tracking , models are given the ground-truth initial pose for each 5-second window and must predict the subsequent trajectory. In Regression , models must predict the full trajectory without access to the ground-truth initial pose. These tasks capture distinct use cases: Tracking is well matched to multimodal systems in which sEMG complements another source of pose information such as computer vision, while Regression is more directly relevant to purely sEMG-based control. A central conclusion of the original emg2pose baseline study was that velocity decoding is preferable to position decoding for real-time pose prediction. In Salter et al.’s vemg2pose model, the decoder predicts pose increments that are integrated over time, rather than directly predicting joint angles at each step. 9 reported that this output parameterization improved both Tracking accuracy and trajectory smoothness relative to direct position decoding. If correct, this would be an important modeling lesson for streaming sEMG decoders. However, the reported Tracking advantage of velocity decoding is not obviously intuitive. Because velocity decoding updates the current estimate by integrating incremental predictions over time, it is inherently exposed to error accumulation: each new prediction must implicitly compensate for past mistakes by adjusting the model’s output distribution. Direct position decoding, by contrast, can in principle map the current sEMG context directly to the current pose without having to adjust the output distribution to correct for previous errors. The reported smoothness advantage of velocity decoding is easier to understand, since temporal integration acts as an implicit low-pass filter. But this does not by itself establish velocity decoding as the preferable modeling choice: if position decoding is more accurate, then smoothness may be better handled directly with lightweight causal post-processing rather than by accepting a less accurate output parameterization. In this work, we revisit the position-versus-velocity question under the original causal emg2pose evaluation protocol. Using the same core architecture as 9 but a more stable training recipe, we show that LSTM-based position decoding models are highly sensitive to a previously unswept decoder output scalar and can otherwise collapse into low-movement solutions. Once this scalar is tuned, position decoding outperforms velocity decoding on the Tracking task across all three emg2pose generalization conditions. On the Regression task, the difference between position and velocity decoding is much smaller; instead, the dominant effect is that augmenting Regression training with Tracking substantially improves performance for both output parameterizations, suggesting that the Regression objective alone does not sufficiently constrain the learned dynamics. Finally, although position decoding produces more local jitter than velocity decoding, we show that a simple adaptive causal low-pass filter preserves its accuracy advantage while yielding a more favorable smoothness-accuracy tradeoff. Taken together, these results revise the benchmark’s original modeling conclusions and establish a new state-of-the-art among published streaming-compatible models on emg2pose. 2 Related work Since 9 introduced the emg2pose dataset, follow-up work has largely moved away from the original real-time continuous pose-estimation benchmark: 11 extends the problem to tendon-control prediction and introduces a bidirectional diffusion-based model; 8 studies tokenized pose decoding on a subset with custom splits and bidirectional decoding; 5 and 4 use emg2pose for pose-informed EMG representation learning and evaluate gesture classification; 7 uses emg2pose for multimodal pretraining in a different downstream EMG task; and 3 , 6 , 1 , and 12 use emg2pose primarily as part of broader pretraining, tokenization/reconstruction, or generative pipelines rather than the original Tracking/Regression evaluation. Thus, despite substantial follow-up activity, we are not aware of any prior emg2pose follow-up that presents a causal, streaming-compatible model, and few works evaluate the original pose benchmark in a way that is directly comparable to the published protocol. 3 Methods 3.1 Task and Notation Given a window of C{=}16 -channel EMG sampled at 2\,\mathrm{kHz} , \mathbf{x}\in\mathbb{R}^{C\times T} , we predict hand pose as J{=}20 joint angles \mathbf{y}\in\mathbb{R}^{J\times T} . For training/evaluation on the tracking task, we provide an initial pose \mathbf{y}_{0} (taken from the first supervised time index of the window) and ignore frames marked as IK failures via a boolean mask. 3.2 Core Architecture Our core architecture is identical to that of Salter et al. 2024. Encoder. We use a causal 1D convolutional + TDS encoder. Two strided temporal conv blocks map EMG to 256 channels (kernel/stride 11/5 then 5/2 ). This is followed by two Time-Depth Separable (TDS) stages (each preceded by a subsampling conv with kernel/stride 17/4 and 9/2 , respectively). The final stage outputs a 64 -D feature sequence \mathbf{f}_{1:K}\in\mathbb{R}^{64\times K} at a reduced temporal rate of 25\,\mathrm{Hz} State-conditioned decoder. We decode autoregressively at a rollout rate of 50\,\mathrm{Hz} by linearly interpolating encoder features to that rate. At each step t , the decoder input concatenates features and the previous pose estimate: \mathbf{z}_{t}=[\mathbf{f}_{t};\,\hat{\mathbf{y}}_{t-1}]\in\mathbb{R}^{(64+20)}. The decoder is a 2-layer LSTM (hidden size 512) followed by a small output MLP. Its output is explicitly scaled by a fixed scalar s : \mathbf{o}_{t}=s\cdot g(\mathbf{h}_{t}), where g(\cdot) is the decoder’s output projection (with a LeakyReLU before the final linear layer). Decoder predictions at 50\,\mathrm{Hz} are then linearly upsampled back to the EMG/joint-angle sample rate for supervision and metrics. 3.3 Position vs. Velocity Variants Both variants share the same encoder and the same state-conditioned LSTM decoder; they differ only in how the decoder output \mathbf{o}_{t} is interpreted: (i) Position decoding model. The decoder directly outputs absolute joint angles: \hat{\mathbf{y}}_{t}=\mathbf{o}_{t}.

Read the complete text