Motion Matters: Motion-guided Modulation Network for Skeleton-based Micro-Action Recognition Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland. Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), October 27–3

Jihao Gu, Kun Li, Fei Wang, Yanyan Wei, Zhiliang Wu, Hehe Fan, Meng Wang · 2025

Read Motion Matters: Motion-guided Modulation Network for Skeleton-based Micro-Action Recognition Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland. Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), October 27–3 by Jihao Gu, Kun Li, Fei Wang, Yanyan Wei, Zhiliang Wu, Hehe Fan, Meng Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21977.txt.

Introduction

Jihao Gu and six co-authors present a network that recognizes micro-actions, the tiny body movements people make in social settings, in a 2025 paper. These small movements carry emotional signals, but their subtlety makes them hard to tell apart. Earlier methods often missed the faint motion cues that separate one micro-action from another.

The team's Motion-guided Modulation Network feeds motion information into the model at two levels. One module guides how each body joint in the skeleton is represented, and another guides how whole frames are handled over time. A consistency strategy then pools motion cues across scales for the final call. On two benchmarks, the method reached the best scores reported for skeleton-based recognition.

Catalog record

CREATORJihao Gu, Kun Li, Fei Wang, Yanyan Wei, Zhiliang Wu, Hehe Fan, Meng Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-21977

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Motion Matters: Motion-guided Modulation Network for Skeleton-based Micro-Action Recognition Conference: Proceedings of the 33rd ACM International Conference on Multimedia; October 27–31, 2025; Dublin, Ireland. Proceedings of the 33rd ACM International Conference on Multimedia (MM ’25), October 27–31, 2025, Dublin, Ireland ISBN: 979-8-4007-2035-2/2025/10 DOI: 10.1145/3746027.3754722 CCS: Human-centered computing Human computer interaction (HCI) CCS: Computing methodologies Activity recognition and understanding Jihao Gu, Kun Li, Fei Wang, Yanyan Wei, Zhiliang Wu, Hehe Fan, Meng Wang Abstract . Micro-Actions (MAs) are an important form of non-verbal communication in social interactions, with potential applications in human emotional analysis. However, existing methods in Micro-Action Recognition often overlook the inherent subtle changes in MAs, which limits the accuracy of distinguishing MAs with subtle changes. To address this issue, we present a novel M otion-guided M odulation N etwork ( MMN ) that implicitly captures and modulates subtle motion cues to enhance spatial-temporal representation learning. Specifically, we introduce a Motion-guided Skeletal Modulation module (MSM) to inject motion cues at the skeletal level, acting as a control signal to guide spatial representation modeling. In parallel, we design a Motion-guided Temporal Modulation module (MTM) to incorporate motion information at the frame level, facilitating the modeling of holistic motion patterns in micro-actions. Finally, we propose a motion consistency learning strategy to aggregate the motion cues from multi-scale features for micro-action classification. Experimental results on the Micro-Action 52 and iMiGUE datasets demonstrate that MMN achieves state-of-the-art performance in skeleton-based micro-action recognition, underscoring the importance of explicitly modeling subtle motion cues. The code will be available at https://github.com/momiji-bit/MMN . 1. Introduction Micro-Action ( Liu et al. 2021 ; Chen et al. 2023 ; Guo et al. 2024a ; Li et al. 2025a ; Li et al. 2024a ; Liu et al. 2024 ) is a nonverbal language in social interaction ( Aviezer et al. 2012 ) , has attracted extensive attention in recent years. In contrast to conventional human actions ( Soomro 2012 ; Kuehne et al. 2011 ; Li et al. 2023a ; Li et al. 2023d ; Li et al. 2025b ; Wang et al. 2025 ) , micro-actions are characterized by imperceptible and low-intensity movements. These movements hold significant potential for understanding individuals’ internal emotional states ( Li et al. 2024c ; Zhao et al. 2025 ) . In human-centric micro-action analysis ( Liu et al. 2021 ; Chen et al. 2023 ; Balazia et al. 2022 ; Guo et al. 2024a ; Li et al. 2023c ; Li et al. 2023b ) , remarkable progress has been made. From the perspective of the dataset, Liu et al . and Chen et al . collected the iMiGUE ( Liu et al. 2021 ) and SMG ( Chen et al. 2023 ) datasets that contain spontaneous micro-gestures in the upper limbs. These videos are sampled from the post-competition review of athletes, revealing deep emotional states conveyed through these micro-gestures. Meanwhile, Balazia et al . presented the MPIIGI ( Balazia et al. 2022 ) dataset, which annotated the subtle upper-body behaviors in group interactions and highlighted the social behaviors in human communications. To explore the whole body micro-actions, Guo et al . ( Guo et al. 2024a ) developed the large-scale Micro-Action 52 (MA-52) dataset comprising 20k video samples interviewed from 205 participants, distributed in 52 micro-action classes, benchmarking micro-action recognition. From the perspective of methodology, traditional action recognition methods, including 2D CNN based ( Wang et al. 2018 ; Lin et al. 2019 ; Feichtenhofer et al. 2019 ) , 3D CNN based ( Tran et al. 2015 ; Carreira and Zisserman 2017 ) , GCN-based ( Yan et al. 2018 ; Liu et al. 2020 ) , and Transformer-based ( Liu et al. 2022 ) , are selected to evaluate these datasets. However, these methods show suboptimal performance due to the challenges posed by the subtle and low-intensity nature of micro-actions. Recently, Li et al . ( Li et al. 2025a ) proposed a novel prototypical ambiguous calibrating net to address the ambiguity in micro-actions. Despite the above significance, accurately recognizing micro-actions remains particularly challenging due to several inherent difficulties. We depicted several micro-action examples in Figure 1 (a). 1) Subtle motion amplitudes. Micro-actions inherently exhibit low-amplitude movements, making them hard to distinguish from background movements. 2) High inter-class similarity. Micro-actions usually involve only minor motion differences, leading to visually ambiguous and overlapping representations. For example, “scratching or touching shoulder” and “scratching or touching neck” are only different in the touching region. 3) Notable intra-class variability. Due to individual differences in body shape, appearance, and other physical traits, the same micro-action will manifest in noticeably different ways across subjects. Intuitively, capturing subtle temporal motions is key to effective micro-action recognition. Compared to the RGB modality, skeleton sequences provide a compact yet expressive representation that is inherently robust to appearance noise and well-suited for modeling fine-grained body motion ( Yan et al. 2018 ; Chen et al. 2021b ; Duan et al. 2022a ; Wang et al. 2024a ; Wang et al. 2024b ) . Motivated by this, we attempt to model subtle temporal motions within skeleton sequences, enabling the network to effectively capture and emphasize subtle yet discriminative motion patterns. To this end, we propose a novel Motion-guided Modulation Network (MMN), specifically designed to amplify subtle motion cues critical for distinguishing micro-actions. As shown in Figure 1 (b), we decouple motion patterns into skeletal and temporal branches, facilitating more structured spatial-temporal skeleton feature representation. At the skeletal level, key joints are adaptively enhanced, while at the temporal level, informative frames are emphasized to capture meaningful motion patterns. The overview of the proposed Motion-guided Modulation Network (MMN) is illustrated in Figure 2 . Firstly, we encode the input skeleton sequences using skeleton-aware embeddings into a high-dimensional feature space. Then, the proposed motion-guided feature modulation injects motion into skeletal and temporal modalities through a unified architecture to build motion-guided spatiotemporal features. Subsequently, the motion consistency learning module is designed to capture motion cues from fine-to-coarse spatiotemporal features. Finally, the learned features are used for micro-action classification. In summary, the contributions of this paper are summarized as follows: • We present a motion-guided modulation network explicitly to capture subtle motion patterns and guide the learning of discriminative spatiotemporal features for micro-action recognition. • We propose a skeletal-temporal context-aware augmentation strategy to enhance the robustness and generalization of the proposed method in the context of micro-action recognition. • Extensive experiments conducted on the Micro-Action 52 and iMiGUE datasets validate the effectiveness of the proposed method. Qualitative analysis highlights the effectiveness of the motion-guided modulation network in micro-action recognition. Figure 1 . (a) Micro-Action Recognition (MAR) aims to recognize micro-action with subtle motion amplitudes, high inter-class similarity, and notable intra-class variability caused by individual differences. (b) The Pipeline of the proposed Motion-guided Modulation Network (MMN). We attempt to dynamically modulate the motion information into skeletal and temporal separately, fascinating spatial-temporal skeleton feature representation. 2. Related Work 2.1. Micro-Action Recognition Micro-Action Recognition (MAR) ( Liu et al. 2021 ; Chen et al. 2023 ; Balazia et al. 2022 ; Guo et al. 2024a ; Li et al. 2025a ; Chen et al. 2024b ; Guo et al. 2024b ; Li et al. 2024b ; Gu et

Read the complete text