Multi-Head Adaptive Graph Convolution Network for Sparse Point Cloud-Based Human Activity Recognition

Vincent Gbouna Zakka Luis J. Manso Zhuangzhuang Dai · 2025

Read Multi-Head Adaptive Graph Convolution Network for Sparse Point Cloud-Based Human Activity Recognition by Vincent Gbouna Zakka Luis J. Manso Zhuangzhuang Dai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-02778.txt.

Introduction

Vincent Gbouna Zakka, Luis J. Manso, and Zhuangzhuang Dai present a radar-based activity recognition system in this two thousand twenty-five paper. Cameras raise privacy concerns and fail in darkness, so the authors use millimetre-wave radar, which yields privacy-preserving point clouds. Those clouds are sparse and noisy, and graph methods usually apply one fixed kernel everywhere. The team argues kernels should adapt to each local neighbourhood's geometry.

Their Multi-Head Adaptive Kernel module generates several dynamic kernels inside a graph convolution network, each capturing a different aspect of local structure. Features refine progressively while global spatial context is preserved. On benchmark datasets the method reached state-of-the-art accuracy for recognizing human activities. The target application is domestic service robots that monitor elderly or vulnerable residents safely.

Catalog record

CREATORVincent Gbouna Zakka Luis J. Manso Zhuangzhuang Dai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-02778

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Multi-Head Adaptive Graph Convolution Network for Sparse Point Cloud-Based Human Activity Recognition Vincent Gbouna Zakka Luis J. Manso Zhuangzhuang Dai Abstract Human activity recognition is increasingly vital for supporting independent living, particularly for the elderly and those in need of assistance. Domestic service robots with monitoring capabilities can enhance safety and provide essential support. Although image-based methods have advanced considerably in the past decade, their adoption remains limited by concerns over privacy and sensitivity to low-light or dark conditions. As an alternative, millimetre-wave (mmWave) radar can produce point cloud data which is privacy-preserving. However, processing the sparse and noisy point clouds remains a long-standing challenge. While graph-based methods and attention mechanisms show promise, they predominantly rely on “fixed” kernels—kernels that are applied uniformly across all neighbourhoods—highlighting the need for adaptive approaches that can dynamically adjust their kernels to the specific geometry of each local neighbourhood in point cloud data. To overcome this limitation, we introduce an adaptive approach within the graph convolutional framework. Instead of a single shared weight function, our Multi-Head Adaptive Kernel (MAK) module generates multiple dynamic kernels, each capturing different aspects of the local feature space. By progressively refining local features while maintaining global spatial context, our method enables convolution kernels to adapt to varying local features. Experimental results on benchmark datasets confirm the effectiveness of our approach, achieving state-of-the-art performance in human activity recognition. Our source code is made publicly available at: https://github.com/Gbouna/MAK-GCN . I INTRODUCTION Human activity recognition has become increasingly important in monitoring activities of daily living, health status, and general well-being, especially for the elderly and individuals requiring support to live independently [ 1 ] . By providing continuous observation and alerts when necessary, such solutions can significantly improve quality of life. With the slow but steadily increasing adoption of domestic service robots [ 2 ] , the ability to monitor activities is a compelling feature. If equipped with monitoring capabilities, these robots could simultaneously deliver services and ensure the safety and support of end users [ 3 ] . Progress has been made in deploying robots for activity monitoring, with many systems relying on RGB cameras to capture activities of daily living [ 4 ] . Although camera-based approaches have advanced considerably, they face certain limitations, such as privacy concerns, and poor performance on low lighting conditions [ 5 ] . Recent research exploring sensors that overcome these issues has focused on mmWave radar, which produces point cloud data that is inherently privacy-preserving and functions effectively in diverse settings (see Fig. 1 ). Despite its potential, mmWave radar data remains challenging to process due to its unstructured and sparse nature. Early solutions, such as PointNet [ 6 ] , paved the way for numerous variations [ 7 ] . More recently, graph-based methods have attracted attention [ 8 ] . However, these methods commonly rely on the same learned weights for all point pairs, disregarding the variations in their feature correspondences. To address this issue, various strategies have been proposed, inspired by attention mechanisms [ 9 ] . Although these methods use attention to adjust feature weighting, their underlying convolution kernels remain essentially fixed, limiting their ability to adapt to the local geometry and capture the most relevant elements in each neighbourhood. Fig. 1: mmWave radar deployed on a Robotino robot for activity monitoring in both dark and illuminated conditions To overcome the limitations of fixed convolution kernels in capturing diverse feature correspondences among points, we propose an adaptive approach that learns distinct kernels for each pair of points. We propose the Multi-Head Adaptive Kernel (MAK) module, which can learn context-specific convolutions. Our experiments show that MAK-GCN networks achieve state-of-the-art performance on two mmWave radar-based human activity recognition benchmarks. MAK generates multiple sets of dynamic kernels –each head capturing a distinct aspect of the local feature space. Combined with the overall network design, which ensures that local features are progressively enhanced while preserving the global spatial context of the point cloud, this work aims to improve the ability of a network to dynamically tailor convolution kernels to diverse feature correspondences, ultimately enabling robust and discriminative feature learning for human activity recognition. Experimental results on the MMActivity [ 10 ] and MiliPoint [ 11 ] point cloud datasets for human activity recognition demonstrate the effectiveness of the proposed method, achieving new state-of-the-art surpassing previous methods significantly. II RELATED WORKS To address the irregular nature of point clouds, state-of-the-art methods process raw point cloud data directly rather than relying on intermediate representations [ 6 ] . Graph-based approaches represent points as nodes in a graph, with edges formed based on spatial or feature relationships [ 8 ] . While graphs naturally capture local geometric structures, their irregularity makes them difficult to process. Several studies have leveraged the graph-based approach to extract local geometric features. For example, [ 8 ] selects nearest neighbours in feature space and applies EdgeConv for feature extraction, and [ 12 ] models convolution using Gaussian mixture models within a local pseudo-coordinate system. To enhance performance, various approaches [ 9 ] incorporate learned feature-based weights. Nevertheless, they continue to rely on fixed convolution kernels, restricting their ability to flexibly adapt to each local neighbourhood and emphasise the most relevant features. To overcome this limitation, we introduce the Multi-Head Adaptive Kernel (MAK) module, which generates multiple sets of dynamic kernels—each head capturing a distinct aspect of the local feature space. III METHOD This section details the proposed model architecture, beginning with a discussion of its main components, followed by an overview of the overall network design as presented in Fig. 2 . Fig. 2: Architecture of the proposed MAKGConvNet: A graph is constructed from input data for convolution via the MAK module, followed by a common graph convolution. The outputs are concatenated and passed to the classification module. III-A Graph Feature Extraction First, we construct a graph representation of the point cloud using a K-Nearest Neighbours (KNN) algorithm to identify local neighbourhoods. Let X\in\mathbb{R}^{C\times N} be the feature matrix for a single sample, where C denotes the number of channels and N the number of points. For a mini-batch of B samples, the tensor is of shape (B,C,N) . III-A 1 KNN Function The KNN function computes the pairwise squared Euclidean distances between points. Given an input tensor X\in\mathbb{R}^{C\times N} (or (B,C,N) for a batch of B samples), the squared distance between two points x_{i} and x_{j} is defined as follows: d(x_{i},x_{j})^{2}=\|x_{i}-x_{j}\|^{2}=\|x_{i}\|^{2}+\|x_{j}\|^{2}-2\langle x_{i},x_{j}\rangle, (1) where \langle\cdot,\cdot\rangle denotes the inner product. In the implementation, the inner product term is computed by the matrix multiplication -2\,X^{\top}X . Simultaneously, the squared norms \|x_{i}\|^{2} for each point are calculated and arranged so that they can be broadcasted appropriately. The pairwise distance matrix D is then obtained as follows: D=-\text{S}-\Big(-2\,X^{\top}X\Big)-\text{S}^{\top}, (2) with S representing the vector of squared norms. Finally, the indices corresponding to the k smallest distances—indicative of the nearest neighbours—are selected using a top- k operation. This yields an index tensor of shape (B,N,k) , which effectively captures the neighbourhood structure necessary for subsequent graph-based feature extraction. III-A 2 Graph Feature Extraction Function The graph feature extraction module constructs a local neighbourhood representation that captures absolute and relative point features. Given an input tensor, each

Read the complete text