Clothes-Changing Person Re-identification Based On Skeleton Dynamics

Asaf Joseph Shmuel Peleg · 2025

Read Clothes-Changing Person Re-identification Based On Skeleton Dynamics by Asaf Joseph Shmuel Peleg (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-10759.txt.

Introduction

Joseph and Peleg identify people across videos by their moving skeleton alone in this 2025 paper. Re-identification usually leans on appearance, which collapses when a person changes clothes. Their clothes-changing task removes that crutch entirely.

The method feeds joint positions into a spatio-temporal graph network, which learns a descriptor of how each body moves. No color, texture, or clothing features enter at all. At test time, predictions from several clip segments are pooled to firm up the match. On the CCVID benchmark, with several pose estimators tried, the method reached state-of-the-art accuracy. Skeleton dynamics offer a privacy-friendlier route to tracking identity across cameras.

Catalog record

CREATORAsaf Joseph Shmuel Peleg
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-10759

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Clothes-Changing Person Re-identification Based On Skeleton Dynamics Asaf Joseph Shmuel Peleg Abstract Clothes-Changing Person Re-Identification (ReID) aims to recognize the same individual across different videos captured at various times and locations. This task is particularly challenging due to changes in appearance, such as clothing, hairstyle, and accessories. We propose a Clothes-Changing ReID method that uses only skeleton data and does not use appearance features. Traditional ReID methods often depend on appearance features, leading to decreased accuracy when clothing changes. Our approach utilizes a spatio-temporal Graph Convolution Network (GCN) encoder to generate a skeleton-based descriptor for each individual. During testing, we improve accuracy by aggregating predictions from multiple segments of a video clip. Evaluated on the CCVID dataset with several different pose estimation models, our method achieves state-of-the-art performance, offering a robust and efficient solution for Clothes-Changing ReID. 1 Introduction Person Re-Identification (ReID) aims to match individuals appearing in different videos, taken at different times and locations. Two common ReID cases are (i) Same-Clothes and (ii) Clothes-Changing. In Same-Clothes ReID, a person keeps the same appearance, including clothing, hairstyle, and accessories. Several methods give excellent results in this setup [ 15 , 36 , 20 ] . These methods rely on appearance features, and perform poorly in the Clothes-Changing setup. Figure 1 : The information in Skeletons: Each row shows the same person, where the three left and three right video frames were taken months apart. Despite changes in clothing and appearance, the hands movements remains consistent and identifiable. This consistent skeletal motion forms the basis of our method, enabling robust person re-identification despite changes in appearance. Figure 2 : Method Overview: An input video with T frames is first processed by a pose estimation model, then fed into two streams of Graph Convolution Networks (GCNs) to extract features f_{j},f_{b} for the joints and bones streams, respectively. These features encode the video into a shared latent space. During training, the model is optimized using the triplet loss. During testing, two additional statistical methods, Re-Ranking and Re-Voting, are applied to extract the final ranked matching. Some methods have attempted to learn clothing-invariant features, such as silhouettes [ 16 , 17 ] , contour sketches [ 41 ] , or focusing on fine-grained features such as individual body parts [ 34 , 27 ] . Other approaches have focused on extracting temporal information from video datasets to learn additional time-dependent features and integrating these with spatial features [ 40 ] . In [ 11 ] , the authors introduced the problem of leaking personal information in ReID models. They showed how models that rely on appearance features are exposed to personal information such as skin color and environmental clues about an individual’s work and living space. To overcome this drawback, the authors suggested performing ReID in the skeleton space, where the only information used is how an individual’s body is shaped and moves. The privacy concerns, and the advancements in the Skeleton-Based Action-Recognition task [ 10 ] , inspired methods to use the human body pose also for ReID [ 26 , 30 ] . Action recognition is orthogonal to ReID in the sense that Action Recognition should be invariant to the identity of the individual, while ReID should be invariant to the individual’s activity. Although these methods show promising results, all of them still add appearance features in addition to the skeleton. More recently, an innovative paper [ 25 ] suggested data augmentation to enrich the dataset with various clothing and poses. [ 24 ] innovated the use of 3D mesh of the human body. Results presented in these two papers are promising, but they also use image appearance data, conflicting with privacy concerns. In this work, we propose a Graph Convolution Network (GCN) to learn spatial (body shape) and temporal (body motion) information based only on skeleton information. Using only the skeleton data reduces dimensionality and satisfies privacy concerns. We show that using statistical methods such as Re-Ranking [ 43 ] and Ranked-Voting during test time can significantly improve the model performance. We obtain state-of-the-art results on the CCVID dataset, one of the most famous, publicly available datasets for Clothes-Changing ReID. 2 Related Work 2.1 Person Re-Identification (Re-ID) Early ReID papers addressed primarily the Same-Clothes setup, where an individual’s appearance does not change much. Initially, handcrafted features were designed to capture the unique characteristics of individuals, including elements such as color and texture [ 12 , 21 ] . Handcrafted features were later replaced by trained features using deep models [ 1 , 20 ] . 2.2 Clothes-Changing Re-ID (CC-ReID) The Same-Clothes ReID setup does not hold in many real-world applications, where ReID is needed after periods longer than one day. In these cases cloths, accessories, hair style, and more are likely to change. To overcome these temporal changes, features that are invariant to changes in an individual’s appearance are required. An additional challenge in Clothes-Changing ReID is the lack of publicly available datasets for developing new methods. This led the focus towards video-based datasets [ 37 , 8 , 13 ] , where the temporal information can also be taken into account. 3D-CNN’s [ 22 , 14 , 19 ] , RNN’s [ 39 , 38 ] , and GCN’s [ 35 , 40 , 24 ] were used to learn clothes-invariant spatial-temporal features. In [ 25 ] , the authors suggested an auxiliary task of 3D human mesh prediction to enhance the appearance features. In [ 2 ] , face features were used as time-invariant features, in addition to the appearance features, to enhance the clothes-invariant properties. Most of the above methods use some appearance features. In this paper, We also introduce simple statistical methods at test time to improve model performance. Since our model is exposed only to skeleton information, it reduces the amount of personal information learned by the model. 3 Proposed Method 3.1 Overview Video-Based Clothes-Changing ReID datasets are represented as \mathcal{D}:\{\vec{X},\vec{Y}\}_{i=1}^{N} , where \vec{X} is a video, \vec{Y} is the person, camera and clothes ID’s for the given video, and N is the total number of individuals. An overview of our proposed method is shown in Fig 2 . A pose estimation process (e.g. BlazePose [ 3 ] or OpenPose [ 6 ] ) computes the skeleton of each person in the videos. A Graph-Convolution-Network (GCN) is trained to encode the sequence of K skeletons into a latent space, mapping a video segment of K successive frames of the same individual into similar latent values, while video segments of other individuals are mapped into much different values. In this paper we used K=50 . During inference each query video is processed by a pose estimator, and the trained GCN is applied on the skeletons of each video segment of length K . The latent value of each video segment is matched to the segments in the gallery to find the best matches. Following the initial matching, Re-Ranking and Re-Voting methods are used to improve the results by leveraging the multiple video segments for each video both in the query and in the gallery. 3.2 Graph Representation of Skeleton Sequences A sequence of skeletons is represented by a spatio-temporal graph as shown schematically in Fig. 3

Read the complete text