BarbieGait: An Identity-Consistent Synthetic Human Dataset with Versatile Cloth-Changing for Gait Recognition
Qingyuan Cai Saihui Hou Xuecai Hu Yongzhen Huang · 2026
Read BarbieGait: An Identity-Consistent Synthetic Human Dataset with Versatile Cloth-Changing for Gait Recognition by Qingyuan Cai Saihui Hou Xuecai Hu Yongzhen Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12221.txt.
Introduction
Cai and three colleagues introduce BarbieGait, a synthetic gait dataset mapping real subjects into a virtual engine to simulate wide clothing changes while keeping gait identity intact. Clothing diversity raises within-class variance and blocks cloth-invariant learning, so they add GaitCLIF, a baseline model built for cross-clothing recognition. Tests show it lifts cross-clothing performance on BarbieGait and on existing popular gait benchmarks.
Catalog record
| CREATOR | Qingyuan Cai Saihui Hou Xuecai Hu Yongzhen Huang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37590 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.12221
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BarbieGait: An Identity-Consistent Synthetic Human Dataset with Versatile Cloth-Changing for Gait Recognition Qingyuan Cai Saihui Hou Xuecai Hu Yongzhen Huang Abstract Gait recognition, as a reliable biometric technology, has seen rapid development in recent years while it faces significant challenges caused by diverse clothing styles in the real world. This paper introduces BarbieGait , a synthetic gait dataset where real-world subjects are uniquely mapped into a virtual engine to simulate extensive clothing changes while preserving their gait identity information. As a pioneering work, BarbieGait provides a controllable gait data generation method, enabling the production of large datasets to validate cross-clothing issues that are difficult to verify with real-world data. However, the diversity of clothing increases intra-class variance and makes one of the biggest challenges to learning cloth-invariant features under varying clothing conditions. Therefore, we propose GaitCLIF (Gait-oriented CLoth-Invariant Feature) as a robust baseline model for cross-clothing gait recognition. Through extensive experiments, we validate that our method significantly improves cross-clothing performance on BarbieGait and the existing popular gait benchmarks. We believe that BarbieGait, with its extensive cross-clothing gait data, will further advance the capabilities of gait recognition in cross-clothing scenarios and promote progress in related research. The source code and dataset are available at https://github.com/BarbieGait/BarbieGait . Figure 1 : BarbieGait is an identity-consistent synthetic human dataset, where each subject has 100 different kinds of clothes combinations, including variations in hairstyles, upper and lower garments, and carried accessories. We simulate diverse illumination in various environments to generate RGB images and extract multimodal data (2D Human Pose, Silhouette) for gait recognition. 1 1 footnotetext: Corresponding author. 1 Introduction Gait recognition is a reliable biometric technology that identifies subjects based on their walking patterns. It can be performed from a distance without requiring direct interaction with the subject, making it ideal for surveillance and security applications. In recent works, the research on gait recognition has grown fast. However, human appearance variations caused by covariates such as clothing and carrying 40 ; 55 remain a major bottleneck in the development of gait recognition. Although many benchmarks are proposed 76 ; 76 ; 57 ; 81 ; 82 ; 62 ; 49 ; 15 , such as some in-the-lab datasets CASIA-B 76 , OU-MVLP 57 , and in-the-wild dataset Gait3D 81 , GREW 82 et al., they still lack extensive cloth-changing data for every subject. The newly proposed cross-clothing dataset CCPG 40 , investing efforts and costs in collecting cross-clothing data for each subject, only has seven different cloth-changing statuses per person. Without a large amount of cloth-changing data, it becomes difficult to prove whether gait recognition is reliable under extensive clothing variations or if there is still room for improvement. Moreover, the limited clothing diversity makes it insufficient to demonstrate whether existing methods can effectively handle scenarios involving extensive clothing changes. However, collecting cross-clothing gait data that encompasses diverse and complex clothing styles across various ethnicities and seasons is not only immensely costly but also nearly impossible to achieve due to privacy concerns. Nowadays, some human-centric tasks like Human Pose and Shape Estimation 5 ; 8 ; 51 ; 6 ; 7 , Human Neural Rendering 73 , Person Re-Identification 64 ; 80 , and Gait Recognition 79 attempt to generate frame-level synthetic images to reduce data collection costs and get massive data. While these synthetic datasets encompass a wide range of motion sequences, they primarily emphasize action diversity, overlooking a fundamental requirement for gait recognition research. The key question we seek to address is: can these generative paradigms be used to synthesize cloth-changing gait data while preserving the gait identity discriminability of a real subject? Motivated by the key question, we develop a new synthetic gait dataset named BarbieGait for cloth-changing gait recognition research which has two main characteristics: (1) Each virtual character is authentically replicated from a real subject through dual subject-specific alignment protocols: skeleton length and body shape matching, combined with kinematic motion matching. (2) Each subject has 100 completely random full-body clothing changes, yielding highly diverse clothing variations. To the best of our knowledge, we are the first to use high-precision 3D human pose and mesh to achieve real subjects and virtual subjects alignment in both static and dynamic levels, preserving unique gait identity in the generated cloth-changing gait sequence from the real subject. This alignment approach prevents the problem in prior methods 5 ; 73 ; 8 ; 79 , where synthesized gait sequences of the same individual fail to maintain identity consistency due to the reuse of identical motions across different subjects or the use of diverse gait patterns for the same subject. BarbieGait, as a versatile dataset, provides a solid foundation for addressing challenges of cloth-changing and opens up new possibilities for exploring various aspects of gait recognition, such as cross-view and cross-domain issues in the future due to the controllable data generation paradigm. In this paper, we not only utilize BarbieGait as a comprehensive benchmark but also focus on learning cloth-invariant features under cloth-changing conditions. The diversity of cloth-changing significantly increases the intra-class variance for the same identity and hinders the model’s ability to extract identity-related features from cross-clothing features. Therefore, we believe the primary issue is to eliminate cloth-specific statistics. Another key perspective is that, based on human dressing characteristics, features from different parts of the body are affected by clothing to varying degrees. Preserving fine-grained motion information will be more conducive to learning cloth-invariant features from different parts of the human body. Based on these insights, we propose a straightforward yet powerful approach, GaitCLIF (Gait-oriented CLoth-Invariant Feature), which serves as a robust baseline model for gait recognition in cloth-changing conditions. Furthermore, GaitCLIF demonstrates consistent performance improvements on BarbieGait and existing gait recognition benchmarks. Our main contributions can be summarized as follows: • We present BarbieGait , a synthetic gait recognition dataset containing 521 subjects, each with 100 clothing variations generated under consistent identity. It sets a new benchmark with greater clothing diversity and more gait sequences than existing datasets. • To tackle the increased intra-class variance caused by diverse clothing changes, we propose GaitCLIF , a robust baseline for learning fine-grained cloth-invariant motion features for cloth-changing gait recognition. • We demonstrate that our method can notably improve performance on BarbieGait and achieve state-of-the-art performance on the existing datasets, including CCPG, SUSTech1K, Gait3D, and GREW, which involve clothing variations and style changes. 2 Related Work 2.1 Human Synthetic Dataset Existing synthetic datasets mainly serve Human Pose Estimation, Human Mesh Recovery, and Person Re-Identification. SURREAL 60 renders clothing onto SMPL 45 bodies but lacks accurate clothing-body alignment. AGORA 51 provides high-quality real scans but lacks continuous motion due to the high cost of scanning. SynBody 73 and GTA-Human 8 animates parametric models (e.g., GHUM 70 , SMPL, SMPL-X 52 ) to generate video sequences. RandPerson 64 , UnrealPerson 80 , and SynPerson 69 focus on synthetic Re-ID training. VersatileGait 79 targets gait recognition, showing the potential of synthetic data. However, existing datasets often fail to preserve gait identity due to two common issues: (1) the same motion sequence is used to drive different subjects, and (2) the same subject is animated using motion sequences with significant variation in walking patterns. Figure 2 : The BarbieGait data generation