RobustGait: Robustness Analysis for Appearance Based Gait Recognition

Reeshoon Sayera, Akash Kumar, Sirshapan Mitra, Prudvi Kamtam, Yogesh S Rawat · 2025

Read RobustGait: Robustness Analysis for Appearance Based Gait Recognition by Reeshoon Sayera, Akash Kumar, Sirshapan Mitra, Prudvi Kamtam, Yogesh S Rawat (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-13065.txt.

Introduction

Reeshoon Sayera and four co-authors present RobustGait, a benchmark for testing whether gait matching survives the real world. Systems that identify people by how they walk perform well in controlled datasets, but nobody had systematically measured their robustness to corruption and to errors in extracting body silhouettes. RobustGait varies four things at once: perturbation type, silhouette extraction method, model architecture, and deployment scenario, across three established data sets plus wild footage.

Fifteen corruption types at five severity levels expose how damage propagates. Noise applied to the raw image reflects real degradation better than noise applied later. Scores proved highly sensitive to which silhouette extractor was used, an overlooked source of bias in earlier benchmarks. Robustness also depended jointly on the corruption and the design. Noise-aware training and knowledge distillation helped. The authors aim the benchmark at builders of surveillance and identification systems that must work outside the lab.

Catalog record

CREATORReeshoon Sayera, Akash Kumar, Sirshapan Mitra, Prudvi Kamtam, Yogesh S Rawat
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-13065

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RobustGait: Robustness Analysis for Appearance Based Gait Recognition Reeshoon Sayera, Akash Kumar, Sirshapan Mitra, Prudvi Kamtam, Yogesh S Rawat Abstract Appearance-based gait recognition have achieved strong performance on controlled datasets, yet systematic evaluation of its robustness to real-world corruptions and silhouette variability remains lacking. We present RobustGait, a framework for fine-grained robustness evaluation of appearance-based gait recognition systems. RobustGait evaluation spans four dimensions: the type of perturbation (digital, environmental, temporal, occlusion), the silhouette extraction method (segmentation and parsing networks), the architectural capacities of gait recognition models, and various deployment scenarios. The benchmark introduces 15 corruption types at 5 severity levels across CASIA-B, CCPG, and SUSTech1K, with in-the-wild validation on MEVID, and evaluates six state-of-the-art gait systems. We came across several exciting insights. First, applying noise at the RGB level better reflects real-world degradation, and reveal how distortions propagate through silhouette extraction to the downstream gait recognition systems. Second, gait accuracy is highly sensitive to silhouette extractor biases, revealing an overlooked source of benchmark bias. Third, robustness is dependent on both the type of perturbation and the architectural design. Finally, we explore robustness-enhancing strategies, showing that noise-aware training and knowledge distillation improve performance and move toward deployment-ready systems. 1 Introduction Figure 1 : Overlooked biases in appearance-based gait benchmarks. (i) Variation across silhouette extractors leads to evaluation bias due to variable silhouette quality, motivating the need for standardized extraction across benchmarks. (ii) directly applying noise to silhouettes restricts corruptions to simple augmentations as flipping, rotation, or erasing, whereas injecting noise at the RGB level allows various temporal, environmental, and digital degradations to propagate to silhouettes, better reflecting real-world scenarios. Gait recognition aims to identify individuals based on their unique walking patterns captured from video sequences. Unlike face, fingerprint, or iris, gait can be captured at long range and is difficult to conceal, making it highly suitable for security, surveillance, and forensic applications. Despite strong progress of gait recognition models on datasets collected under controlled laboratory conditions [ 69 , 55 , 34 ] , wide-scale deployment in real world scenario remain limited [ 18 ] . Unconstrained videos are affected by a wide range of distortions [ 18 , 75 , 77 , 70 ] , including camera noise [ 26 ] , lighting and weather variations [ 20 ] , temporal inconsistencies across frames, and occlusions caused by objects obstructing the subject [ 43 ] . These factors create significant distribution shift between training benchmarks and deployment environments. Yet existing gait recognition models [ 12 , 9 ] are seldom evaluated under such circumstances, leaving a critical gap in understanding their real-world robustness. Within gait recognition, existing methods can be broadly categorized into two groups: appearance-based approaches [ 38 , 9 ] , which rely on human silhouette-based representations, and model-based approaches [ 13 , 72 ] , which use 2D/3D human poses or SMPL-based reconstructions [ 76 ] . While both approaches have advanced the field, appearance-based methods remain the dominant choice in practice [ 10 ] . They are particularly effective in real-world scenarios, as they can operate reliably on low-resolution videos, avoid the need for accurate pose estimation, and are generally more computationally efficient [ 35 , 36 , 1 ] . Therefore, in our work, we focus on appearance-based gait. The key challenges in comprehensively evaluating robustness of gait systems arise from gait recognition being a two step process [ 12 , 10 ] , where the intermediate silhoutte representation has to be extracted from RGB data as shown in Fig. 1 . First, noise in RGB videos propage through the silhouette extraction stage and directly affect the quality of the silhouette representations. Hence, unlike standard computer vision tasks where robustness is often analyzed by perturbing the input image directly [ 23 , 22 , 56 ] , gait recognition presents a unique challenge due to its dependence on intermediate representations. Directly applying naive augmentations to silhouette data, such as random erasing [ 61 ] , fails to capture the complex perturbations introduced in the RGB input [ 12 ] . Second, gait datasets vary widely in their silhouette generation pipelines. Older datasets such as CASIA-B [ 69 ] and OU-MVLP [ 55 ] rely on outdated background subtraction methods [ 60 ] , whereas recent datasets like CCPG [ 34 ] and SUSTech1K [ 52 ] employ modern segmentation architectures such as U-Net [ 50 ] and PaddleSeg [ 41 ] . These discrepancies highlight the evolving nature of silhouette extraction and highlight a potential source of bias in gait recognition benchmarks. Recent benchmarks, such as GREW [ 18 ] and Gait3D [ 75 ] , have introduced in-the-wild datasets to advance gait recognition evaluation beyond controlled laboratory settings. However, a systematic evaluation of gait recognition model robustness to various noise types, silhouette extractors, and model architectures is lacking. To address this, we present a comprehensive robustness analysis, evaluating the impact of silhouette extraction models on silhouette quality and gait recognition performance. Silhouette extractors are applied in a zero-shot manner without task-specific adaptation. Controlled noise augmentations are applied to RGB inputs before silhouette extraction to simulate realistic degradations that affect the extraction process. RobustGait spans four dimensions of evaluation: (i) perturbation type (digital, environmental, temporal, occlusion), (ii) silhouette extraction method (four representative segmentation and parsing networks), (iii) recognition architecture (sequence-based CNNs, set-based CNNs, transformers), and (iv) deployment scenarios (cross-extractor and cross-scene). In summary, our main contributions are: • We present RobustGait , a comprehensive benchmark spanning three widely used gait datasets: CASIA-B [ 69 ] , CCPG [ 34 ] , and SUSTech1K [ 52 ] , under 15 corruption types and 5 severity levels. • We simulate realistic degradations by introducing controlled corruptions at the RGB level, allowing noise to propagate naturally through the silhouette extraction stage. • We systematically analyze the role of silhouette extraction, showing how differences across four extraction models introduce evaluation bias and affect recognition robustness. • We evaluate six state-of-the-art gait recognition models across diverse architectures, revealing how robustness varies with corruption type, severity, and choice of extractor. • We investigate robustness-improving strategies, including noise-aware training and knowledge distillation, and highlight their effectiveness as well as the trade-offs between robustness and clean-data accuracy. 2 Related Work Figure 2 : Overview of noises : Qualitative visualization of four major taxonomy of noises studied in our benchmark. Silhouette Extraction Models: extract silhouette from RGB data essential for gait recognition. Early gait datasets like CASIA-B [ 69 ] generated silhouettes using background subtraction [ 60 ] , which requires heuristic post-processing. Later improvements, such as CASIA-B* [ 37 ] , aimed to refine alignment but still rely on outdated techniques. Recent datasets such as CCPG [ 34 ] and SUSTECH-1k [ 52 ] adopt the segmentation models U-Net [ 50 ] and PaddleSeg [ 41 ] , while in-the-wild datasets GREW [ 18 ] and Gait3D [ 75 ] employ HTC [ 3 ] and HRNet [ 59 ] to achieve more robust silhouette extraction under challenging conditions. End-to-end gait recognition frameworks [ 68 , 37 ] attempt to learn intermediate representations from RGB data within the network. While these systems show promise, they often struggle to disentangle gait-relevant features from appearance

Read the complete text