Person Re-Identification via Generalized Class Prototypes
Md Ahmed Al Muzaddid, William J. Beksi · 2025
Read Person Re-Identification via Generalized Class Prototypes by Md Ahmed Al Muzaddid, William J. Beksi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-17043.txt.
Introduction
Md Ahmed Al Muzaddid and William J. Beksi improve person matching across cameras in a 2025 paper. Person re-identification links images of the same person across views. Systems describe each person with a feature summary. One summary per identity class acts as its representative.
Earlier work mostly used the plain average of a class's summaries. A few studies tried other representatives only during retrieval. The authors show those choices give weaker matching results. Their method picks generalized representatives beyond simple class averages. The number of representatives per class can be tuned per application. Applied over several existing embeddings, the method improved results substantially. Better representatives, they argue, are an overlooked lever in re-identification.
Catalog record
| CREATOR | Md Ahmed Al Muzaddid, William J. Beksi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-17043
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Person Re-Identification via Generalized Class Prototypes Md Ahmed Al Muzaddid, William J. Beksi Abstract Advanced feature extraction methods have significantly contributed to enhancing the task of person re-identification. In addition, modifications to objective functions have been developed to further improve performance. Nonetheless, selecting better class representatives is an underexplored area of research that can also lead to advancements in re-identification performance. Although past works have experimented with using the centroid of a gallery image class during training, only a few have investigated alternative representations during the retrieval stage. In this paper, we demonstrate that these prior techniques yield suboptimal results in terms of re-identification metrics. To address the re-identification problem, we propose a generalized selection method that involves choosing representations that are not limited to class centroids. Our approach strikes a balance between accuracy and mean average precision, leading to improvements beyond the state of the art. For example, the actual number of representations per class can be adjusted to meet specific application requirements. We apply our methodology on top of multiple re-identification embeddings, and in all cases it substantially improves upon contemporary results. 1 Introduction Fig. 1 : An overview of prototype-based Re-ID. The solid circles/squares denote the feature vectors of each image instance, while the empty circles represent query vectors. The two plots on the right depict the feature vector distribution in the embedding space. The upper-right plot illustrates instance-based Re-ID, which typically yields lower precision. The plot depicts a specific case where among the five nearest instances from the query, two are false positives. The lower-right plot demonstrates how our prototype-based Re-ID approach enhances precision by representing all instances from the same class using a distribution-aware feature vector. Person re-identification (Re-ID) has been widely studied as a specific image retrieval problem. Given a query image of a person, the goal is to identify it from a set of gallery images captured by a group of non-overlapping cameras. The gallery images typically include disjoint views of the same person taken by different cameras at distinct times. Re-ID research has undergone rapid growth since the introduction of initial datasets [ 6 , 8 ] for this task. The technology has found widespread application in various domains such as autonomous vehicles, security and surveillance systems, sports analytics, and much more. The Re-ID task is challenging due to a combination of dynamic lighting conditions, low image resolution, multiple camera viewpoints, occlusions, unconstrained poses, and unreliable bounding boxes. A common approach to person Re-ID is to first transform the query and gallery images into feature vectors using either handcrafted feature engineering or deep learning feature extractors. Subsequently, the similarity between the query and gallery feature vectors is assessed by measuring the distance between them. The greater the proximity of these vectors, the higher the degree of similarity. More specifically, we expect that the feature vectors representing the same person will exhibit a close spatial relationship, while vectors representing different individuals will have a significant separation in the vector space where distance is measured by the Euclidean norm. Since images for person Re-ID are typically transformed into feature vectors, feature extraction via deep learning has become a key aspect in recent advancements. This research has focused on developing more discriminative features, yet it has inherent limitations. Specifically, it is restricted to extracting viewpoint-centric features from a single image, which restricts its ability to form a comprehensive, person-centric representation by utilizing multiple images of the same individual. Furthermore, the extensive image comparisons required for Re-ID impose high computational demands, restricting its practical application in resource-constrained environments. As an alternative approach, Snell et al. [ 23 ] introduced the prototypical network for Re-ID, a method that learns a metric space in which classification is performed by calculating distances to prototype representations for each class. Building on this paradigm, we propose a generalization of this concept by employing multiple prototypes per class. We show that using multiple prototypes per class enhances the performance of Re-ID tasks compared to a single prototype per class. To the best of our knowledge, we are the first to establish the effectiveness of varying numbers of prototypes for image retrieval . Not only do we examine prototypes as class representatives, but we also generalize the class representative selection process. In particular, we develop a transformer decoder-based model that takes a set of images of an object of interest and generates one or more set/class representatives in the embedding space during inference. When generating multiple prototypes iteratively, the decoder’s self-attention module attends to all prototypes generated in preceding iterations, while the cross-attention module is conditioned on the overall feature distributions of the entire class. Fig. 1 illustrates the selection of class representatives via our method compared to conventional (e.g., instance-based) approaches. To demonstrate the effectiveness of our approach, we present baseline algorithms for efficiently identifying robust prototypes. These methods sample class representatives that capture intra-class diversity while maintaining inter-class boundaries within the embedding space. In summary, our contributions are as follows. • We provide an analysis of the impact of different class representatives (e.g., instance, centroid) on person Re-ID tasks. • We create an attention-based model to generate class prototypes that can be directly compared with the query during inference time. • We present multiple sampling-based algorithms for selecting class representatives and establish state-of-the-art person Re-ID benchmarks. Our source code is publicly available at [ 7 ] . 2 Related Work 2.1 Prototype-Based Methods Similar to the prototypical network approach introduced by Snell et al. [ 23 ] , Wang et al. [ 30 ] developed embedding models that classify each query example by calculating distances to speaker prototypes represented by centroids. Other research has explored alternative strategies for aggregating image features. For example, centroid vectors have been utilized during model training across various applications [ 12 , 34 , 37 ] . Recently, a centroid-based approach was used to represent gallery classes during inference for person Re-ID [ 33 ] . This improves performance by summarizing all gallery images of a single class into an average centroid vector, enabling similarity measurement through distances between query features and representations. However, we do not rely on a single fixed prototype such as a centroid. Instead, our approach allows flexibility in selecting a predefined number of representative points within the embedding space based on the feature distribution. 2.2 Attention Models Attention models have become very effective for person Re-ID. They can handle the part alignment challenge and enhance feature representation. For instance, Liu et al. [ 17 ] proposed an end-to-end comparative attention network that learns to focus on part pairs of images of people to compare their appearance. Researchers have also employed attention models over a sequence of frames to extract salient features [ 18 , 14 , 22 ] . More recently, Zhang et al. [ 36 ] developed a patch-wise augmentation technique to enhance the representation of high-frequency components in attention-based models. In this work, given a set of samples with their corresponding camera ID, we use an attention model to find prototypes that represent a class. Our approach exhibits parallels with prior works such as [ 40 , 9 , 29 ] , in which the inference time setting allows