DPM++: Dynamic Masked Metric Learning for Occluded Person Re-identification
Lei Tan, Yingshi Luan, Pincong Zou, Pingyang Dai, Liujuan Cao · 2026
Read DPM++: Dynamic Masked Metric Learning for Occluded Person Re-identification by Lei Tan, Yingshi Luan, Pincong Zou, Pingyang Dai, Liujuan Cao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06637.txt.
Introduction
Lei Tan, Yingshi Luan, Pincong Zou, Pingyang Dai, and Liujuan Cao tackle person re-identification when bodies are partly hidden behind obstacles. Occlusion removes identifying cues and adds clutter, so matching a partial view against a whole-body representation is unreliable. Earlier methods estimate visible parts with extra models or fake occlusion through augmentation, without one unified learning scheme.
Their DPM++ framework learns a masked metric that adapts per sample, selecting identity features that stay visible and suppressing unreliable ones. A CLIP-based two-stage supervision transfers text-side identity knowledge into the matching space. Saliency-guided patch transfer synthesizes realistic occluded training samples, and benchmarks show consistent gains in both occluded and normal settings.
Catalog record
| CREATOR | Lei Tan, Yingshi Luan, Pincong Zou, Pingyang Dai, Liujuan Cao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06637
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DPM++: Dynamic Masked Metric Learning for Occluded Person Re-identification Lei Tan, Yingshi Luan, Pincong Zou, Pingyang Dai, Liujuan Cao Abstract Although person re-identification has achieved impressive progress in recent years, the common occlusion case caused by different obstacles remains an unsettled issue in real-world applications. The fundamental difficulty lies in the mismatch between incomplete occluded samples and holistic identity representations. Severe occlusion not only removes discriminative body cues but also introduces strong interference from background clutter and occluders, making conventional global metric learning unreliable. Existing methods mainly address this issue either by relying on extra pre-trained models to estimate visible parts for alignment or by constructing occluded samples through data augmentation to improve robustness. However, they still lack a unified framework that directly learns robust visibility-consistent matching under realistic occlusion patterns. In this paper, we propose DPM++, a Dynamic Masked Metric Learning framework for occluded person re-identification. The key idea of DPM++ is to learn an input-adaptive masked metric that dynamically selects reliable identity subspaces for each occluded instance, so that the matching process emphasizes visibility-consistent discriminative evidence while suppressing unreliable or occlusion-sensitive components. Built upon the original classifier-prototype space, DPM++ further introduces a CLIP-based two-stage supervision scheme, in which ID-level semantic priors are first learned from the text branch and then transferred into the classifier-prototype space used for final dynamic masked matching. To further strengthen the learning of the proposed masked metric, we introduce a saliency-guided patch transfer strategy to synthesize controllable and photo-realistic occluded samples during training. By exploiting real scene priors in the training data, this strategy exposes the model to realistic partial observations and provides richer supervision than conventional random erasing-based augmentation. In addition, occlusion-aware sample pairing and mask-guided optimization are developed to further improve the stability and effectiveness of the overall framework. Extensive experiments on multiple occluded and holistic person re-identification benchmarks demonstrate that DPM++ consistently outperforms previous state-of-the-art methods in both holistic and occlusion scenarios. I Introduction Person re-identification (ReID) aims to match pedestrian instances across non-overlapping camera views and has been extensively studied due to its wide applications in intelligent surveillance and public security [ 1 , 2 , 3 ] . Benefiting from large-scale benchmarks and deep neural networks, recent ReID methods have achieved impressive progress under holistic settings, where most body regions are visible and discriminative appearance cues can be reliably captured [ 4 , 5 ] . However, this assumption is frequently violated in real-world scenarios. In practice, pedestrians are often occluded by vehicles, other people, signboards, or background clutter, which severely corrupts identity evidence and causes a significant performance degradation for conventional ReID models. As a result, occluded person re-identification remains an important yet unresolved problem in practical deployment [ 6 , 7 , 8 ] . The core difficulty of occluded person re-identification lies in the mismatch between occluded samples and holistic identity representations. Under severe occlusion, only a subset of identity-related patterns remains visible, while conventional ReID models are usually trained to compare global features in a fixed embedding space. Such global matching is vulnerable to missing body parts, spurious background responses, and occluder interference, making the learned metric unreliable when visual evidence becomes incomplete. Existing works mainly attempt to alleviate this issue from two directions, as shown in Figure 1 (a) and (b). One line of work introduces extra pre-trained models [ 9 , 10 , 11 ] , such as human parsing, pose estimation, or body clue extraction, to estimate visible parts and assist feature alignment. Although effective in some cases, these methods often suffer from domain gaps between auxiliary models and ReID data, and their performance can be sensitive to inaccurate visible-part prediction. Another line of work enhances robustness through occlusion-oriented data augmentation by constructing occluded samples during training [ 12 , 13 , 14 ] . While such strategies improve data diversity, many of them still rely on random erasing-style corruption, whose content and location differ substantially from realistic occlusion patterns observed in practice. These limitations indicate that occluded ReID should not be treated merely as a harder version of holistic ReID, nor as a problem that can be solved solely by auxiliary visible-part estimation or random corruption simulation. Instead, it should be revisited as a partial-to-holistic matching problem: given an incomplete visual observation, the model must determine which identity evidence remains reliable and compare it against a more complete identity anchor in a visibility-consistent manner. From this perspective, the key challenge is not only to suppress occlusion noise, but also to learn a metric that dynamically adapts to the visibility condition of each input instance. Fig. 1 : Conceptual comparison of three paradigms for occluded person re-identification. (a) Data augmentation-based methods improve robustness by enforcing feature consistency between the original sample and its augmented views. (b) Auxiliary network-based methods rely on extra cues, such as pose or visible-part information, to explicitly align occluded samples. (c) In contrast, DPM++ performs automatic partial-to-holistic alignment by dynamically generating an image-specific mask and selecting a visibility-consistent discriminative subspace, without requiring extra body-part supervision or pre-trained auxiliary networks. A natural way to address this challenge is to introduce prototypes as holistic anchors and perform matching in a dynamically selected subspace [ 15 ] . Prototype-based matching has shown strong potential in occluded ReID, since it provides a relatively stable reference against which incomplete observations can be compared. In particular, DPM [ 15 ] demonstrates that dynamic prototype masking offers an effective way to reformulate occluded matching as subspace selection in the prototype space. Nevertheless, purely visual prototypes are still learned from training images and therefore inevitably inherit the bias of occlusion, background contamination, and data imbalance. Consequently, under severe occlusion, visual prototypes may not always serve as sufficiently complete or robust identity anchors. This limitation motivates us to move beyond purely visual supervision and seek stronger semantic priors for prototype learning. In this paper, we propose DPM++ , a Dynamic Masked Metric Learning framework for occluded person re-identification as shown in Figure 1 (c). The central idea of DPM++ is to learn an input-adaptive masked metric that dynamically selects reliable identity subspaces for each occluded instance, so that the matching process emphasizes visibility-consistent discriminative evidence while suppressing unreliable or occlusion-sensitive components. Different from directly replacing the original DPM prototypes with text embeddings, DPM++ retains the task-oriented classifier-prototype space for final dynamic masked matching, while introducing a CLIP-based two-stage supervision scheme to enhance prototype learning. Specifically, ID-level semantic priors are first learned from the text branch, and then transferred into the classifier-prototype space used in the second stage. In this way, the final classifier prototypes become more holistic, semantically informed, and robust under severe occlusion, while remaining fully compatible with the original DPM-style masking mechanism. This design offers two important advantages. First, the text branch provides higher-level semantic priors that are less sensitive to local corruption caused by occlusion. Compared with prototypes learned purely from occluded visual observations, the semantics learned from CLIP offer a more stable supervisory signal for identity representation learning. Second, by transferring such semantic priors into the classifier-prototype space, DPM++ preserves the strengths of the original DPM formulation, i.e., performing final masked matching in a task-oriented visual prototype space rather than directly relying on