A Semantic and Occlusion-Aware GM-PHD Filter
Jovan Menezes, Mark Campbell · 2026
Read A Semantic and Occlusion-Aware GM-PHD Filter by Jovan Menezes, Mark Campbell (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20666.txt.
Introduction
Jovan Menezes and Mark Campbell propose a semantic, occlusion-aware birth model for a Gaussian-mixture tracking filter. Earlier filters often assume new objects appear uniformly or under simple rules, which hurts tracking in dense driving scenes. Their model uses deep-learning semantic cues and explicit occlusion regions to say where new objects are likely to appear. Tests on simulations and the KITTI driving set show faster track initiation and lower cardinality error.
Catalog record
| CREATOR | Jovan Menezes, Mark Campbell |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40153 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.20666
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Semantic and Occlusion-Aware GM-PHD Filter Jovan Menezes, Mark Campbell Abstract This paper proposes a new birth model including semantic information derived from deep learning to create an occlusion-aware Gaussian Mixture Probability Hypothesis Density (GM-PHD) filter. Unlike prior approaches that rely on simplistic or uniform assumptions, the proposed Semantic-Occlusion Aware (S-OA) birth model defines initialization terms by explicitly considering regions of occlusion and by leveraging semantic information about the environment. This enables the filter to accurately represent where new objects are more likely to appear, thereby improving tracking performance in complex and high-density driving scenarios. The method is evaluated through Monte Carlo simulations and experiments on the KITTI dataset. Performance is assessed by measuring the latency between first detection and track initiation, along with the mean absolute cardinality error and the Optimal Subpattern Assignment (OSPA) metric. Results demonstrate that the S-OA birth model reduces initialization delay in occlusion-heavy settings, matching or outperforming the strongest baseline in approximately 70 % \mathbf{\%} of cases. A sensitivity analysis of birth model weights is also provided. Overall, the findings underscore the benefits of integrating occlusion reasoning and semantic priors into Bayesian tracking frameworks for autonomous driving. I Introduction Reliable multi-target tracking (MTT) is essential for autonomous vehicles, supporting safe navigation in dynamic, multi-agent traffic environments. However, it remains challenging due to sensor noise, occlusions, false detections, and uncertainty in both the number and states of objects [ 2 , 1 ] . MTT methods typically follow either the Tracking-by-Detection (TBD) or Joint Detection and Tracking (JDT) frameworks, and recent advances in both have incorporated deep learning. Although these approaches achieve strong performance through large-scale data and appearance-based association, they rely heavily on extensive training data, struggle with out-of-distribution scenes, offer limited uncertainty modeling, and incur high computational costs for data association in dense, cluttered driving scenarios. A principled alternative to learning-based methods is offered by Bayesian probabilistic frameworks that mainly follow the TBD paradigm, such as the Joint Probabilistic Data Association (JPDA) filter [ 3 ] , Multiple Hypothesis Tracking (MHT) filter [ 4 ] , and Random Finite Set (RFS) theory [ 5 ] . These approaches do not rely on large-scale training data and naturally quantify uncertainty. The key distinction between these approaches lies in how they address the data association problem: JPDA averages over associations for each target, MHT maintains multiple competing hypotheses over time, and RFS models the entire multi-target state as a probabilistic set. Among RFS-based filters, the Probability Hypothesis Density (PHD) filter [ 6 ] stands out by eliminating the need for explicit data association. The PHD filter provides a transparent and interpretable probabilistic framework that naturally handles clutter, missed detections, and an unknown and varying number of targets. These characteristics make it particularly suitable for MTT in autonomous vehicles, where highly dynamic environments, dense traffic, and frequent target entries and exits are prevalent, as seen in Fig. 1 . Fig. 1: MTT in a dense driving scenario. A target (marked in pink in the camera frame) enters the scene at t_{1} , gets occluded at t_{2} , and reappears at t_{3} . Our S-OA GM-PHD filter leverages occlusion reasoning and scene semantics to initiate tracking (marked in red at t_{3} ) more quickly than baseline methods (marked in blue at t_{5} ). The GM-PHD filter models the target intensity function, which represents the expected spatial density of targets, as a mixture of weighted Gaussian components. The GM-PHD filter has been successfully applied across various domains [ 7 , 8 , 9 ] . However, the formulation of the birth model remains a key challenge for the PHD filter and the wider class of RFS theory-based filters, as it directly governs the introduction of new targets into the scene. Existing approaches to defining birth models are often computationally expensive, rely on restrictive assumptions, require prior map data, or necessitate careful tuning of mixture parameters to achieve acceptable tracking performance. Standard GM-PHD filter formulations assume that potential birth locations are known a priori, and define Gaussian birth components in these regions [ 10 ] . In autonomous driving scenarios, this assumption proves inefficient, as new targets may appear anywhere within the sensor’s field of view (FOV), often emerging from behind occlusions. Consequently, the birth model must consider the entire surveillance volume. Frequent creation and deletion of perceived targets can also negatively affect downstream planning and control, leading to unstable or stop-and-go driving behavior. A simple alternative is to uniformly distribute birth terms across the workspace, but this is computationally inefficient and impractical for real-time use. A hybrid approach combining a uniform distribution with selected Gaussian components is proposed in [ 11 ] ; however, its computational cost grows significantly with workspace size. Adaptive methods in [ 12 , 13 ] update the birth model at each scan using incoming measurements, but they are highly sensitive to clutter and prone to tracking false positives, an important limitation in safety-critical applications such as autonomous driving. Most existing methods do not explicitly incorporate scene context, occlusions, or semantic structure into the birth model. Although [ 14 , 15 ] integrate semantic information into the PHD filter, they focus mainly on target classification rather than broader environmental understanding. In autonomous driving, new targets often emerge from occluded areas, such as behind vehicles or infrastructure, and their appearance depends strongly on scene semantics, for example, pedestrians are more likely near crosswalks. Incorporating occlusion awareness and semantic priors into the birth process can therefore improve initialization, reduce false positives, and enhance overall tracking performance. Motivated by the need for improved occlusion reasoning we introduce a novel birth model for the GM-PHD filter that explicitly integrates both occlusion information and environmental semantics to accurately represent the spatial distribution of new targets. By leveraging these contextual cues, the S-OA GM-PHD filter shortens the latency in initiating tracks for newly born targets and improves robustness in complex, cluttered scenes. We present the following contributions of this work: • A novel birth model for the GM-PHD filter that explicitly incorporates scene semantics and occlusion information, enabling more accurate target initialization in dense and dynamic environments. • A comprehensive evaluation of the S-OA birth model through extensive Monte Carlo simulations and experiments on the KITTI benchmark dataset, with performance compared against multiple established baselines. • An analysis of tracking robustness of the S-OA birth model relative to the uniform and partially uniform birth model under varying model parameters, addressing a gap that has received limited attention in previous studies. II Background The formulation of the PHD filter follows references [ 6 , 10 , 16 ] . At time step k , we consider a set \mathbf{X}_{k} of n_{k} targets in the state space \mathcal{X}\in\mathbb{R}^{n_{x}} , where each target state is denoted by \mathbf{x}_{1,k},\dots,\mathbf{x}_{{n_{k}},k} . Similarly, the sensor receives a set \mathbf{Z}_{k} of m_{k} measurements represented by \mathbf{z}_{1,k},\dots,\mathbf{z}_{{m_{k}},k} from the observation space \mathcal{Z}\in\mathbb{R}^{n_{z}} . RFS models the multi-target state \mathbf{X}_{k} and multi-target measurement \mathbf{Z}_{k} collections as finite sets, with no inherent ordering among their elements. Every time step, certain targets may disappear, while others survive and evolve into new states, and additional targets may be introduced into the scene. Owing to imperfections in the sensor and the detection process, some