TAPM-Net: Trajectory-Aware Perturbation Modeling for Infrared Small Target Detection

Hongyang Xie, Hongyang He, Victor Sanchez · 2026

Read TAPM-Net: Trajectory-Aware Perturbation Modeling for Infrared Small Target Detection by Hongyang Xie, Hongyang He, Victor Sanchez (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05446.txt.

Introduction

Hongyang Xie and 2 co-authors propose TAPM-Net, a 2026 network for finding tiny infrared targets in cluttered scenes. Infrared small target detection is hard because targets are faint, cover few pixels, and compete with structured background noise. Earlier neural models improved accuracy but did not trace how a target disturbs features layer by layer.

TAPM-Net follows those disturbances as trajectories. One module builds energy fields from features at several levels and extracts paths that follow local gradients. A second, Mamba-based module models movement along each path with constrained diffusion and feature fusion. Experiments on the NUAA-SIRST and IRSTD-1K datasets report state-of-the-art results at modest computational cost.

Catalog record

CREATORHongyang Xie, Hongyang He, Victor Sanchez
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05446

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TAPM-Net: Trajectory-Aware Perturbation Modeling for Infrared Small Target Detection Hongyang Xie, Hongyang He, Victor Sanchez Abstract Infrared small target detection (ISTD) remains a long-standing challenge due to weak signal contrast, limited spatial extent, and cluttered backgrounds. Despite performance improvements from convolutional neural networks (CNNs) and Vision Transformers (ViTs), current models lack the mechanism to trace how small targets trigger directional, layer-wise perturbations in the feature space—an essential cue for distinguishing signal from structured noise in infrared scenes. To address this limitation, we propose the Trajectory-Aware Mamba Propagation Network (TAPM-Net) that explicitly models the spatial diffusion behavior of target-induced feature disturbances. TAPM-Net is built upon two novel components: a Perturbation-guided Path Module (PGM) module and a Trajectory-Aware State Block (TASB). The PGM module constructs perturbation energy fields from multi-level features and extracts gradient-following feature trajectories that reflect the directionality of local responses. The resulting feature trajectories are fed into the TASB, which is a Mamba-based state-space unit that models dynamic propagation along each trajectory while incorporating velocity-constrained diffusion and semantic-aligned feature fusion from word- and sentence-level embeddings. Unlike existing attention-based methods, TAPM-Net enables anisotropic, context-sensitive state transitions along spatial trajectories, maintaining global coherence at low computational cost. Experiments on NUAA-SIRST and IRSTD-1K demonstrate that TAPM-Net achieves SOTA performance in ISTD. TAPM-Net † † email: [email protected] † † email: [email protected] † † email: [email protected] † † affiliation: Signal and Information Processing (SIP) Lab The University of Warwick Coventry, UK 1 Introduction Infrared small target detection (ISTD) is a crucial task in surveillance, remote sensing, and defense applications. Traditional approaches for ISTD predominantly focus on background suppression [ 1 , 11 , 15 , 23 ] , and low-rank [ 14 , 7 ] and sparse decomposition techniques [ 10 , 39 , 40 ] . These approaches aim to isolate targets by modeling the background as a low-rank structure while treating the targets as sparse outliers. However, they often suffer from low detection accuracy, poor generalization to complex scenes, and vulnerability to structured noise. Figure 1: Performance vs. complexity of several models on the NUAA-SIRST dataset. Each model is represented by a distinct color. The size of each marker reflects the relative computational cost of the corresponding model. By learning data-driven discriminative features, CNN-based methods [ 29 , 8 , 9 , 17 , 13 , 44 , 46 , 33 , 27 , 32 , 22 , 36 , 18 , 19 ] outperform traditional ISTD methods in both precision and recall. However, many of these methods still rely on local contrast cues or global saliency estimation, and thus struggle to maintain fine-grained sensitivity to subtle, dispersed targets, particularly in highly textured or dynamic environments. Recently, ViTs [ 35 ] and hybrid CNN-Transformer architectures [ 30 , 41 , 5 ] have further pushed detection accuracy by leveraging global self-attention and cross-layer fusion. Despite their strong performance, these models are typically computationally expensive, making them impractical for resource-constrained applications. Moreover, they lack an explicit mechanism to trace how feature disturbances propagate spatially, especially when such disturbances are weak or distributed. To address these limitations, we draw inspiration from physical diffusion models [ 4 , 24 , 42 , 12 , 2 ] and propose a fundamentally different approach: treating small targets not as isolated saliency peaks but as sources of structured perturbation that propagate through the feature space. We then introduce TAPM-Net, a Trajectory-Aware Mamba Propagation Network that models the spatial dynamics of target-induced disturbances in a principled and learnable manner. TAPM-Net comprises two key modules: the Perturbation-guided Path Module (PGM), which constructs energy fields from backbone features and extracts gradient-aligned propagation feature trajectories; and the Trajectory-Aware State Block (TASB), which uses the Mamba architecture to recursively model state transitions along each trajectory. This design enables efficient, directional, and semantically aligned propagation modeling with low computational overhead. Unlike attention-based models that operate globally and uniformly, TAPM-Net focuses on structured, trajectory-aware propagation, thus capturing not only where the target is, but how its influence spreads. As shown in Figure 1 , TAPM-Net outperforms existing methods in both accuracy and efficiency by fully leveraging data-driven spatial propagation. Instead of relying on handcrafted priors, TAPM-Net learns perturbation-aware feature trajectories directly from feature distributions and models them efficiently using a Mamba-based state-space formulation. Our contributions are then threefold: • Our work is the first to introduce a perturbation-based formulation into the ISTD task, modeling small targets as localized disturbance sources and constructing energy fields to trace their spatial influence. • Inspired by physical diffusion, we design a trajectory-aware state-space modeling framework built on Mamba, enabling efficient and semantically aligned feature propagation along gradient-guided trajectories. • TAPM-Net achieves superior accuracy and computational efficiency in the NUAA-SIRST and IRSTD-1K datasets, confirming its effectiveness under both detection and deployment constraints. 2 Related work ISTD networks. Recent advances in ISTD have been driven by deep learning models, particularly CNNs, evaluated on the NUAA-SIRST [ 8 ] benchmark, first introduced by ACM [ 8 ] to promote standardized evaluation. For example, MDvsFA [ 29 ] proposes feature aggregation to balance false alarms and miss-detections. DNANet [ 17 ] introduces dense nested connections for multi-scale context modeling, while UIUNet [ 34 ] leverages a U-Net to enhance spatial detail preservation. However, CNN-based methods typically focus on local feature extraction, often struggling to model weak target responses under strong background interference or to capture global context dependencies. To address these limitations, transformer-based and hybrid models have emerged. For example, TCI-Former [ 5 ] introduces target-contour interaction to jointly model target structures and their surrounding context, improving boundary preservation. MiM-ISTD [ 6 ] proposes a nested Mamba-in-Mamba architecture to model feature perturbation propagation across scales, enhancing robustness in complex scenes. These methods partially bridge local-global feature integration but remain computationally demanding. Despite recent advances, ISTD still faces long-term challenges in robustly modeling weak, structureless targets in cluttered environments while maintaining computational efficiency. Motivated by these gaps, our proposed TAPM-Net introduces trajectory-guided feature modeling and Mamba-based state propagation, enabling efficient disturbance-aware detection with enhanced spatial coherence and long-range dependency modeling. State-space sequence modeling in vision tasks. These models emerge as efficient alternatives to self-attention mechanisms to capture long-range dependencies in vision tasks. For example, U-Mamba [ 20 ] extends Mamba to dense pixel-wise prediction by embedding state transitions into a U-Net, improving spatial detail retention. Swin-UNet [ 3 ] integrates shifted window mechanisms with hierarchical U-Net decoding, enhancing local-global feature alignment. Weak-Mamba-U-Net [ 31 ] introduces lightweight state updates to reduce computational overhead while preserving temporal dynamics. LocalVMamba [ 16 ] constrains state propagation within local regions, improving locality awareness but limiting global context modeling. MS-VMamba [ 26 ] extends Mamba to multi-scale feature processing, enabling cross-scale dependency learning. GroupMamba [ 25 ] further decomposes state transitions into grouped channels, improving efficiency in large-scale vision tasks. While these designs demonstrate the versatility of state-space modeling, they often rely on spatially uniform token propagation, lacking physically grounded mechanisms to guide feature flows based on disturbance structures. Mamba’s linear-time recurrence offers clear advantages over attention mechanisms in terms of scalability and efficiency, but current formulations treat all spatial positions equally, ignoring localized perturbation dynamics critical to ISTD. To address this, TAPM-Net integrates trajectory-guided state propagation into

Read the complete text