High Performance Space Debris Tracking in Complex Skylight Backgrounds with a Large-Scale Dataset
Guohang Zhuang, Weixi Song, Jinyang Huang, ChenWei Yang, Yan Lu · 2025
Read High Performance Space Debris Tracking in Complex Skylight Backgrounds with a Large-Scale Dataset by Guohang Zhuang, Weixi Song, Jinyang Huang, ChenWei Yang, Yan Lu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-02614.txt.
Introduction
Guohang Zhuang and co-authors present a deep learning tracker for space debris in a 2025 paper. Debris poses an extreme threat to spacecraft, and tracking it in real time is hard against complex, bright sky backgrounds. Older signal methods struggle with dense debris and clutter.
Their network, SDT-Net, learns debris features in a way that steadies end-to-end training. To train it, they built a large data set by simulation based on real observations. It holds over eighteen thousand video clips with a quarter million synthetic debris pieces. Tests confirm both the model's strength and the data set's challenge. Safer orbits depend on such tracking.
Catalog record
| CREATOR | Guohang Zhuang, Weixi Song, Jinyang Huang, ChenWei Yang, Yan Lu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-02614
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
High Performance Space Debris Tracking in Complex Skylight Backgrounds with a Large-Scale Dataset Guohang Zhuang, Weixi Song, Jinyang Huang, ChenWei Yang, Yan Lu Abstract With the rapid development of space exploration, space debris has attracted more attention due to its potential extreme threat, leading to the need for real-time and accurate debris tracking. However, existing methods are mainly based on traditional signal processing, which cannot effectively process the complex background and dense space debris. In this paper, we propose a deep learning-based Space Debris Tracking Network (SDT-Net) to achieve highly accurate debris tracking. SDT-Net effectively represents the feature of debris, enhancing the efficiency and stability of end-to-end model learning. To train and evaluate this model effectively, we also produce a large-scale dataset Space Debris Tracking Dataset (SDTD) by a novel observation-based data simulation scheme. SDTD contains 18,040 video sequences with a total of 62,562 frames and covers 250,000 synthetic space debris. Extensive experiments validate the effectiveness of our model and the challenging of our dataset. Furthermore, we test our model on real data from the Antarctic Station, achieving a MOTA score of 70.6%, which demonstrates its strong transferability to real-world scenarios. Our dataset and code will be released soon. 1 Introduction During the past decade, global space activities have exponentially increased, which has raised the potential risk of collisions between debris and spacecraft in near-Earth space [ 1 , 2 ] . This has led to significant economic losses, drawing increasing attention to the issue of space debris. The Space Debris Tracking (SDT) is to detect and predict the trajectories of space debris, reducing the collision risks and promoting space industry development. This makes monitoring debris extremely urgent and critical for ensuring the safety of space operations. SDT is an essential task that includes detecting and predicting the trajectories of space debris. It is a computer vision problem, specifically an object tracking task in astronomical videos, where the goal is to identify and follow space debris across continuous frames for a video. However, traditional methods typically focus on object detection rather than tracking. These approaches often rely on techniques such as template-matching methods [ 3 , 4 ] and morphological operator methods [ 5 , 6 ] . While these methods are capable of detecting debris in individual images, they struggle to associate objects across consecutive frames, making them less suitable for space debris monitoring. Artificial intelligence (AI) has achieved significant success in fields such as object detection [ 7 ] and object tracking [ 8 ] , due to its exceptional ability to process large-scale datasets. Traditional methods have limitations in space debris detection and cannot effectively handle long-term tracking tasks. AI models can make up for this deficiency through efficient data processing and learning methods. However, AI models rely on large-scale, high-quality datasets while astronomy data are extremely limited. So, there is no an effective AI model that could meet the requirements of debris tracking mission for popular telescopes like the Solar Data Telescope (LST) [ 9 ] and Wide-Field Survey Telescope (WFST) [ 10 ] . Figure 1: Illustration of the space debris formation and tracking pipeline using synthetic labels. It includes the simulation of space debris within Earth’s magnetic field, the generation of synthetic labels such as start (st), end (ed), and center (cen) points, and bounding boxes for debris in image frames. Additionally, the process of segment source debris tracking across multiple frames is shown, with visualization examples of debris tracking and dense debris tracking using the SDTD dataset. To address the challenge of limited data in astronomy, we follow the idea of observation-based data simulation in the astronomical field [ 11 , 12 , 13 ] . The observation-based data simulation is widely proven to lead to realistic data and reliable scientific conclusions, providing a chance for us to design a method for data simulating space debris. Due to its success, we construct a Space Debris Tracking Dataset (SDTD), which is the first publicly available dataset designed for space debris tracking. Tab 1 highlights the key differences of SDTD compared to existing datasets. Specifically, as shown in Fig 1 , SDTD consists of 18,040 synthetic videos, totaling 62,562 frames and 25,000 annotated debris instances. In order to apply AI methods to the SDT task, we propose a simple yet effective deep learning method, namely the Space Debris Tracking Network (SDT-Net). We introduce a Region-of-Interest Feature Enhancement (RoIFE) module to highlight debris features, aiding in more accurate detection. A detection module is then used to localize the debris by predicting their positions in the image. After localization, a tracking module is applied to perform cross-frame data association, generating tracking trajectories for each debris. In summary, the key contributions of this paper are as follows: 1. We propose a space debris simulation method. Based on this method, we construct SDTD, the first benchmark dataset for SDT. It contains 18,040 video data with complex backgrounds and diverse debris targets, and the data is close to the real space debris situation. 2. We introduce the Space Debris Tracking Network (SDT-Net) to improve space debris tracking. By integrating a RoIFE module, a detection module, and a tracking module, we effectively enhance debris representations, leading to more accurate and reliable tracking performance. 3. Evaluation on the constructed SDTD dataset shows that the proposed SDT-Net achieves state-of-the-art performance in terms of space debris tracking on the test set overall. Table 1: Summary of Space Debris Target Datasets. Dataset Type Size #Video. #Det. #Seg. #Track. Target Variations Debris Number [ 11 ] Real 83 images 7 video \checkmark \times \times One One SDebrisNet [ 14 ] Real 1551 images \times \checkmark \times \times Three One [ 6 ] Real 200 images \times \checkmark \times \times One One AstroStripeSet [ 15 ] Real 1500 images \times \checkmark \checkmark \times Four One SDTD Synthetic & Real 65,562 images 18,040 video \checkmark \checkmark \checkmark Five One to Five 2 Related Work 2.1 Object Detection and Tracking Object detection and tracking involves detecting objects, assigning a unique ID to each detection, and then tracking these objects across frames in a video while maintaining the ID assignments. This task has been a central focus in computer vision and has found applications in various fields, such as autonomous driving [ 16 ] . In the context of tracking, several methods have been proposed over the years. For instance, SORT [ 17 ] conducted track association by combining Kalman Filter [ 18 ] and Hungarian algorithm [ 19 ] . DeepSORT [ 20 ] introduced an extra cosine distance and compute the appearance similarity for track association. CenterTrack [ 21 ] is a center-based multi-object tracking method that extends the detection framework of CenterNet [ 22 ] to achieve efficient real-time tracking. ByteTrack [ 23 ] exploits low-score detection boxes by first matching high-confidence detections and then associating them with low-score detections. 2.2 Space Debris Detection Space Debris Detection is a task of predicting space debris location from a single image. Jiang et al. [ 24 ] applied enhanced median filtering to remove noise and used an improved Hough transform to detect targets. Guo et al. [ 25 ] proposed an enhanced YOLOv8-based method for space debris detection, achieving