JDATT: A Joint Distillation Framework for Atmospheric Turbulence Mitigation and Target Detection

Zhiming Liu, Paul Hill, Nantheera Anantrasirichai · 2025

Read JDATT: A Joint Distillation Framework for Atmospheric Turbulence Mitigation and Target Detection by Zhiming Liu, Paul Hill, Nantheera Anantrasirichai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19780.txt.

Introduction

Zhiming Liu, Paul Hill, and Nantheera Anantrasirichai present a compact framework that both clears air turbulence from images and finds targets in them, in a paper from 2025. Turbulence warps video with ripples, blur, and flicker. That hurts both image quality and detection. Doing the two jobs in sequence wastes effort and loses accuracy.

Their framework, JDATT, joins a strong clearing model and a detector, then shrinks both by joint distillation. A large model's skill is passed to a small one at two levels: inner features and final outputs. Tests on synthetic and real turbulence data showed better restored images and detection scores. Model size and running time fell sharply, suiting live use on light gear such as remote cameras.

Catalog record

CREATORZhiming Liu, Paul Hill, Nantheera Anantrasirichai
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-19780

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

JDATT: A Joint Distillation Framework for Atmospheric Turbulence Mitigation and Target Detection Zhiming Liu, Paul Hill, Nantheera Anantrasirichai Abstract Atmospheric turbulence (AT) introduces severe degradations—such as rippling, blur, and intensity fluctuations—that hinder both image quality and downstream vision tasks like target detection. While recent deep learning–based approaches have advanced AT mitigation using transformer and Mamba architectures, their high complexity and computational cost make them unsuitable for real-time applications, especially in resource-constrained settings such as remote surveillance. Moreover, the common practice of separating turbulence mitigation and object detection leads to inefficiencies and suboptimal performance. To address these challenges, we propose JDATT —a J oint D istillation framework for A tmospheric T urbulence mitigation and T arget detection. JDATT integrates state-of-the-art AT mitigation and detection modules and introduces a unified knowledge distillation strategy that compresses both components while minimizing performance loss. We employ a hybrid distillation scheme: feature-level distillation via Channel-Wise Distillation (CWD) and Masked Generative Distillation (MGD), and output-level distillation via Kullback–Leibler divergence. Experiments on synthetic and real-world turbulence datasets demonstrate that JDATT achieves superior visual restoration and detection accuracy while significantly reducing model size and inference time, making it well-suited for real-time deployment. 1 Introduction Atmospheric turbulence (AT), caused by temperature differences between the ground and the air, frequently occurs in real-world scenarios. It severely degrades the quality of images and videos by introducing distortions such as rippling, blurring, and intensity fluctuations. These effects pose significant challenges not only to visual fidelity but also to downstream tasks such as object recognition and detection Hill2025 . Traditional methods for mitigating atmospheric turbulence distortions—such as deconvolution Deledalle:blind:2020 and lucky imaging 6471221 —struggle with limitations in computational efficiency and tend to introduce artifacts, particularly in dynamic scenes. In recent years, significant progress has been made in atmospheric turbulence mitigation techniques aimed at enhancing visual quality. Early convolutional neural network (CNN)-based approaches gao2019atmospheric laid the groundwork for more advanced methods such as TMT zhang2023imagingatmosphereusingturbulence , which employs transformer architectures, and MAMAT hill2025mamat3dmambabasedatmospheric , which leverages a 3D Mamba framework han2024mamba3denhancinglocalfeatures . These models have substantially improved image clarity and structural fidelity. However, their high parameter counts and complex architectures result in slow inference speeds, limiting their use in real-time applications. In practice—particularly in time-sensitive domains like remote surveillance—turbulence mitigation alone is insufficient. Accurate and efficient target detection must be jointly addressed. Although mainstream detection models ren2016fasterrcnnrealtimeobject ; carion2020endtoendobjectdetectiontransformers achieve high accuracy, most research prioritizes detection performance over model efficiency and real-time capability. While YOLO redmon2016lookonceunifiedrealtime is known for its real-time detection efficiency, integrating it with mitigation models in atmospheric turbulence environments introduces substantial computational overhead. This combined framework often compromises real-time performance, particularly in remote monitoring systems with limited computational resources. Consequently, reducing model size and inference time while preserving detection accuracy remains a key challenge. To address the aforementioned challenges, we propose the first end-to-end joint distillation optimization framework, JDATT ( J oint D istillation framework for A tmospheric T urbulence mitigation and T arget detection). JDATT integrates a state-of-the-art atmospheric turbulence mitigation module with a high-performing target detection model under atmospheric turbulence conditions, optimized jointly via a unified knowledge distillation (KD) strategy to enable model compression with minimal performance degradation. Specifically, the proposed joint distillation framework adopts a hybrid strategy that combines feature-level and output-level distillation. For feature-level supervision, we employ Channel-Wise Distillation (CWD) shu2021channelwiseknowledgedistillationdense and Masked Generative Distillation (MGD) yang2022maskedgenerativedistillation . CWD aligns intermediate channel responses between teacher and student, while MGD introduces region-specific masks to guide the student toward salient areas. At the output level, we apply Kullback–Leibler (KL) divergence hinton2015distillingknowledgeneuralnetwork to match the student’s class probability distributions to those of the teacher, facilitating the transfer of inter-class relationships. These components are complementary: feature-level distillation conveys representational capacity, while output-level distillation refines prediction alignment. Together, they enable efficient knowledge transfer within a compact model architecture. Experiments on both synthetic and real atmospheric turbulence datasets show that the joint distillation training strategy yields better visual quality in restored videos and higher target detection accuracy compared to separate distillation processes. Our knowledge distillation strategy reduces model size and inference time, demonstrating its effectiveness in turbulence-affected target detection scenarios. 2 Related Work Atmospheric turbulence mitigation. Over the past decade, deep learning has driven the development of numerous turbulence mitigation methods. Early approaches were primarily based on CNN architectures gao2019atmospheric ; mao2021acceleratingatmosphericturbulencesimulation ; anan2023atmospheric , but recent work has demonstrated the superior capability of transformers in capturing complex distortion patterns. TurbNet mao2022single adopts a UNet-like architecture, replacing convolutional layers with transformer blocks. TMT zhang2023imagingatmosphereusingturbulence introduces a two-stage pipeline—de-tilting to correct local shifts and de-blurring to enhance clarity—guided by a multi-scale loss to improve performance under varying turbulence levels. Wo et al. Wu:24 enhance local-global context interaction using sliding window-based self-attention and channel attention, inspired by phase distortion and point spread function representations. Physics-inspired models have also gained traction for turbulence removal Jaiswal:Physics:2023 ; Jiang:NeRT:2023 . Diffusion models have shown superior performance on single-image restoration Nair:AT-DDPM:2023 , while transformer-based methods remain state-of-the-art for video restoration Anantrasirichai:Artificial:2021 . The DATUM framework zhang2024spatiotemporalturbulencemitigationtranslational replicates classical mitigation pipelines 6471221 , combining deformable attention for frame alignment and residual dense blocks for fusion. Most recently, MAMAT hill2025mamat3dmambabasedatmospheric integrates 3D Mamba within a UNet-like architecture, outperforming both TMT and DATUM on synthetic benchmarks. Object detection. Object detectors are broadly classified into two-stage and one-stage models. Two-stage detectors, like the R-CNN family girshick2014rich , first generate region proposals and then classify them. Faster R-CNN ren2016fasterrcnnrealtimeobject improve efficiency by unifying proposal and classification steps. One-stage detectors, such as YOLO redmon2016lookonceunifiedrealtime , predict bounding boxes and class probabilities in a single pass, offering faster performance for real-time tasks like surveillance and autonomous driving. Successive YOLO versions (e.g. wang2022yolov7 ; khanam2024yolov11overviewkeyarchitectural ) introduce improvements such as anchor boxes, multi-scale detection, and advanced augmentation strategies. Transformer-based detectors like DETR carion2020endtoendobjectdetectiontransformers replace traditional components with a transformer encoder-decoder and bipartite matching. Extensions like Deformable DETR zhu2021deformable enhance performance on small objects and improve training convergence. To date, only two methods have specifically proposed detector architectures designed to better handle turbulence-induced distortions Lau:ATFaceGAN:2020 ; Hu:Object:2023 . Knowledge distillation (KD). Knowledge distillation (KD) is a widely adopted model compression technique that enables a lightweight student network to inherit the performance characteristics of a larger, high-capacity teacher model. Initially introduced by Hinton et al. hinton2015distillingknowledgeneuralnetwork , KD leverages the teacher’s softened output logits to guide the student model with richer supervisory signals than one-hot labels alone. This approach has become especially influential in computer vision tasks where model efficiency is crucial, such as object detection, semantic segmentation, and real-time video analysis. Existing KD techniques can be broadly categorized into three groups: i) Response-based distillation: The most classic form of KD, in which the student learns to replicate the teacher’s output probability distribution hinton2015distillingknowledgeneuralnetwork . ii) Feature-based distillation: These methods supervise the student using the teacher’s intermediate feature representations or activation maps, often incorporating attention or normalization mechanisms to better align spatial or channel-wise features romero2015fitnetshintsdeepnets ; zhou2020channeldistillationchannelwiseattention . iii) Relation-based distillation: Instead of matching raw features, these methods distill the relational knowledge encoded in the teacher’s internal representations, such as pairwise distances, similarities, or graph-based structures among instances or feature channels park2019relationalknowledgedistillation . 3 Methodology Figure 1 : Overview

Read the complete text