Towards Cognitive Defect Analysis in Active Infrared Thermography with Vision-Text Cues
Mohammed Salah, Eman Ouda, Giuseppe Dell’Avvocato, Fabrizio Sarasini, Ester D’Accardi, Jorge Dias, Davor Svetinovic, Stefano Sfarra, Yusra Abdulrahman · 2026
Read Towards Cognitive Defect Analysis in Active Infrared Thermography with Vision-Text Cues by Mohammed Salah, Eman Ouda, Giuseppe Dell’Avvocato, Fabrizio Sarasini, Ester D’Accardi, Jorge Dias, Davor Svetinovic, Stefano Sfarra, Yusra Abdulrahman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10549.txt.
Introduction
Mohammed Salah and co-authors bring models that read both images and words to defect hunting in carbon fiber composites, using heat imaging. Training detectors the usual way needs costly, slow datasets of inspection sequences. Their framework skips that: encoders already trained on natural images, plus a light adapter, give zero-shot finding of hidden defects and where they sit. On 25 sequences with impacts at varied energies, the adapter beat classic reduction methods on signal quality, with strong detection overlap.
Catalog record
| CREATOR | Mohammed Salah, Eman Ouda, Giuseppe Dell’Avvocato, Fabrizio Sarasini, Ester D’Accardi, Jorge Dias, Davor Svetinovic, Stefano Sfarra, Yusra Abdulrahman |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41265 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.10549
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Cognitive Defect Analysis in Active Infrared Thermography with Vision-Text Cues Mohammed Salah, Eman Ouda, Giuseppe Dell’Avvocato, Fabrizio Sarasini, Ester D’Accardi, Jorge Dias, Davor Svetinovic, Stefano Sfarra, Yusra Abdulrahman Abstract Active infrared thermography (AIRT) is currently witnessing a surge of artificial intelligence (AI) methodologies being deployed for automated subsurface defect analysis of high performance carbon fiber-reinforced polymers (CFRP). Deploying AI-based AIRT methodologies for inspecting CFRPs requires the creation of time consuming and expensive datasets of CFRP inspection sequences to train neural networks. To address this challenge, this work introduces a novel language-guided framework for cognitive defect analysis in CFRPs using AIRT and vision-language models (VLMs). Unlike conventional learning-based approaches, the proposed framework does not require developing training datasets for extensive training of defect detectors, instead it relies solely on pretrained multimodal VLM encoders coupled with a lightweight adapter to enable generative zero-shot understanding and localization of subsurface defects. By leveraging pretrained multimodal encoders, the proposed system enables generative zero-shot understanding of thermographic patterns and automatic detection of subsurface defects. Given the domain gap between thermographic data and natural images used to train VLMs, an AIRT-VLM Adapter is proposed to enhance the visibility of defects while aligning the thermographic domain with the learned representations of VLMs. The proposed framework is validated using three representative VLMs; specifically, GroundingDINO, Qwen-VL-Chat, and CogVLM. Validation is performed on 25 CFRP inspection sequences with impacts introduced at different energy levels, reflecting realistic defects encountered in industrial scenarios. Experimental results demonstrate that the AIRT-VLM adapter achieves signal-to-noise ratio (SNR) gains exceeding 10 dB compared with conventional thermographic dimensionality-reduction methods, while enabling zero-shot defect detection with intersection-over-union (IoU) values reaching approximately 70%. These findings indicate that coupling pretrained VLMs with the proposed adapter enables reliable localization of subsurface CFRP defects without defect-specific training and extensive dataset preparation. † † aftertitle: I Introduction Carbon fiber reinforced polymers (CFRPs) are valued in the aerospace industry for their exceptional strength-to-weight ratio, corrosion resistance, and fatigue performance, enabling lighter airframes, improved fuel efficiency, and extended service life. Modern transport aircraft now rely heavily on CFRPs in primary load-bearing structures such as fuselage skins, wings, spars, ribs, and tail sections, as well as in secondary components, including control surfaces, fairings, doors, nacelles, and interior panels [ 9 , 31 ] . However, during manufacturing and in service, CFRP parts can develop a variety of defects and damage modes, such as porosity, resin-rich areas, fiber waviness or wrinkling, matrix cracking, debonding, delaminations, and impact-induced barely visible impact damage, which degrade stiffness, strength, and fatigue life and may remain hidden from visual inspection [ 4 ] . To assess material properties, structural integrity, and subsurface defects without causing damage, nondestructive testing (NDT) techniques are employed, particularly in safety-critical fields such as aerospace. Commonly used NDT methods for CFRP inspection include ultrasonic testing, radiographic inspection, and infrared thermography (IRT), all of which can detect hidden anomalies and subsurface damage [ 25 ] . Among these techniques, IRT has emerged as a valuable tool for identifying both surface and subsurface defects by analyzing the thermal response of CFRP structures [ 10 ] . IRT is based on monitoring the propagation of heat on the surface of a material, where disturbances in thermal patterns indicate the presence of internal anomalies [ 19 ] . In particular, active infrared thermography (AIRT) improves defect detectability by applying external thermal excitation, such as flash lamps, halogen heaters, or lasers, which increases the thermal contrast between sound and defective regions [ 20 ] . As a result, AIRT is especially suitable for inspecting non-metallic and multilayered materials where conventional inspection methods may be limited. AIRT has been widely adopted in sectors such as aerospace, energy, and civil infrastructure, where large-scale and on-site inspections are often required. Furthermore, recent advances in artificial intelligence (AI) have enabled automated defect characterization in AIRT. AI-based pulsed thermography (PT) algorithms have been proposed for defect classification [ 26 ] , segmentation [ 34 , 28 ] , and depth estimation [ 7 ] . In addition, to accelerate thermographic inspection processes and enable coverage of large structures, robotic and line-scan thermography systems have been introduced [ 17 ] . Although AI methodologies are currently being investigated in AIRT, a challenge in AI-based AIRT is the scarcity of datasets and the need to prepare costly datasets for training AI models for defect analysis. Vision–Language Models (VLMs) offer a promising paradigm for zero-shot defect detection in AIRT; however, current thermographic representations produced by conventional dimensionality-reduction techniques are not designed to generate image representations aligned with the natural-image domain of foundation VLMs, limiting their direct applicability for zero-shot reasoning. To address these challenges, this work proposes a zero-shot cognitive framework for defect analysis in AIRT using vision and text cues, leveraging the strong reasoning capabilities of pretrained multimodal VLMs. Specifically, an AIRT–VLM adapter is introduced to transform thermographic information into VLM-compatible representations, enabling off-the-shelf VLMs to perform zero-shot subsurface defect localization without thermography-specific training or large annotated datasets. As such, the focus of this work is methodological and AI-driven, applying multimodal VLMs to thermographic data for zero-shot defect localization, rather than advancing the physical modeling of infrared thermography. The key contributions of this work are as follows: 1. A novel zero-shot cognitive defect analysis framework for CFRP components is introduced, addressing the challenge of preparing time-consuming, costly datasets for AI-based thermographic inspection. 2. The AIRT-VLM Adapter is proposed to bridge the domain gap between thermographic data and natural image distributions used in pretrained Vision–Language Models, enhancing the visibility of the defect and representation alignment. 3. The proposed framework is tested to detect impact damage at different energy levels. The results show that VLMs coupled with the AIRT-VLM adapter enable reliable grounding of subsurface defects. I-A Related Work Compared to earlier NDT techniques, such as radiography, eddy current testing, and ultrasonic testing, AIRT offers higher efficiency, faster evaluation, and fully non-contact inspection [ 18 ] . This growing interest has spurred extensive research into learning-based models for defect detection, including adaptations of Faster R-CNN and YOLOv5 for IRT data [ 26 ] , as well as ConvLSTM architectures to better capture temporal dependencies [ 5 ] . For defect segmentation, various neural network architectures have been explored, such as U-Net variants for composites and forged components [ 33 , 15 ] , and ConvLSTM-based models for 3D defect depth reconstruction. However, many approaches rely mainly on spatial information and underutilize temporal dynamics in thermographic sequences. To address this limitation, 3D CNNs have been introduced to explicitly model spatiotemporal features and improve subsurface defect segmentation [ 7 ] . However, the aforementioned models are supervised and their performance depends heavily on the availability of large, carefully annotated thermographic datasets, whose acquisition and labeling are costly, time-consuming, and often limited in generalizability across varying inspection conditions. In these methods, AIRT dimensionality reduction techniques are primarily used as preprocessing steps to generate compact thermographic representations suitable for deep neural network input, since raw inspection sequences are highly dimensional and computationally expensive to process. AIRT dimensionality reduction is used to generate compact thermographic representations suitable for deep neural network input, as raw inspection sequences are highly dimensional and computationally expensive to process. Such techniques serve