From Prediction to Diagnosis: Reasoning-Aware AI for Photovoltaic Defect Inspection
Dev Mistry 1, Feng Qiu 2, Bo Chen 3, Feng Liu 4, Can Chen 5, Mohammad Shahidehpour 1, Ren Wang 1,∗ · 2026
Read From Prediction to Diagnosis: Reasoning-Aware AI for Photovoltaic Defect Inspection by Dev Mistry 1, Feng Qiu 2, Bo Chen 3, Feng Liu 4, Can Chen 5, Mohammad Shahidehpour 1, Ren Wang 1,∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26776.txt.
Introduction
Mistry and co-authors present REVL-PV, a vision-language framework that reasons its way to photovoltaic defect calls. Most detectors act as opaque classifiers, giving little insight for high-stakes solar assets. Their model links visual evidence to likely defect causes before naming a class, across luminescence, thermal, and daylight images. The output reads as a structured diagnostic report in the style of pro inspection. On 1,927 real modules in eight defect groups it reaches 93% accuracy. A blind check shows its reports align closely with a certified inspector.
Catalog record
| CREATOR | Dev Mistry 1, Feng Qiu 2, Bo Chen 3, Feng Liu 4, Can Chen 5, Mohammad Shahidehpour 1, Ren Wang 1,∗ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40376 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.26776
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
From Prediction to Diagnosis: Reasoning-Aware AI for Photovoltaic Defect Inspection Dev Mistry 1, Feng Qiu 2, Bo Chen 3, Feng Liu 4, Can Chen 5, Mohammad Shahidehpour 1, Ren Wang 1,∗ Abstract {affiliations} Department of Electrical and Computer Engineering, Illinois Institute of Technology, Chicago, IL 60616, USA Argonne National Laboratory, Lemont, IL 60439, USA Smart Grid Emerging Technology Department, Commonwealth Edison, Chicago, IL 60618, USA Department of Computer Science, Drexel University, Philadelphia, PA 19104, USA School of Data Science and Society, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA To whom correspondence should be addressed ([email protected]). 1 Abstract Reliable photovoltaic defect identification is essential for maintaining energy yield, ensuring warranty compliance, and enabling scalable inspection of rapidly expanding solar fleets. Although recent advances in computer vision have improved automated defect detection, most existing systems operate as opaque classifiers that provide limited diagnostic insight for high-stakes energy infrastructure. Here we introduce REVL-PV, a vision-language framework that embeds domain-specific diagnostic reasoning into multimodal learning across electroluminescence, thermal, and visible-light imagery. By requiring the model to link visual evidence to plausible defect mechanisms before classification, the framework produces structured diagnostic reports aligned with professional photovoltaic inspection practice. Evaluated on 1,927 real-world modules spanning eight defect categories, REVL-PV achieves 93% classification accuracy while producing interpretable diagnostic rationales and maintaining strong robustness under realistic image corruptions. A blind concordance study with a certified solar inspection expert shows strong semantic alignment between model explanations and expert assessments across defect identification, root-cause attribution, and visual descriptions. These results demonstrate that reasoning-aware multimodal learning establishes a general paradigm for trustworthy AI-assisted inspection of photovoltaic energy infrastructure. The global deployment of solar photovoltaics is accelerating at an exponential pace. Cumulative installed PV capacity worldwide surpassed 2.26 TW by the end of 2024 after record annual additions of 553-601 GW, more than any other energy-generation technology [ 10 ] . According to the International Energy Agency, renewable power capacity is set to expand by nearly 4,600 GW between 2025 and 2030 (equivalent to the combined current power capacity of China, the European Union and Japan), with solar PV accounting for almost 80 percent of this growth [ 11 ] . This scale implies that hundreds of millions of new modules will enter operation annually worldwide. Thus, with this unprecedented expansion comes the critical challenge that undetected or misclassified defects will accelerate degradation, reduce energy yields across utility-scale fleets by several percent, increase operations-and-maintenance costs, and create safety hazards including fires and electrical faults. As a result, the exclusive reliance on manual inspection has become increasingly untenable, intensifying the need for automated diagnostic systems that can operate reliably across heterogeneous imaging conditions and defect types while effectively supporting and augmenting human expertise. Earlier methods based on thresholding with morphological operations [ 9 ] , Fourier image reconstruction [ 23 ] and handcrafted reconstruction pipelines were effective only for obvious anomalies under controlled conditions, but they lacked robustness to illumination changes, subtle internal faults, and large-scale deployment variability [ 7 ] . More recent Convolutional Neural Network- and Vision Transformer (ViT)-based architectures have substantially improved defect localization and classification performance. Among all these methods, the YOLO family of models [ 15 , 1 , 14 ] and various ViT frameworks [ 18 , 12 ] have become particularly prominent for module-level fault detection. However, most existing approaches still function primarily as black-box predictors. They exhibit reduced generalization under varying field imaging conditions, provide limited interpretability and little support for structured diagnostic decision-making. Even early multimodal frameworks, such as the PVAL [ 6 ] system, is optimized for satellite-level array localization rather than detailed module-level diagnostic reasoning. In energy applications where inspection outcomes inform maintenance actions, warranty claims, and operational risk management, such opacity poses a significant barrier to adoption. On the other hand, human inspectors do not diagnose PV defects through single-step classification. Instead, they follow structured diagnostic reasoning that links observable visual cues to plausible physical mechanisms before determining defect type and recommended action. This intermediate reasoning process is critical for resolving ambiguity, auditing decisions, and maintaining trust in inspection outcomes. We hypothesize that the gaps in current automated inspection systems stem from a mismatch between how models are trained and how photovoltaic defects are diagnosed in practice. Bridging this gap requires AI systems that ground multimodal learning in expert domain knowledge, treating diagnostic reasoning as an integral prerequisite for classification rather than a post-hoc explanation. To address these challenges, we introduce a Reasoning-Boosted Vision-Language for Photovoltaics (REVL-PV) framework (Fig. 1 ) that integrates four tightly coupled components. First, we apply class-balanced data curation together with physically motivated data augmentation to mitigate long-tailed defect distributions and imaging variability common in photovoltaic manufacturing and field inspection. Second, the system employs structured diagnostic prompting that explicitly separates intermediate reasoning from final defect classification. Third, model adaptation is performed in a staged manner, first establishing domain-consistent diagnostic logic and subsequently grounding this logic in visual evidence across heterogeneous imaging modalities, including EL, thermal, and RGB imagery, each of which encodes distinct physical information about module health. Finally, a reasoning-stabilized inference strategy using test-time augmentation (TTA). The resulting diagnostic outputs extend beyond defect labels to include visual evidence description, inferred root cause, and recommended inspection actions, aligning automated predictions with professional photovoltaic inspection workflows. A central design objective of this work is practical deployability within energy infrastructure. Rather than relying on large, general-purpose foundation models, we demonstrate that compact vision-language models (VLM) equipped with domain-specific reasoning can achieve high diagnostic accuracy while remaining compatible with the memory and reliability constraints of industrial inspection systems. This balance is essential for real-world photovoltaic inspection, where decisions must be made consistently and with clear justification. By integrating reasoning directly into learning rather than adding it post hoc, REVL-PV improves defect classification, particularly for rare and ambiguous categories. Evaluated on 1,927 real-world photovoltaic modules, the framework achieves 93% accuracy while generating transparent diagnostic rationales. These results show that compact, domain-adapted vision-language models can provide a practical alternative to larger general-purpose systems for photovoltaic inspection, supporting both autonomous screening and human-in-the-loop workflows. A blind comparison against a certified solar panel expert further shows that the model’s reasoning and final diagnoses align closely with professional standards, highlighting the broader potential of reasoning-aware compact VLMs for industrial diagnostics. Main Text A brief overview of REVL-PV. We present REVL-PV, a domain-aware, reasoning-based vision-language framework for photovoltaic defect diagnosis (Fig. 1 ). Rather than treating defect classification as direct pattern recognition, REVL-PV integrates photovoltaic-specific domain knowledge with structured diagnostic reasoning, mirroring the Evidence→Cause→Action logic employed by human inspectors. The framework introduces two key components: (1) Reasoning-Boosted Supervised Fine-Tuning (RSFT), which explicitly conditions classification on intermediate diagnostic steps linking visual observations to fault mechanisms (Fig. 1 Stage 2) and (2) a Two-Phase Reasoning Enhancement strategy (2PRE), which first aligns reasoning structure through text-only training before grounding it to visual features via multimodal grounding (Fig. 1 Stage 3). Together, these components enable transparent, auditable defect diagnosis without sacrificing classification accuracy. At its core, the REVL-PV framework is built upon a multimodal vision-language architecture designed to capture the complex, multi-physics nature of photovoltaic failures. It synthesizes complementary physical information by integrating EL for