YOLOv10 with Kolmogorov-Arnold networks and vision-language foundation models for interpretable object detection and trustworthy multimodal AI in computer vision perception
Marios Impraimakis, Daniel Vazquez, Feiyu Zhou · 2026
Read YOLOv10 with Kolmogorov-Arnold networks and vision-language foundation models for interpretable object detection and trustworthy multimodal AI in computer vision perception by Marios Impraimakis, Daniel Vazquez, Feiyu Zhou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23037.txt.
Introduction
Impraimakis, Vazquez, and Zhou build an interpretable layer over YOLOv10 object detection. Detectors give confidence scores that users cannot easily judge. A Kolmogorov-Arnold network acts as a post-hoc surrogate for trust. It models detection trust from seven geometric and semantic features. Its additive spline form shows each feature's effect directly. A BLIP model adds scene captions for a light multimodal interface. Tests on COCO and campus images flag low-trust predictions under blur or occlusion. The system supports review and risk choices downstream.
Catalog record
| CREATOR | Marios Impraimakis, Daniel Vazquez, Feiyu Zhou |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36918 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.23037
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
YOLOv10 with Kolmogorov-Arnold networks and vision-language foundation models for interpretable object detection and trustworthy multimodal AI in computer vision perception Marios Impraimakis, Daniel Vazquez, Feiyu Zhou Abstract The interpretable object detection capabilities of a novel Kolmogorov-Arnold network framework are examined here. The approach refers to a key limitation in computer vision for autonomous vehicles perception, and beyond. These systems offer limited transparency regarding the reliability of their confidence scores in visually degraded or ambiguous scenes. To address this limitation, a Kolmogorov-Arnold network is employed as an interpretable post-hoc surrogate to model the trustworthiness of the You Only Look Once (Yolov10) detections using seven geometric and semantic features. The additive spline-based structure of the Kolmogorov-Arnold network enables direct visualisation of each feature’s influence. This produces smooth and transparent functional mappings that reveal when the model’s confidence is well supported and when it is unreliable. Experiments on both Common Objects in Context (COCO), and images from the University of Bath campus demonstrate that the framework accurately identifies low-trust predictions under blur, occlusion, or low texture. This provides actionable insights for filtering, review, or downstream risk mitigation. Furthermore, a bootstrapped language-image (BLIP) foundation model generates descriptive captions of each scene. This tool enables a lightweight multimodal interface without affecting the interpretability layer. The resulting system delivers interpretable object detection with trustworthy confidence estimates. It offers a powerful tool for transparent and practical perception component for autonomous and multimodal artificial intelligence applications. Keywords: Autonomous vehicles, Interpretable object detection, Kolmogorov-Arnold Network (KAN), You Only Look Once (YOLOv10), Trustworthy Explainable AI (XAI) 1 Introduction Object detection systems have attracted interest through the development of the one-stage You Only Look Once models. These detectors achieve real-time performance, making them attractive for deployment in visual perception tasks in autonomous vehicles [ 31 , 89 , 70 , 67 ] , traffic [ 87 ] , and pedestrian detection [ 48 , 40 ] . To this end, Wang et al. [ 72 ] proposed to train the You Only Look Once models without a filtering step for faster and more accurate behavior. Dong et al. [ 19 ] developed a method that uses wavelet-based processing, improved feature pooling, and a combined loss design. Luz et al. [ 14 ] showed that combining Internet of Things devices, edge computing, and deep learning enables vehicle detection across hardware with widely varying processing speeds. Wang et al. [ 73 ] improved the detection of tiny objects by mixing information from different scales and surrounding context [ 32 ] . Haoyan et al. [ 23 ] proposed a lightweight model for steel‑surface defect detection by replacing standard layers with an adaptive downsampling structure [ 3 , 7 ] . Chhimpa et al. [ 11 ] , later, demonstrate that fine-tuning an object detection model can effectively identify brain tumors in medical images. An et al. [ 4 ] introduced also a small-target model which improves crack detection using a new head structure, a detail-enhancing pyramid, and a loss function. Zhang et al. [ 88 ] proposed an improved network specifically for aerial vehicle detection, Ding et al. [ 18 ] developed a model that uses attention and multi-scale processing to detect small objects from drone imagery, while Chen et al. [ 10 ] added an edge-focused feature module, improved multi-scale processing, and pruning and distillation steps. Sun et al. [ 65 ] also combined a transformer-based backbone with an attention-driven feature-fusion method to capture tiny details. Srinivasu et al. [ 63 ] studied how adjusting model settings and expanding the training data affects the detection performance. Mahapadi et al. [ 43 ] later optimized two nature-inspired search algorithms. Along these lines, Qin et al. [ 51 ] proposed a classroom-behavior detection system which improves recognition under crowded and multi-scale conditions. Furthermore, Xie et al. [ 80 ] described a model for autonomous-driving detection [ 76 , 37 , 20 , 75 , 35 , 46 , 30 ] that uses a new gating module, an improved feature pyramid, a redesigned multi-scale network, and a double-distillation training strategy. Liu et al. [ 39 ] introduced an enhanced model designed to locate defects in aircraft-engine components. Finally, Meng et al. [ 44 ] combine ideas from pose-estimation models for agricultural automation. Toward Kolmogorov-Arnold networks proposed by Liu et al. [ 41 ] , Shuai et al. [ 59 ] introduced later a physics-informed framework that embeds scientific laws into the learning process [ 1 , 33 , 69 , 68 ] . Wu et al. [ 79 ] presented Graph Kolmogorov-Arnold networks [ 36 ] , while Howard et al. [ 25 ] developed multifidelity Kolmogorov-Arnold networks that use inexpensive low-quality data. Hasan et al. [ 24 ] combined sequence-learning networks to analyze brain-signal time series, while Baravsin et al. [ 6 ] conducted a study across over one hundred time-series datasets for real-world signals. Furthermore, Wang et al. [ 74 ] proposed convolutional Kolmogorov-Arnold networks, which aim to create smaller and more interpretable intrusion-detection models. Saravani et al. [ 57 ] compared Kolmogorov–Arnold networks with machine-learning approaches, Ansar et al. [ 5 ] modified the loss functions of Kolmogorov-Arnold networks incorporating a correlation measure to improve performance, while Ta et al. [ 66 ] introduced fully-composed Kolmogorov-Arnold networks that mix mathematical basis functions to learn complex relationships from low-dimensional inputs. Finally, Panahi et al. [ 49 ] proposed a general discovery framework using Kolmogorov-Arnold networks that can uncover governing equations from data. To the vision-language modeling end, Xue et al. [ 83 ] introduced a curated dataset, training procedures, and a family of large models that handle both images and text [ 8 ] . Yang et al. [ 84 ] presented VisionZip, a method that keeps only the most useful visual tokens, Xu et al. [ 82 ] proposed a model with chain-of-thought that performs its own multi-stage reasoning steps, while Vasu et al. [ 71 ] introduced a new vision encoder that produces fewer visual tokens to greatly speed up processing. To this end, Deng et al. [ 17 ] studied how vision-language models balance visual and textual information when they are given images and different kinds of text inputs, Zhou et al. [ 90 ] introduced the first benchmark fot both space and time in videos, while Shu et al. [ 58 ] proposed video-extra-large which summarizes the content of each time segment. Deitke et al. [ 16 ] presented some newly created datasets, Zhan et al. [ 86 ] also curated a large remote-sensing instruction dataset [ 38 ] , and Hu et al. [ 26 ] created a high-quality remote-sensing image-captioning dataset for aerial images. Furthermore, Wu et al. [ 78 ] explored segmenting farmland applications, Dai et al. [ 15 ] investigated the interactions between people and their environments, and Xin et al. [ 81 ] examined a decomposed three-dimensional encoder, an improved image-text alignment method, and a dual-stream projector for medical images with text descriptions. Related to interpretable artificial intelligence in engineering [ 42 , 29 , 28 , 47 , 34 ] , Singh et al. [ 60 ] introduced DiaXplain, a diabetes-diagnosis tool to deliver understandable results, Roy et al. [ 55 ] developed