Tiny but Trusted: Efficient Vision-Language Reasoning for Time-Series Anomaly Detection
Xiaona Zhou 1 , Muntasir Wahed 1 , Tianjiao Yu 1 , Constantin Brif 2 , Ismini Lourentzou 1 {xiaonaz2,mwahed2,ty41,lourent2}@illinois.edu , [email protected] · 2026
Read Tiny but Trusted: Efficient Vision-Language Reasoning for Time-Series Anomaly Detection by Xiaona Zhou 1 , Muntasir Wahed 1 , Tianjiao Yu 1 , Constantin Brif 2 , Ismini Lourentzou 1 {xiaonaz2,mwahed2,ty41,lourent2}@illinois.edu , [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30344.txt.
Introduction
Xiaona Zhou and four co-authors construct VisAnomBench, a benchmark from time-series sets with notes from large VLMs using chosen rewards. Public anomaly benchmarks provide interval labels but not reasons, making VLM fine-tuning for grounded, clear calls hard. Fine-tuning on this benchmark yields VisAnomReasoner, a compact VLM for finding anomalies. On VisAnomBench, VisAnomReasoner spots anomalies better and beats all rivals, raising scores by at least 21 and 23 points. On another benchmark, it transfers strongly, raising scores by about 10 and 13 points.
Catalog record
| CREATOR | Xiaona Zhou 1 , Muntasir Wahed 1 , Tianjiao Yu 1 , Constantin Brif 2 , Ismini Lourentzou 1 {xiaonaz2,mwahed2,ty41,lourent2}@illinois.edu , [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60032 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30344
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Tiny but Trusted: Efficient Vision-Language Reasoning for Time-Series Anomaly Detection Xiaona Zhou 1 , Muntasir Wahed 1 , Tianjiao Yu 1 , Constantin Brif 2 , Ismini Lourentzou 1 {xiaonaz2,mwahed2,ty41,lourent2}@illinois.edu , [email protected] Abstract Recent advances in Vision–Language Models (VLMs) have achieved impressive performance across many tasks, yet prior studies report unsatisfactory performance when applying large language or multimodal models to finding abnormal patterns in sequential data. Public anomaly detection benchmarks typically provide interval annotations but not natural-language rationales, making it difficult to fine-tune VLMs to produce grounded, interpretable decisions. To address this gap, we construct VisAnom Bench , a curated benchmark built from public time-series datasets and augmented with high-quality anomaly explanations selected from multiple large VLMs using fine-grained, task-specific rewards. Through fine-tuning on this benchmark, we develop VisAnom Reasoner , a parameter-efficient VLM for time-series anomaly detection. Experimental results on VisAnomBench show that VisAnomReasoner achieves more accurate anomaly localization and consistently outperforms all baselines, with improvements of at least 21.23 and 23.87 percentage points in precision and F 1 , respectively. Additional experiments on the TSB-AD-U benchmark demonstrate strong cross-benchmark generalization, with VisAnomReasoner improving precision and F 1 by 9.57 and 13.39 percentage points, respectively. https://plan-lab.github.io/projects/VisAnom \setabstractlogo [9mm]assets/logos/plan-logo-full.pdf 1 Introduction Detecting abnormal patterns in time-series data is a critical problem in applications such as industrial process monitoring, healthcare diagnostics, and cyber–physical systems, where timely and interpretable decisions are essential [ 6 , 11 , 42 , 54 ] . Beyond identifying when anomalies occur, practitioners often require explanations that justify why a region is anomalous, e.g. , to diagnose failure modes and support downstream decision-making. However, existing time-series anomaly detection methods focus exclusively on numeric scores or binary labels [ 37 , 57 , 41 , 61 ] , offering limited interpretability and little insight into why a particular interval was flagged as anomalous. Recent advances in Vision–Language Models (VLMs) have demonstrated strong multimodal reasoning capabilities across tasks such as image captioning [ 26 , 46 ] , visual question answering [ 30 , 20 ] , chart understanding [ 16 , 56 ] , and visual instruction following [ 27 , 39 ] . These models can align visual evidence with natural language explanations and generate step-by-step reasoning in complex visual domains. Despite this progress, applying VLMs to time-series anomaly detection remains challenging. Time-series plots lack explicit object boundaries and spatial structure, requiring models to reason over temporal patterns, periodicity, and deviations rather than discrete visual entities. As a result, general-purpose VLMs applied out of the box often produce coarse, unstable anomaly predictions and ungrounded explanations when faced with time-series data [ 53 , 62 , 45 ] . A key obstacle to adapting VLMs for time-series anomaly reasoning is the lack of suitable supervision. Public time-series datasets typically provide only anomaly intervals or point-wise labels [ 37 , 57 , 41 , 61 ] , without accompanying explanations, which significantly limits the application of supervised fine-tuning. As a result, existing approaches either adopt task-specific detection pipelines without explicit reasoning supervision [ 14 ] , or attempt to elicit anomaly reasoning from pretrained models through prompting alone [ 38 , 31 , 62 ] , leading to limited anomaly localization accuracy in practice. Most existing approaches operate on textual or short time-series inputs and are limited by context window constraints, while only one method supports long time-series. This work addresses this gap by introducing VisAnom Bench , a benchmark for vision–language time-series anomaly reasoning. VisAnomBench is constructed from multiple public benchmarks spanning diverse domains and anomaly types, and augments them with temporally grounded natural-language explanations aligned with anomaly intervals. It enables supervised learning for both interval-level anomaly localization and explanation generation directly from time-series plots. We introduce VisAnom Reasoner , a parameter-efficient VLM fine-tuned on VisAnomBench for reasoning-based time-series anomaly detection. Experimental results show that explanation-augmented supervision enables VisAnomReasoner to achieve more accurate anomaly localization and improved temporal alignment compared to both large general-purpose VLMs and specialized large models across multiple evaluation metrics. The contributions are summarized as follows: (1) We formulate time-series anomaly detection as a plot-grounded vision-language reasoning task that jointly requires interval-level localization and structured explanation generation. This formulation moves beyond scalar anomaly scores by evaluating whether models can align visual evidence, temporal boundaries, and natural-language reasoning in a single prediction. (2) We introduce VisAnom Bench , the first explanation-augmented benchmark for vision-language time-series anomaly reasoning spanning diverse domains and anomaly types. Unlike existing benchmarks that provide only point-wise or interval labels, VisAnomBench pairs anomaly intervals with temporally grounded natural-language rationales, enabling models to learn not only where anomalies occur but also why they are visually and temporally abnormal. (3) We introduce VisAnom Reasoner , a compact vision-language anomaly reasoning model, and evaluate its performance against 15 baselines. Despite its small scale, VisAnomReasoner consistently outperforms general-purpose VLMs, specialized LLM/VLM anomaly detectors, time-series foundation models, and classical detectors, improving precision and F 1 by at least 21.23 and 23.87 percentage points on VisAnomBench and achieving strong cross-benchmark generalization on TSB-AD-U . Ablation studies show that reasoning supervision improves anomaly localization and explanation quality, with VisAnomReasoner explanations preferred over the base model in 69.6% of cases. 2 Related Work LLMs for Time-Series Reasoning and Modeling. Recent work has explored using large language models for time-series reasoning and question answering by encoding time series as text or symbolic representations. ChatTS [ 50 ] and AXIS [ 23 ] study conversational analysis and Q&A over time-series data, while Time-MQA [ 21 ] introduces a multi-task benchmark that includes anomaly-related questions. Time-RA [ 55 ] similarly encodes short time series as text and formulates anomaly detection as a true-or-false reasoning task, without supporting precise anomaly localization in time series. A parallel line of work adapts LLMs for time-series forecasting and classification by modeling sequences as text or tokens [ 33 , 45 , 58 , 59 , 44 , 13 ] . These approaches are constrained by context window limits and cannot scale to long time series with thousands of observations without preprocessing, which introduces additional challenges such as information loss and fragmented temporal context. Consequently, existing LLM-based time-series methods offer limited support for real-world anomaly detection settings that demand long-horizon analysis, accurate localization of anomaly intervals, and interpretable, visually grounded explanations for detected anomalies. VLMs and Multimodal Models for Anomaly Detection. An emerging direction addresses the limitations of text-based time-series input by operating directly on visual representations, where plots expose trends, periodicity, and deviations that naturally support anomaly detection via visual reasoning. Early work in this direction encodes short time-series windows with a vision encoder and relies on large VLMs, such as GPT-4o, to identify anomalous regions [ 14 ] . Complementary studies benchmark open-source and proprietary multimodal models on time-series anomaly detection tasks, showing that out-of-the-box performance remains inconsistent and often unstable [ 53 ] . Other approaches explore prompt-based strategies to guide anomaly detection, for example by injecting explicit time-index information [ 31 , 38 , 62 ] , but these methods are typically constrained to short sequences due to context window limitations. These works highlight the promise of visual reasoning for time-series anomaly detection, but existing benchmarks do not support models that jointly perform interval-level localization