Rethinking Large Language Models for Irregular Time Series Classification in Critical Care

Feixiang Zheng, Yu Wu, Cecilia Mascolo, Ting Dang · 2026

Read Rethinking Large Language Models for Irregular Time Series Classification in Critical Care by Feixiang Zheng, Yu Wu, Cecilia Mascolo, Ting Dang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16516.txt.

Introduction

Feixiang Zheng and three coauthors rethink large models for odd timed ward data. Their 2026 preprint deals with data from the Intensive Care Unit. ICU data tracks key signs of each sick case in time. Gaps in that data are odd, with long and short spans mixed. Large models have shown pledge for time data in late work.

Odd gaps break the even steps such models oft expect. The team tests how well the models cope with true ICU gaps. Poor cope would call for new steps built for ward data. Good cope would open large models to ward tracks. The work keeps sick case use at its heart.

Catalog record

CREATORFeixiang Zheng, Yu Wu, Cecilia Mascolo, Ting Dang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-16516

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Rethinking Large Language Models for Irregular Time Series Classification in Critical Care Feixiang Zheng, Yu Wu, Cecilia Mascolo, Ting Dang Abstract Time series data from the Intensive Care Unit (ICU) provides critical information for patient monitoring. While recent advancements in applying Large Language Models (LLMs) to time series modeling (TSM) have shown great promise, their effectiveness on the irregular ICU data, characterized by particularly high rates of missing values, remains largely unexplored. This work investigates two key components underlying the success of LLMs for TSM: the time series encoder and the multimodal alignment strategy . To this end, we establish a systematic testbed to evaluate their impact across various state-of-the-art LLM-based methods on benchmark ICU datasets against strong supervised and self-supervised baselines. Results reveal that the encoder design is more critical than the alignment strategy. Encoders that explicitly model irregularity achieve substantial performance gains, yielding an average AUPRC increase of 12.8% over the vanilla Transformer. While less impactful, the alignment strategy is also noteworthy, with the best-performing semantically rich, fusion-based strategy achieving a modest 2.9% improvement over cross-attention. However, LLM-based methods require at least 10 × \times longer training than the best-performing irregular supervised models, while delivering only comparable performance. They also underperform in data-scarce few-shot learning settings. These findings highlight both the promise and current limitations of LLMs for irregular ICU time series. The code is available at https://github.com/mHealthUnimelb/LLMTS . † † address: ∗ The University of Melbourne, Australia † University of Cambridge, UK 1 Introduction The rich, multivariate time series data generated in the Intensive Care Unit (ICU), such as vital signs and lab tests [ 24 , 15 ] , holds immense potential for improving patient outcomes through machine learning. However, this potential is fundamentally challenged by the nature of ICU data: it is profoundly irregular, characterized by sporadic measurements, high missingness rates, and asynchronous sampling across sensors, which makes effective modeling a significant hurdle. Prior research has explored irregular-aware data augmentation and time-aware encoding [ 15 , 14 , 21 , 5 , 19 ] . While effective on specific datasets, these models often fail to generalize robustly across different hospitals or patient populations, which may use different monitoring devices with sensor-specific dynamics or exhibit unique irregular patterns. The recent emergence of Large Language Models (LLMs) offers a compelling alternative, distinguished by their powerful zero-shot and few-shot generalization capabilities [ 3 , 1 ] . Early studies have successfully applied LLMs to time series [ 9 , 13 ] , benefiting from their ability to create aligned embeddings of time series and unstructured text, thereby providing a richer source of information for modeling. However, this research has predominantly focused on clean, regularly-sampled time series, leaving a critical gap in our understanding of their performance on the complex irregularities intrinsic to ICU data. This motivates the central questions of our work: To what extent can current LLMs model the complex irregularities in ICU time series data, and do they offer practical advantages over existing irregular-specific lightweight models? This paper aims to bridge the gap by investigating LLMs for irregular time series, focusing on their effectiveness, limitations, and computational trade-offs relative to time series models without LLMs. We highlight two key components underlying LLM-based time series modeling: (1) the time series encoder , which transforms raw or preprocessed time series signals into high-level representations; and (2) the multimodal alignment strategy , which aligns temporal and textual representations suitable for LLM processing. Figure 1: LLM architectures for time series (TS) modeling. To systematically rethink the applicability and limitations of these key components in processing irregular time series, we propose the following research questions: RQ1. To what extent can LLMs developed for regular time series effectively generalize to irregular ICU healthcare data? RQ2. Which components of time series LLMs have the greatest impact on modeling irregular time series? RQ3. What are the trade-offs between the computational overhead introduced by LLMs and the performance gains they offer for irregular time series modeling, compared to traditional methods? RQ4. How effective are time series LLMs at few-shot learning for irregular time series? To address these questions, we conduct a comprehensive empirical study using four state-of-the-art (SOTA) LLM-based methods, specifically, Time-LLM [ 9 ] , S^{2} IP [ 13 ] , CALF [ 11 ] , and FSCA [ 8 ] , in comparison with traditional supervised and self-supervised baselines on ICU mortality prediction task using two benchmark irregular ICU datasets. To the best of our knowledge, this is the first systematic effort to assess the utility of LLMs for irregular time series classification in critical care. Our work offers actionable insights for designing more effective and computationally viable LLM-based time series models for clinical applications. 2 Related Work Figure 2: Workflow of LLMs. Irregular ICU time series is encoded and aligned with textual embeddings for classification. Traditional irregular time series modeling. Early approaches addressed irregularity through imputation or aggregation, but these strategies often discarded information and failed to capture fine-grained temporal dynamics [ 18 , 4 ] . Recent efforts have developed encoders that explicitly handle irregularity. Specifically, Latent ODEs [ 14 ] model continuous-time dynamics via ordinary differential equations, while attention-based models such as mTAND [ 15 ] uses multi-time attention and Warpformer [ 21 ] introduce time-warping layers and doubly self-attentive blocks. Despite their effectiveness, these methods remain fully supervised and are validated on limited datasets, restricting scalability and generalization. LLMs for time series modeling. LLMs have demonstrated strong generalization and reasoning capabilities across a wide range of NLP and multimodal tasks, motivating their application to time series. Early works leveraged prompt-based methods, treating numeric time series as text to process [ 20 ] , but these approaches neglected the modality gap between textual and numerical data, limiting their robustness [ 11 ] . Recent research addresses this gap by introducing explicit alignment techniques. Approaches such as Time-LLM reprograms time series into to LLM embedding spaces, while S^{2} IP [ 13 ] leverages semantic anchors for cross-modal alignment. CALF [ 11 ] extends this by enforcing feature-level and output-level consistency, and FSCA [ 8 ] introduces structural and logical alignment using graph neural networks. However, existing studies have concentrated primarily on regularly sampled datasets, overlooking irregular time series data that frequently arise in healthcare. Our work bridges this gap by investigating the effectiveness of time series encoder structures and alignment methods in handling irregular data. 3 Experimental Setup We design a comprehensive empirical testbed with four SOTA LLM-based methods to examine the role of time series encoders and multimodal alignment strategies in TSM, as shown in Figure 2 . In this framework, irregular time series are segmented into fixed-size patches and encoded into temporal embeddings. In parallel, auxiliary textual embeddings are obtained either by tokenizing and encoding clinical text or by leveraging pretrained word token embeddings. An alignment module then fuses temporal and textual representations, which are fed into the LLM backbone. Finally, the output is passed through a classification head to support downstream tasks. Baselines. We conduct a comprehensive empirical testbed using four SOTA LLM-based models ( Time-LLM [ 9 ] , S^{2} IP [ 13 ] , CALF [ 11 ] and FSCA [ 8 ] ), two SOTA

Read the complete text