Adapting Large Language Models for Time Series Modeling via a Novel Parameter-efficient Adaptation Method

Juyuan Zhang, Wei Zhu, Jiechao Gao · 2025

Read Adapting Large Language Models for Time Series Modeling via a Novel Parameter-efficient Adaptation Method by Juyuan Zhang, Wei Zhu, Jiechao Gao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13725.txt.

Description

Juyuan Zhang and co-authors present Time-LLaMA in 2025, a way to turn large language models toward time series forecasting. Data in fields like energy and transport arrive as long numeric streams, where labeled examples are sparse. Language models show strong pattern skill over token sequences, but aligning numbers with text and keeping the model fast are both unsolved balances.

Their framework first turns a series into token embeddings with a simple linear step, then lines those tokens up with text prompts. A dynamic form of low rank adaptation picks, for each input and each layer, the best small tuning modules to steer the big model. Tests across many hard real world series tasks gave top results in their report. The design aims to borrow language model strength without retraining the whole giant for each new stream.

Catalog record

CREATORJuyuan Zhang, Wei Zhu, Jiechao Gao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-13725

Browse the full library · About the Tower of Babel