Can Large Language Models Adequately Perform Symbolic Reasoning Over Time Series?

Zewen Liu, Juntong Ni, Xianfeng Tang, Max S.Y. Lau, Wenpeng Yin, Wei Jin · 2025

Read Can Large Language Models Adequately Perform Symbolic Reasoning Over Time Series? by Zewen Liu, Juntong Ni, Xianfeng Tang, Max S.Y. Lau, Wenpeng Yin, Wei Jin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03963.txt.

Introduction

Zewen Liu and co-authors test whether large language models can reason symbolically over time series in a 2025 paper. Finding hidden symbolic laws in data echoes Kepler's work on planetary motion and remains a core goal for science and AI. Their benchmark covers three tasks on real world series: fitting symbolic formulas, inferring Boolean networks, and discovering causal links. The tasks span varied symbolic forms and complexity.

The team also built a closed loop system pairing language models with genetic programming, where models both propose and judge structures. Results show clear strengths and limits in current models. Domain knowledge, context fit, and reasoning structure all mattered for success. Readers see a systematic check on machine scientific discovery.

Catalog record

CREATORZewen Liu, Juntong Ni, Xianfeng Tang, Max S.Y. Lau, Wenpeng Yin, Wei Jin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-03963

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Can Large Language Models Adequately Perform Symbolic Reasoning Over Time Series? Zewen Liu, Juntong Ni, Xianfeng Tang, Max S.Y. Lau, Wenpeng Yin, Wei Jin Abstract Uncovering hidden symbolic laws from time series data, as an aspiration dating back to Kepler’s discovery of planetary motion, remains a core challenge in scientific discovery and artificial intelligence. While Large Language Models show promise in structured reasoning tasks, their ability to infer interpretable, context-aligned symbolic structures from time series data is still underexplored. To systematically evaluate this capability, we introduce SymbolBench , a comprehensive benchmark designed to assess symbolic reasoning over real-world time series across three tasks: multivariate symbolic regression, Boolean network inference, and causal discovery . Unlike prior efforts limited to simple algebraic equations, SymbolBench spans a diverse set of symbolic forms with varying complexity. We further propose a unified framework that integrates LLMs with genetic programming to form a closed-loop symbolic reasoning system, where LLMs act both as predictors and evaluators. Our empirical results reveal key strengths and limitations of current models, highlighting the importance of combining domain knowledge, context alignment, and reasoning structure to improve LLMs in automated scientific discovery. 1 Introduction Centuries ago, Johannes Kepler revolutionized our understanding of the cosmos by discovering the laws of planetary motion Gentner 2002 . Through meticulous analysis and rigorous reasoning over astronomical observations, captured as time series data of planetary positions, Kepler derived precise mathematical relationships that explained the complex, time-dependent dynamics of celestial orbits. Automating such a challenging process, where hidden symbolic laws are extracted from time series , is a long-standing aspiration in artificial intelligence Reddy and Shojaee 2025 . However, achieving this automation presents fundamental reasoning-driven challenges, as time series data encapsulates dynamic behaviors and temporal dependencies that demand abstraction, generalization, and reasoning beyond mere pattern recognition to uncover underlying symbolic structures. Recent advances in Large Language Models (LLMs) and Multimodal LLMs (MLLMs) show strong performance in complex reasoning tasks Wang et al. 2024 , but their ability to extract symbolic laws from time series remains underexplored. Traditional methods in symbolic regression, such as genetic programming Makke and Chawla 2024 , often prioritize data fit at the expense of interpretability. Meanwhile, recent attempts Merler et al. 2024 ; Li et al. 2024 ; Shojaee et al. 2024 to use LLMs in this domain have been limited; they employ them merely as domain-agnostic function generators, overlooking the models’ core potential for deeper, theory-aligned reasoning. This shallow integration often results in proposed equations that lack contextual relevance. Additionally, most work focuses on algebraic expressions, neglecting other symbolic forms like logical formulas Zhang et al. 2024 and causal relations Assaad et al. 2022 . To address these gaps and provide further insights into the symbolic reasoning ability of LLMs for time series, a comprehensive benchmark is urgently required. Our work is guided by four key objectives: (a) Real-world relevance: To use real-world time series with ground-truth symbolic structures. (b) Task difficulty: To incorporate a diverse form of symbolic structures with varying complexity. (c) Scale and balance: To ensure a sufficiently large and balanced sample distribution across tasks. (d) Unified framework: To provide a unified framework to execute various tasks and establish connections with task-specific baselines. To realize these objectives, we present three primary contributions. (I) SymbolBench , a comprehensive benchmark designed to rigorously evaluate the symbolic reasoning capabilities of LLMs over time series with rich real-world contextual descriptions. It uniquely spans three core tasks covering major types of time series data: (a) Multivariate symbolic regression for continuous data to recover complex equations like coupled Ordinary Differential Equations (ODEs). (b) Boolean network inference Zhang et al. 2024 for discrete systems to identify logical rules. (c) Causal discovery Assaad et al. 2022 for multivariate data to uncover structured causal graphs. Each task includes challenging, real-world examples from domains such as biology, physics, and healthcare, with varying dimensionality and difficulty. To ensure both quality and coverage, we curate representative subsets from large databases, yielding a benchmark that is broader, more challenging, and more balanced than prior efforts. (II) Unified Symbolic Reasoning Framework that enables the context-aware and knowledge-rich LLMs to play the dual role of predictors and judges in the process of hypothesis generation, testing, and refinement, while optionally including efficient genetic programming tools in a hybrid way. (III) Critical empirical insights into the current strengths and limitations of LLMs and MLLMs in temporal symbolic reasoning. (a) LLMs surpass traditional baselines on multivariate symbolic regression and causal discovery, but fall short on Boolean network inference; (b) LLMs are able to perform a certain level of reasoning on the three tasks, with properly increasing test-time compute bringing moderate improvement. (c) Introducing context not only improves performance but also potentially guides the selection of generalizable symbolic structures. (d) Combining LLMs in complementary roles with genetic programming further boosts performance. 2 Related Work Symbolic Expression Discovery. Symbolic regression (SR) aims to recover interpretable equations from time series data. Classical methods like Genetic Programming and sparse optimization (e.g., SINDy Brunton et al. 2016 , PySR Cranmer 2024 ) prioritize accuracy and parsimony but face scalability challenges. Recent deep learning models (e.g., ODEformer d’Ascoli et al. 2023 , TPSR Shojaee et al. 2023 ) improve efficiency by treating SR as a translation task, though they require pretraining and lack iterative refinement. Related fields like Boolean network inference and causal discovery also seek symbolic structures from time series. More details are in Appendix A . LLM Symbolic Reasoning. Due to the strong in-context learning and reasoning ability of LLMs that allow them to adapt to various tasks, they are able to perform logical inference Ahn et al. 2024 ; Wang and Chen 2023 , and temporal symbolic reasoning Fang et al. 2024 . Despite the strong ability of LLMs, current research for SR tasks only applies them as function generators without a reasoning process. Though the generated functions may achieve a high fitting score, the reasoning process remains unknown to us and may fail to align with the context, with little real-world meaning. In addition, the current research focus has also skewed toward algebraic equations, with logical rules or causal relations remaining underexplored. 3 SymbolBench Dataset To rigorously evaluate the reasoning abilities of LLMs on time series related science discovery, we introduce SymbolBench , a curated benchmark that aims to uncover symbolic structures from time series. The dataset spans diverse domains (e.g., physics, biology) and is structured around three core categories of symbolic structures. More details of the dataset are provided in Appendix B . Coupled Differential Equations (CDEs). CDEs represent dynamic systems, yielding continuous and multivariate time series data. Let x_{i} denote the i -th variable of a multivariate time series, a coupled differential equation can be described as the following: \frac{dx_{i}}{dt}=f_{i}(x_{1},x_{2},...,x_{n}),i=1,...,n , where the symbolic structures f_{i} describe dynamic interactions among state variables. The corresponding time series data consists of numerical solutions \{x_{i}(t)\} over time, generated from initial conditions and system parameters. This setting reflects real-world dynamical systems in physics and engineering, where the complexity arises from variable interdependence. While the previous benchmark dataset, ODEbench d’Ascoli et al. 2023 , contains coupled ODEs from 1 dimension to 4 dimensions, the number of samples is small, and the class of dimensions

Read the complete text