Table as Thought: Exploring Structured Thoughts in LLM Reasoning

Zhenjie Sun, Naihao Deng, Haofei Yu, Jiaxuan You · 2025

Read Table as Thought: Exploring Structured Thoughts in LLM Reasoning by Zhenjie Sun, Naihao Deng, Haofei Yu, Jiaxuan You (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-02152.txt.

Introduction

Zhenjie Sun and co-authors propose giving language models a table as a scaffold for thought. Their 2025 paper builds on step-by-step prompting, which lays reasoning out in a line. That line shapes the order of steps but leaves the inside of each step loose.

In their frame, each row of the table is one thought step, and the columns hold the limits and context that step must respect. The model fills the table cell by cell, then checks its own work for gaps before it stops. Tests show the frame shines on planning tasks, where many limits must be held at once. It also shows promise on math problems against plain step-by-step baselines.

Catalog record

CREATORZhenjie Sun, Naihao Deng, Haofei Yu, Jiaxuan You
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE45 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-02152

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Table as Thought: Exploring Structured Thoughts in LLM Reasoning Zhenjie Sun, Naihao Deng, Haofei Yu, Jiaxuan You Abstract Large language models’ reasoning abilities benefit from methods that organize their thought processes, such as chain-of-thought prompting, which employs a sequential structure to guide the reasoning process step-by-step. However, existing approaches focus primarily on organizing the sequence of thoughts, leaving structure in individual thought steps underexplored. To address this gap, we propose Table as Thought, a framework inspired by cognitive neuroscience theories on human thought. Table as Thought organizes reasoning within a tabular schema, where rows represent sequential thought steps and columns capture critical constraints and contextual information to enhance reasoning. The reasoning process iteratively populates the table until self-verification ensures completeness and correctness. Our experiments show that Table as Thought excels in planning tasks and demonstrates a strong potential for enhancing LLM performance in mathematical reasoning compared to unstructured thought baselines. This work provides a novel exploration of refining thought representation within LLMs, paving the way for advancements in reasoning and AI cognition. 1 Introduction Recent advancements in reasoning have demonstrated that the reasoning capabilities of large language models (LLMs) can be enhanced by introducing structure into the reasoning process Wei et al. (2023) ; Yao et al. (2023) ; Besta et al. (2024) . For instance, the chain-of-thought approach organizes textual reasoning in a step-by-step manner using a linear chain structure Wei et al. (2023) . Building on this, following works have shown that incorporating more complex organizational structures further improves reasoning performance Besta et al. (2024) ; Yao et al. (2023) . However, these approaches structure reasoning only at the level of connections between distinct reasoning steps (inter-thought level) and leave the content of individual steps (thought level) unstructured. This raises the critical question: Can LLMs’ reasoning abilities be further enhanced by introducing structure within individual thoughts? To address this question, we draw inspiration from cognitive neuroscience theories of human thought. Neuroscientists have found that humans think in a structured way, with the brain’s organization facilitating sequential and goal-oriented reasoning. Christoff and Gabrieli (2000) provided early evidence that the prefrontal cortex supports structured reasoning through a rostrocaudal hierarchy, enabling the processing of increasingly abstract concepts and complex goal-directed behavior. Later, Friston (2005) ’s predictive coding framework demonstrated how structured cognition emerges from the brain’s ability to build hierarchical models, combining experiences with current input to predict results. More recently, Jeff Hawkins Hawkins (2021) argued that humans think in a structured manner, with the neocortex organizing knowledge in certain structures, and thinking arises from neurons activating sequential locations in these frames. Building on these insights, we propose investigating whether similarly structured representations can be incorporated into LLMs to enhance their reasoning and planning capabilities. In this work, we adopt a simple yet effective structural format—a tabular schema—to approximate the structured nature of human thinking processes. In our approach, the schema of a table serves as a framework for organizing and navigating knowledge. Inspired by the sequential processes described in neuroscience—where neurons activate specific patterns step by step Hawkins (2021) —we model these processes as the sequential population of rows in a table, moving across columns according to a predefined schema. A single table can encapsulate one or more such structured thought processes, providing a coherent container for organizing and connecting thinking steps and associated information. Tables not only represent step-by-step processes for achieving specific goals but also serve as robust frameworks for planning tasks. Moreover, utilizing tables as structured representations enables schema design that ensures organization and data integrity, thereby facilitating efficient verification and analysis. The contributions of our paper are as follows: • Motivated by insights from cognitive neuroscience regarding the structured nature of human thinking, we propose a novel framework, Table as Thought, that injects structure at the thought level. To the best of our knowledge, this is the first exploration and demonstration of integrating structured representations directly into the reasoning process of large language models. • We demonstrate the advantages of Table as Thought in tasks requiring planning and mathematical reasoning, highlighting its potential to enhance performance on tasks that demand sequential and goal-oriented thought processes. • We provide a detailed and comprehensive analysis of Table as Thought, offering insights into its functionality and strengths, and comparing the benefits of structured versus unstructured thought representations. We believe these findings can inspire future research into the nature and representation of thought processes in artificial intelligence and computational linguistics. 2 Related Work Structures in LLM Reasoning Recent advancements in large language models (LLMs) have increasingly focused on integrating structured processes to enhance reasoning capabilities. Chain-of-Thought prompting Wei et al. (2023) introduces a step-by-step framework that organizes thoughts in a sequential manner, enabling more coherent reasoning. Building on this, Tree of Thoughts Yao et al. (2023) and Graph of Thoughts Besta et al. (2024) employ hierarchical and networked structures to further enhance problem-solving, leveraging branching and interconnected paths. Moreover, self-consistency Wang et al. (2023) improves reliability by sampling multiple reasoning paths and selecting the most consistent outcome, thereby addressing variability in generated responses. While these methods excel at organizing reasoning at a macro level—such as through chaining, branching, or aggregating thought paths—they do not address the internal structure of individual thoughts. Our work is distinct in that it introduces structure directly at the thought level, refining the granularity of reasoning processes in LLMs. By focusing on the internal organization of individual reasoning steps, we provide a novel perspective on enhancing the depth and precision of structured reasoning in LLMs. Representations of Tables in LLM Inference Tables have traditionally played a significant role in LLMs for tasks involving the understanding and processing of tabular data, such as knowledge retrieval Cong et al. (2024) , question answering over structured data Yin et al. (2020) ; Zhang et al. (2024b) , and tabular reasoning Herzig et al. (2020) ; Deng et al. (2024) . In these tasks, tables are leveraged only as input for interpretation and manipulation. The Chain-of-Table framework Wang et al. (2024) extends the application of tables by employing them as proxies for intermediate thoughts in reasoning tasks involving tabular data. In this framework, LLMs iteratively update a table, forming a dynamic reasoning chain where the table evolves based on intermediate results. While this approach has proven effective on tabular-specific datasets, it remains inherently tied to tasks where tabular data is part of the input or reasoning context. In contrast, our work redefines the role of tables by utilizing them as a universal framework for structuring and representing the internal thought processes of LLMs in non-table-specific tasks, such as planning and mathematical reasoning. Unlike prior approaches that depend on pre-existing tabular inputs, we employ tables as dynamic containers to organize and manipulate thoughts step by step. This approach enables structured reasoning even in tasks where no tabular data is initially present, bridging the gap between unstructured text-based reasoning and structured problem-solving paradigms. By generalizing the utility of tables beyond table-specific reasoning tasks, our work marks a significant departure from previous methods and demonstrates the versatility of this novel framework. Figure 1: The Overall Pipeline for Table as Thought Reasoning. The figure illustrates how Table as Thought structures reasoning by iteratively populating

Read the complete text