Is your LLM trapped in a Mental Set? Investigative study on how mental sets affect the reasoning capabilities of LLMs
Saiful Haq, Niyati Chhaya, Piyush Pandey, Pushpak Bhattacharya, IIT Bombay, Hyperbots Inc [email protected] · 2025
Read Is your LLM trapped in a Mental Set? Investigative study on how mental sets affect the reasoning capabilities of LLMs by Saiful Haq, Niyati Chhaya, Piyush Pandey, Pushpak Bhattacharya, IIT Bombay, Hyperbots Inc [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-11833.txt.
Introduction
Human solvers get stuck in a rut, reaching for a method that worked before even when it no longer fits. Saiful Haq and co-authors asked whether large language models fall into the same trap. They call the trap a mental set, a term from cognitive psychology. The team compared three models, two open Llama versions and GPT-4o, on reasoning tasks seeded with such traps. Standard scores alone would miss this weakness.
The study is presented as the first to test this psychology concept in language models. It argues that adaptability belongs in model testing beside accuracy scores. A model that cannot drop a stale strategy will fail on fresh problems in the real world. The framing offers a new lens for judging reasoning tools.
Catalog record
| CREATOR | Saiful Haq, Niyati Chhaya, Piyush Pandey, Pushpak Bhattacharya, IIT Bombay, Hyperbots Inc [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 14 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-11833
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Is your LLM trapped in a Mental Set? Investigative study on how mental sets affect the reasoning capabilities of LLMs Saiful Haq, Niyati Chhaya, Piyush Pandey, Pushpak Bhattacharya, IIT Bombay, Hyperbots Inc [email protected] Abstract In this paper, we present an investigative study on how Mental Sets influence the reasoning capabilities of LLMs. LLMs have excelled in diverse natural language processing (NLP) tasks, driven by advancements in parameter-efficient fine-tuning (PEFT) and emergent capabilities like in-context learning (ICL). For complex reasoning tasks, selecting the right model for PEFT or ICL is critical, often relying on scores on benchmarks such as MMLU, MATH, and GSM8K. However, current evaluation methods, based on metrics like F1 Score or reasoning chain assessments by larger models, overlook a key dimension: adaptability to unfamiliar situations and overcoming entrenched thinking patterns. In cognitive psychology, Mental Set refers to the tendency to persist with previously successful strategies, even when they become inefficient - a challenge for problem solving and reasoning. We compare the performance of LLM models like Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct and GPT-4o in the presence of mental sets. To the best of our knowledge, this is the first study to integrate cognitive psychology concepts into the evaluation of LLMs for complex reasoning tasks, providing deeper insights into their adaptability and problem-solving efficacy. 1 Introduction Recent advancements in transformer architectures Vaswani 2017 have profoundly reshaped NLP and vision-language tasks. Models such as LLaMA-3 Dubey et al. 2024 , Phi-4 Abdin et al. 2024 , Mixtral Jiang et al. 2024 , Deepseek-v3 Liu et al. 2024 , InternVL-2.5 Chen et al. 2024 , and Pixtral Agrawal et al. 2024 have set new benchmarks in reasoning and generalization capabilities. These open-source large language models (LLMs) and vision-language models (VLMs) have demonstrated remarkable performance on challenging benchmarks like MMLU Hendrycks et al. 2020 , GSM8K Cobbe et al. 2021 , and MATH Hendrycks et al. 2021 , solidifying their role in solving reasoning-intensive tasks. One of the most significant developments driving these advancements is in-context learning (ICL) Dong et al. 2022 . Unlike traditional training paradigms that require fine-tuning on task-specific data, ICL enables models to adapt to new tasks through examples embedded directly in the input prompts. This paradigm not only enhances task adaptability but also reduces computational overhead. The flexibility and scalability of ICL have propelled its adoption in solving problems across diverse domains, from mathematical reasoning to commonsense understanding. Despite their success, traditional evaluation metrics such as accuracy, F1 score, and reasoning chain assessments primarily capture task performance in well-defined or familiar scenarios. These benchmarks, however, fail to account for an essential aspect of reasoning: adaptability in the face of novelty and the ability to overcome entrenched problem-solving patterns. This dimension aligns with the concept of a Mental Set Öllinger et al. 2008 in cognitive psychology—a phenomenon where reliance on previously successful strategies inhibits the adoption of more efficient solutions in novel situations. Mental set, often described as cognitive rigidity, emerges when repeated success with specific approaches reinforces their use, even in cases where such approaches are suboptimal or ineffective. While this tendency streamlines problem-solving in routine contexts, it presents a critical bottleneck when models encounter unfamiliar challenges that demand innovative solutions. In contrast to mental set, Insight represents the ability to overcome these entrenched patterns through a reorganization of mental representations, enabling novel solutions to emerge. Insightful problem-solving is characterized by sudden breakthroughs, often accompanied by the well-documented "aha!" moment. This process is inherently different from systematic problem-solving as it involves either decomposing familiar cognitive chunks or relaxing implicit constraints that limit how a problem is conceptualized. For instance, Duncker’s candle problem Duncker and Lees 1945 and Luchins’ water jug experiments Luchins and Luchins 1959 demonstrate how initial problem representations can either obstruct or facilitate insight, depending on whether solvers can reframe their approach. The interplay between mental set and insight is particularly relevant when assessing reasoning capabilities, as models that exhibit high adaptability must strike a balance between leveraging prior knowledge and restructuring it when necessary. Understanding how these cognitive phenomena interact provides deeper insight into the flexibility and robustness of AI systems when faced with complex, unfamiliar tasks. Our contribution is: • An investigative study on how Mental Sets influence the reasoning capabilities of LLMs (Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct and GPT-4o). To the best of our knowledge, this is the first study to integrate cognitive psychology concepts into the evaluation of LLMs for complex reasoning tasks, providing deeper insights into their adaptability and problem-solving efficacy. 2 Related work Mental set Öllinger et al. 2008 occurs when individuals continue to use a familiar strategy, even when it is no longer the most efficient approach. This is evident in problem-solving contexts like the Water-Jug problem Luchins and Luchins 1959 , where participants persist in applying a complex method despite the availability of a simpler solution. Such entrenched thinking patterns can limit problem-solving effectiveness. For example, students might repeatedly use the "add-subtract" method in solving problems like 5 + 2 + 3 = ? + 3, even when the "grouping" method would be faster and less cognitively demanding. This rigidity in thinking is a clear example of mental set interfering with problem-solving flexibility. On the other hand, procedural flexibility DeCaro 2016 refers to the ability to shift between various strategies or methods when solving problems, particularly in mathematics, where students often learn multiple approaches to tackle different types of problems. This flexibility enables them to select the most efficient method depending on the problem’s context. Research has shown that procedural flexibility is linked to a deeper conceptual understanding. For instance, when students are exposed to different problem-solving strategies, they become better equipped to adapt their approach to novel or unfamiliar challenges. Educational psychology studies suggest that students with greater procedural flexibility tend to experience reduced cognitive load and improved accuracy in their problem-solving. For example, in mathematics, students may be taught multiple strategies, such as the "add-subtract" method and the "grouping" method. The latter, which simplifies cognitive demands, may be more efficient in some cases. Flexible students are more likely to switch between methods depending on the problem, enhancing their understanding of key concepts like mathematical equivalence. While procedural flexibility is a valuable skill, mental set can hinder its development. 3 Dataset The dataset used in this study is based on the problems outlined in DeCaro 2016 , as summarized in Table 3 . It consists of two types of mathematical equivalence problems: complex problems and shortcut problems. Each type includes six problems. • Complex problems require multi-step strategies to solve. These problems involve various addition operations where multiple numbers must be added before solving for the missing value. • Shortcut problems are designed for quicker resolution by leveraging repeated addends on both sides of the equation, enabling simpler and more efficient solutions. The numbers used in both problem sets are consistent to ensure that any differences in problem-solving difficulty arise solely from the required strategy, rather than the numerical values themselves. The dataset is structured to evaluate how the order of problem presentation influences participants’ (or LLMs’) use of efficient problem-solving strategies. 4 Experiment Setup Model Metric SP SP+CPF CP CP+SPF Llama-3.1-8b-instruct EM 0.16 0 0 0 Steps 1 x x x