Swarm Intelligence Enhanced Reasoning: A Density-Driven Framework for LLM-Based Multi-Agent Optimization
Ying Zhu, Heng Zhou, Rui Su, Peiqin Zhuang, Lei Bai · 2025
Read Swarm Intelligence Enhanced Reasoning: A Density-Driven Framework for LLM-Based Multi-Agent Optimization by Ying Zhu, Heng Zhou, Rui Su, Peiqin Zhuang, Lei Bai (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17115.txt.
Introduction
Large language models solve hard problems better when many agents search together, like a swarm. Ying Zhu, Heng Zhou, Rui Su, Peiqin Zhuang, and Lei Bai build that idea into a framework in 2025. They treat reasoning as a search for the best answer in a wide space. Swarms can get stuck at good-but-not-best answers, so the framework adds a push for variety.
A density-based plan scores both answer quality and spread at once. Sorting keeps answers that are strong and unlike each other, which widens the search paths. A step-level check also flags weak steps so agents can fix them mid-run. The authors say the mix lifts performance on complex tasks. The design borrows from swarm methods long used in classic optimization.
Catalog record
| CREATOR | Ying Zhu, Heng Zhou, Rui Su, Peiqin Zhuang, Lei Bai |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-17115
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Swarm Intelligence Enhanced Reasoning: A Density-Driven Framework for LLM-Based Multi-Agent Optimization Ying Zhu, Heng Zhou, Rui Su, Peiqin Zhuang, Lei Bai Abstract Recently, many approaches, such as Chain-of-Thought (CoT) prompting and Multi-Agent Debate (MAD), have been proposed to further enrich Large Language Models’ (LLMs) complex problem-solving capacities in reasoning scenarios. However, these methods may fail to solve complex problems due to the lack of ability to find optimal solutions. Swarm Intelligence has been serving as a powerful tool for finding optima in the field of traditional optimization problems. To this end, we propose integrating swarm intelligence into the reasoning process by introducing a novel Agent-based Swarm Intelligence (ASI) paradigm. In this paradigm, we formulate LLM reasoning as an optimization problem and use a swarm intelligence scheme to guide a group of LLM-based agents in collaboratively searching for optimal solutions. To avoid swarm intelligence getting trapped in local optima, we further develop a Swarm Intelligence Enhancing Reasoning (SIER) framework, which develops a density-driven strategy to enhance the reasoning ability. To be specific, we propose to perform kernel density estimation and non-dominated sorting to optimize both solution quality and diversity simultaneously. In this case, SIER efficiently enhances solution space exploration through expanding the diversity of the reasoning path. Besides, a step-level quality evaluation is used to help agents improve solution quality by correcting low-quality intermediate steps. Then, we use quality thresholds to dynamically control the termination of exploration and the selection of candidate steps, enabling a more flexible and efficient reasoning process. Extensive experiments are conducted on widely-used seven mathematical reasoning benchmarks, i.e., MATH-500, MMLU-STEM, etc. As expected, our method consistently outperforms both CoT methods and existing reward-guided approaches, particularly on complex problems. This demonstrates the effectiveness of our approach in leveraging swarm intelligence for enhanced reasoning. 1 Introduction Large Language Models (LLMs) have demonstrated remarkable progress across various domains, yet significant challenges remain in complex reasoning tasks. Generally, many approaches propose to address the remaining challenges by employing Chain-of-Thought (CoT) prompting [ 39 , 20 ] or its variants [ 37 , 43 , 48 , 47 , 35 ] , guiding models to decompose complex problems into manageable steps, and reasoning the final answer step by step. However, Large language models are typically prone to making hallucinations during the CoT reasoning process due to inherent randomness and limitations in comprehension, which may lead to incorrect results. Alternatively, researchers propose to use Multi-Agent Debate (MAD) frameworks to perform interactions among multiple agents, collaboratively deriving better answers [ 10 , 22 , 4 , 36 ] . Generally, a variety of agents are defined and assigned distinct, pre-defined roles. They then follow a designated communication protocol or scheme to collaboratively generate better answers. Note that the success of MAD is presumably based on the hypothesis that LLMs can take on heterogeneous roles with various human-crafted prompts. Different from CoT methods, the heterogeneous prompts can help agents think divergently together, expanding the extent of exploration of the solution space and ultimately converging on a better solution. However, this hypothesis is not always valid and frequently fails, making MAD ineffective in deriving better answers. Instead, MAD methods even perform worse than basic CoT methods. As mentioned in [ 45 ] , the factor may be attributed to the fact that various agents are inherently homogeneous. Despite the different roles of the agents, they still rely on the same large language model. Solutions generated by different agents hold high similarities. Moreover, during the collaboration process, influenced by the context constructed from historical interaction information, the similarity between the solutions generated by the agents gradually increases, which is significantly lower than the diversity of using multiple CoTs with the same computational resource consumption (the details are shown in Appendix B in our supplementary materials), thus making it difficult to find the optimal result. This leads us to a simple but crucial question: how can we generate more diverse solutions to increase the chances of finding the correct answer? Swarm intelligence algorithms are a kind of traditional heuristic optimization method [ 2 , 19 , 9 ] that mimic the collective behaviors observed in nature. Generally, they begin by forming an initial population of candidate solutions through repeated sampling in the solution space, and then gradually improve the population quality using feedback from fitness value indicators. With limited computational resources, they show significant effectiveness compared to direct random sampling. Inspired by this, we conceptualize LLM reasoning as solution space exploration, treating the reasoning process as an optimization problem where a population of LLM-based agents collectively searches the solution space for optimal solutions. However, directly applying swarm intelligence algorithms may result in suboptimal solutions. Due to the complexity of LLM reasoning and the high diversity of possible solutions, the solution space contains multiple global optima with correct reasoning pathways alongside local optima with incorrect reasoning pathways. Traditional swarm intelligence algorithms tend to cause population concentration within the same region of the solution space, resulting in convergence to the same optima and diminishing the ability to thoroughly explore the space as population diversity decreases. Consequently, once trapped in an incorrect local optimum, the population loses its capability to discover global optimal solutions. Despite existing research [ 40 , 1 , 50 ] focused on maintaining population diversity, it remains crucial to be aware of the risk of local optima entrapment when applying swarm intelligence algorithms to LLM reasoning tasks. In this paper, we propose a novel paradigm called Agent-based Swarm Intelligence (ASI), which conceptualizes LLM reasoning as a solution search process in the solution space for global optima. ASI consists of a generator G generating solutions and an evaluator E evaluating the step-level quality of solutions. Based upon ASI, we address the aforementioned local optima issue by introducing the density-assisted search mechanism and developing the Swarm Intelligence Enhancing Reasoning (SIER) framework. This mechanism employs kernel density estimation techniques and non-dominated sorting to implement step-level Pareto front selection that jointly optimizes steps’ quality and density, enabling exploring solution space efficiently while preserving diversity. Through this innovative mechanism, SIER efficiently enhances solution space exploration by expanding the diversity of the search paths while mitigating convergence to local optima. Furthermore, a step-level quality evaluation is used to enable agents to enhance solution quality by rectifying intermediate steps of low quality. Then, we use the termination of exploration and the sampling of candidate steps can be dynamically controlled through quality thresholds, facilitating a more flexible and efficient reasoning process. We conduct extensive experiments on seven widely used mathematical reasoning benchmarks, including AIME-2024, AIME-2025, MATH-500, and other challenging datasets. Across various evaluation metrics, SIER consistently outperforms state-of-the-art methods, demonstrating the effectiveness of our approach in enhancing reasoning capabilities. 2 Related Work 2.1 Multi-Agent Systems Recently, LLM-based Multi-Agent Systems [ 11 , 33 , 13 ] have rapidly emerged as powerful frameworks for solving complex problems. Early developments like Camel [ 21 ] and MetaGPT [ 17 ] provided infrastructure for agent collaboration. Later on, the Multi-Agent Debate (MAD) strategy [ 41 , 5 , 49 ] has been widely adopted to facilitate collaborative interactions among agents through discussion. Several representative approaches include: Society of Mind (SoM) [ 10 ] establishes a three-step framework for