Hybrid Concolic Testing with Large Language Models for Guided Path Exploration
Mahdi Eslamimehr - Quandary Peak Research · 2026
Read Hybrid Concolic Testing with Large Language Models for Guided Path Exploration by Mahdi Eslamimehr - Quandary Peak Research (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12274.txt.
Introduction
Mahdi Eslamimehr joins concolic testing with large language models to guide path search in big programs. Concolic testing runs code with both real and symbolic inputs. It is strong, but path counts explode and constraint solving is costly.
His frame uses a language model to pick which paths to try and to ease solving. That pairing aims to make the method work on large, real software. Better test coverage finds flaws before release. The work sets out the algorithm and its claims. LLM guides may cut the cost of search by a lot.
Catalog record
| CREATOR | Mahdi Eslamimehr - Quandary Peak Research |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-12274
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hybrid Concolic Testing with Large Language Models for Guided Path Exploration Mahdi Eslamimehr - Quandary Peak Research Abstract . Concolic testing, a powerful hybrid software testing technique, has historically been plagued by fundamental limitations such as path explosion and the high cost of constraint solving, which hinder its practical application in large-scale, real-world software systems. This paper introduces a novel algorithmic framework that synergistically integrates concolic execution with Large Language Models (LLMs) to overcome these challenges. Our hybrid approach leverages the semantic reasoning capabilities of LLMs to guide path exploration, prioritize interesting execution paths, and assist in constraint solving. We formally define the system architecture and algorithms that constitute this new paradigm. Through a series of experiments on both synthetic and real-world Fintech applications, we demonstrate that our approach significantly outperforms traditional concolic testing, random testing, and genetic algorithm-based methods in terms of branch coverage, path coverage, and time-to-coverage. The results indicate that by combining the strengths of both concolic execution and LLMs, our method achieves a more efficient and effective exploration of the program state space, leading to improved bug detection capabilities. Introduction The relentless growth in software complexity has made automated software testing an indispensable component of the software development lifecycle. Among the various testing methodologies, concolic testing has emerged as a promising hybrid technique that combines concrete and symbolic execution to systematically explore program paths and uncover bugs. By generating concrete inputs that exercise new paths, concolic testing aims to achieve high code coverage and find deep, subtle errors that random testing might miss. However, despite its theoretical appeal, the practical application of concolic testing has been severely hampered by two fundamental challenges: path explosion and the high cost of constraint solving. The exponential growth in the number of feasible execution paths in any non-trivial program quickly overwhelms the testing process, while complex path conditions can lead to computationally expensive or even intractable queries for the underlying SMT solvers. Existing approaches to mitigate these issues, such as search heuristics and path pruning, have had limited success. These techniques often lack a deep semantic understanding of the program’s logic, leading to suboptimal path selection and an inability to focus on semantically interesting or bug-prone regions of the code. This is where Large Language Models (LLMs) present a transformative opportunity. With their remarkable ability to comprehend natural language and source code, LLMs can provide the semantic guidance that has been missing from traditional concolic testing. This paper proposes a new hybrid testing framework that integrates concolic execution with LLM-driven test case generation. Our approach leverages the strengths of both techniques to create a more efficient and effective testing process. Specifically, we use LLMs to: • Guide path exploration: By analyzing the source code and existing path conditions, the LLM can prioritize paths that are more likely to lead to interesting program states or uncover new bugs. • Assist in constraint solving: When the SMT solver encounters a complex or intractable constraint, the LLM can suggest alternative inputs or mutations to the path condition that might simplify the problem. • Generate semantic test inputs: The LLM can generate high-level test scenarios and translate them into concrete inputs that target specific program functionalities. Our primary research contributions are as follows: • A novel algorithmic framework for integrating LLMs with concolic testing. • A set of LLM-guided heuristics for path prioritization and constraint simplification. • A comprehensive evaluation of the proposed approach on a range of synthetic and real-world benchmarks, demonstrating significant improvements in code coverage and bug detection compared to existing techniques. By combining the systematic exploration of concolic testing with the semantic reasoning of LLMs, we believe our approach represents a significant step forward in the field of automated software testing. Background and Motivation This section provides the necessary background on concolic testing and Large Language Models, and motivates the need for a hybrid approach. 2.1. Symbolic and Concolic Execution Symbolic execution is a powerful program analysis technique where a program is executed with symbolic instead of concrete values. For each path taken through the program, a path condition is constructed as a logical formula over the symbolic inputs. This formula represents the constraints that the inputs must satisfy to follow that specific path. An SMT (Satisfiability Modulo Theories) solver is then used to find a concrete solution to the path condition, which yields a test input that executes the path. While powerful, pure symbolic execution struggles with complex code, external library calls, and OS interactions, as it requires a complete symbolic model of the entire environment. Concolic testing (a portmanteau of “concrete” and “symbolic”) was developed to address these limitations. It executes the program with concrete inputs while simultaneously performing symbolic execution. The concrete execution helps to simplify the symbolic analysis by resolving environmental interactions and complex computations. When a new path is desired, the path condition of the current path is negated at a specific branch, and the SMT solver is invoked to generate a new input that will steer the program down the alternative path. Tools like DART, CUTE, Sherlock, AtomChase and Racagedon are seminal examples of concolic testing systems. 2.2. The Path Explosion Problem A fundamental challenge in both symbolic and concolic testing is path explosion. The number of possible execution paths in a program grows exponentially with the number of conditional branches. For a program with just a few dozen if statements, the number of paths can easily reach trillions, making exhaustive exploration computationally infeasible. Existing concolic testing tools employ various heuristics to select which paths to explore next, such as prioritizing paths that cover new code. However, these heuristics are often syntactic and lack a deep understanding of the program’s semantics, leading to inefficient exploration. 2.3. Constraint Solving Bottlenecks The performance of concolic testing is heavily dependent on the underlying SMT solver. As the program explores deeper paths, the path conditions become increasingly complex. Modern SMT solvers are powerful, but they can struggle with certain types of constraints, particularly those involving non-linear arithmetic, floating-point numbers, or complex string operations. When a solver fails to find a solution for a satisfiable path condition within a given timeout, the concolic tester is forced to abandon that path, potentially missing bugs. 2.4. Large Language Models for Code Large Language Models (LLMs) like GPT-5.1 and Codex have demonstrated remarkable capabilities in understanding, generating, and reasoning about source code. They are trained on vast corpora of code and natural language text, enabling them to capture the syntax, semantics, and common patterns of software development. In the context of software testing, LLMs can be prompted to generate test cases, suggest assertions, or even explain the logic of a piece of code. This semantic reasoning ability offers a promising new avenue for guiding the test generation process. 2.5. Motivating Example Consider a function that parses a complex data structure and performs different actions based on the values of its fields. A traditional concolic tester might explore paths randomly or based on simple coverage metrics. It could spend a significant amount of time exploring paths that correspond to trivial or uninteresting input variations. An LLM, on the other hand, could analyze the function’s code and documentation to understand its intended purpose. It