A Multi-Agent Framework for Automated Exploit Generation with Constraint-Guided Comprehension and Reflection Conference: 34th IEEE/ACM International Conference on Program Comprehension; April 12–13, 2026; Rio de Janeiro, Brazil 34th IEEE/ACM International Conference on Program Comprehension (ICPC ’26), April 12–13, 2026, Rio de Janeiro, Brazil DOI: 10.1145/3794763.3794817 ISBN: 979-8-4007-2482-4/2026/04 CCS: Security and privacy Software security engineering CCS: Computing methodologies Multi-agent planning CCS: Software and its engineering Software libraries and repositories
Siyi Chen, Tianhan Luo, Shijian Wu, Xiangyu Liu, Yilin Zhou, Qi Li, Wenyuan Xu · 2026
Read A Multi-Agent Framework for Automated Exploit Generation with Constraint-Guided Comprehension and Reflection Conference: 34th IEEE/ACM International Conference on Program Comprehension; April 12–13, 2026; Rio de Janeiro, Brazil 34th IEEE/ACM International Conference on Program Comprehension (ICPC ’26), April 12–13, 2026, Rio de Janeiro, Brazil DOI: 10.1145/3794763.3794817 ISBN: 979-8-4007-2482-4/2026/04 CCS: Security and privacy Software security engineering CCS: Computing methodologies Multi-agent planning CCS: Software and its engineering Software libraries and repositories by Siyi Chen, Tianhan Luo, Shijian Wu, Xiangyu Liu, Yilin Zhou, Qi Li, Wenyuan Xu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05130.txt.
Introduction
Chen and six co-authors propose Vulnsage, a multi-agent framework for exploit generation with grasp and reflection. Open-source code is widely used in modern software, introducing safety flaws. Static analysis tools can find flaws at scale, yet they generate huge reports with many false alarms. Exploit generation aims to confirm truth by building an exploit. Methods based on fuzzing or symbolic execution face path reach problems. Language models show promise for grasping flaws and making exploits. How to use them remains an open question.
Catalog record
| CREATOR | Siyi Chen, Tianhan Luo, Shijian Wu, Xiangyu Liu, Yilin Zhou, Qi Li, Wenyuan Xu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57511 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.05130
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Multi-Agent Framework for Automated Exploit Generation with Constraint-Guided Comprehension and Reflection Conference: 34th IEEE/ACM International Conference on Program Comprehension; April 12–13, 2026; Rio de Janeiro, Brazil 34th IEEE/ACM International Conference on Program Comprehension (ICPC ’26), April 12–13, 2026, Rio de Janeiro, Brazil DOI: 10.1145/3794763.3794817 ISBN: 979-8-4007-2482-4/2026/04 CCS: Security and privacy Software security engineering CCS: Computing methodologies Multi-agent planning CCS: Software and its engineering Software libraries and repositories Siyi Chen, Tianhan Luo, Shijian Wu, Xiangyu Liu, Yilin Zhou, Qi Li, Wenyuan Xu Abstract . Open-source libraries are widely used in modern software development, introducing significant security vulnerabilities. While static analysis tools can identify potential vulnerabilities at scale, they often generate overwhelming reports with high false positive rates. Automated Exploit Generation (AEG) emerges as a promising solution to confirm vulnerability authenticity by generating an exploit. However, traditional AEG approaches based on fuzzing or symbolic execution face path coverage and constraint-solving problems. Although LLMs show great potential for AEG, how to effectively leverage them to comprehend vulnerabilities and generate corresponding exploits is still an open question. To address these challenges, we propose VulnSage , a multi-agent framework for AEG. VulnSage simulates human security researchers’ workflows by decomposing the complex AEG process into multiple specialized sub-agents: Code Analyzer Agent, Code Generation Agent, Validation Agent, and a set of Reflection Agents, orchestrated by a central supervisor through iterative cycles. Given a target program, the Code Analyzer Agent performs static analysis to identify potential vulnerabilities and collects relevant information for each one. The Code Generation Agent then utilizes an LLM to generate candidate exploits. The Validation Agent and Reflection Agents form a feedback-driven self-refinement loop that uses execution traces and runtime error analysis to either improve the exploit iteratively or reason about the false positive alert. Experimental evaluation demonstrates that VulnSage succeeds in generating 34.64% more exploits than state-of-the-art tools such as EXPLOADE.js . Furthermore, VulnSage has successfully discovered and verified 146 zero-day vulnerabilities in real-world scenarios, demonstrating its practical effectiveness for assisting security assessment in software supply chains. † † cc-license: by 1. Introduction The widespread use of open-source libraries in modern software ecosystems introduces significant security risks ( 29 ; 31 ) . As a result, automated discovery and mitigation of library vulnerabilities have become an important research focus in cybersecurity ( 25 ; 50 ) . Static analysis has been widely adopted for automated vulnerability detection. However, traditional static analysis methods often struggle to achieve scalability, soundness, and precision simultaneously ( 18 ) . Many practical tools, such as CodeQL ( 17 ) , prioritize scalability and soundness, but this trade-off often leads to overwhelming reports with numerous false positives, requiring significant manual effort for verification. Automated Exploit Generation (AEG) has emerged as a promising solution to this problem, aiming to automatically generate a working proof-of-concept (PoC) to confirm a vulnerability’s authenticity and impact. Despite its advantages, AEG remains limited in real-world exploit validation. This is primarily due to the difficulty of crafting inputs required by the entry point function 1 1 1 In our scenario, the function that contains user-controlled parameters is the entry point function. . Such inputs often have complex data structures, and their values must satisfy specific control-flow constraints in order to reach the critical function (i.e., sink in taint analysis terminology) and finally execute attacker-defined payload ( 1 ; 9 ) . Traditional dynamic analysis techniques, such as fuzzing, have demonstrated success in discovering vulnerabilities by providing unexpected inputs ( 48 ; 6 ; 5 ) . However, their effectiveness diminishes when faced with complex program logic or deep execution paths. Another group of techniques using symbolic execution, employed by tools such as EXPLOADE.js ( 30 ) , explores the program paths by translating them into formal constraints. However, the constraints encoded in code, including string manipulations and higher-order functions, are complex and difficult for current SMT frameworks to solve effectively ( 2 ) . Recent advancements in Large Language Model (LLM) show their powerful code understanding and imitation capabilities, which could be great potential for code generation tasks ( 39 ; 35 ) . However, applying LLM in AEG also has challenges ( 21 ) : (1) the LLM only produces useful outputs when it fully understands the task. For generating an exploit for a vulnerability, the LLM must firstly comprehend all code relevant to the vulnerability, which often exceeds a single model’s context window ( 20 ) ( 28 ) . (2) Even when the code fits the context window, large language models may lose focus midway and produce hallucinated content ( 27 ; 49 ; 19 ) . (3) AEG is a complex task, including code analysis, code synthesis, exploit verification, etc. — without special handling, LLMs struggle with complex or multi-step tasks ( 46 ) . (4) LLM can not verify the generated code itself, nor the correctness of the code’s syntax. To address the limitations above, we propose VulnSage , a multi-agent framework for automated exploit generation. VulnSage is guided by a key insight: An experienced security analyst would break down the exploit process into four distinct steps: (1) auditing the vulnerable code deeply and comprehending the input structure, (2) writing exploit code, (3) executing the exploit to check whether it is successful, (4) when execution fails, adjusting the exploit with feedback. These four complementary subtasks require multiple iterations to achieve successful exploitation. Accordingly, VulnSage incorporates several specialized agents: Code Analyzer Agent, Code Generation Agent, Validation Agent, and a set of Reflection Agents. These agents are invoked by a Supervisor Agent based on the current progress of exploit generation to simulate the human AEG workflow. Given a library, the Code Analyzer Agent performs static analysis, extracts vulnerability-related code slices for each alert, and drafts an initial exploit template. The Code Generation Agent executes a two-step process: (1) encoding the exploit generation problem as a set of constraints and (2) generating exploit code that satisfies those constraints. The Validation Agent prepares an executable environment for exploits and verifies exploit validity using oracles. The Reflection Agents include an agent that derives new constraints from failed exploits and an agent that reasons whether the corresponding alert is a false positive. Finally, the Supervisor Agent outputs the confirmed vulnerabilities with their corresponding exploits, along with identified false positives and the underlying reasons. Our experimental results demonstrate that VulnSage successfully generates exploits for 53.47% vulnerabilities on SecBench.js , a significant improvement of at least 34.64% over the state-of-the-art tools such as EXPLOADE.js on JavaScript vulnerabilities. Furthermore, VulnSage successfully discovered 146 0-day vulnerabilities with reasonable cost. Contributions. The paper’s contributions can be briefly outlined as follows: (1) Multi-Agent Vulnerability Discovery Architecture: We propose a novel multi-agent framework named VulnSage , addressing the context size limitation of large language models in the AEG scenario. (2) Constraints-based Comprehension: We extract the relevant code and encode it as constraints to guide the LLM toward a better understanding of the vulnerability. (3) Environment Feedback and Reflection Mechanism: We develop a continuous reflection mechanism that can automatically validate the exploits, leverage the feedback to refine the exploit code, and reason about false positives of alerts. (4) Empirical Effectiveness: We conduct experimental evaluations that demonstrate superior performance compared to state-of-the-art baselines, with successful discovery