Towards Effectively Leveraging Execution Traces for Program Repair with Code LLMs
Mirazul Haque, Petr Babkin, Farima Farmahinifarahani, Manuela Veloso, J. P. Morgan AI Research, {New York, Palo Alto} · 2025
Read Towards Effectively Leveraging Execution Traces for Program Repair with Code LLMs by Mirazul Haque, Petr Babkin, Farima Farmahinifarahani, Manuela Veloso, J. P. Morgan AI Research, {New York, Palo Alto} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-04441.txt.
Description
Mirazul Haque and co-authors test run traces as hints for code repair in a 2025 paper. Language model repair tools read code as still text and skip how a program acts when it runs. The team fed live execution traces into repair prompts to close that blind spot.
Across three repair sets and GPT family models, plain trace prompts beat no trace ones in just two of six setups. Long, tangled traces helped least. Prompts tuned for the model did better on a steadier basis. Trace hints also beat fine tuning a small model on a small set, and probes show traces can aid model reasoning.
Catalog record
| CREATOR | Mirazul Haque, Petr Babkin, Farima Farmahinifarahani, Manuela Veloso, J. P. Morgan AI Research, {New York, Palo Alto} |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-04441