LLMloop : Improving LLM-Generated Code and Tests through Automated Iterative Feedback Loops
Ravin Ravi 1 , Dylan Bradshaw 1 , Stefano Ruberto 2 , Gunel Jahangirova 3 , and Valerio Terragni 1 · 2026
Read LLMloop : Improving LLM-Generated Code and Tests through Automated Iterative Feedback Loops by Ravin Ravi 1 , Dylan Bradshaw 1 , Stefano Ruberto 2 , Gunel Jahangirova 3 , and Valerio Terragni 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23613.txt.
Description
Ravi and four co-authors present LLMLOOP, a framework that polishes model-written code and tests in rounds. Language models draft code fast, but drafts often fail to compile or run wrong. LLMLOOP runs five repair loops over each draft. The loops fix compile errors, static warnings, and failing tests in turn. A mutation loop then grades and hardens the test suite itself. The polished tests double as a regression suite for the code. On the HUMANEVAL-X bench, the loops lift output quality by a clear margin.
Catalog record
| CREATOR | Ravin Ravi 1 , Dylan Bradshaw 1 , Stefano Ruberto 2 , Gunel Jahangirova 3 , and Valerio Terragni 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23055 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.23613