LLMloop : Improving LLM-Generated Code and Tests through Automated Iterative Feedback Loops

Ravin Ravi 1 , Dylan Bradshaw 1 , Stefano Ruberto 2 , Gunel Jahangirova 3 , and Valerio Terragni 1 · 2026

Read LLMloop : Improving LLM-Generated Code and Tests through Automated Iterative Feedback Loops by Ravin Ravi 1 , Dylan Bradshaw 1 , Stefano Ruberto 2 , Gunel Jahangirova 3 , and Valerio Terragni 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23613.txt.

Description

Ravi and four co-authors present LLMLOOP, a framework that polishes model-written code and tests in rounds. Language models draft code fast, but drafts often fail to compile or run wrong. LLMLOOP runs five repair loops over each draft. The loops fix compile errors, static warnings, and failing tests in turn. A mutation loop then grades and hardens the test suite itself. The polished tests double as a regression suite for the code. On the HUMANEVAL-X bench, the loops lift output quality by a clear margin.

Catalog record

CREATORRavin Ravi 1 , Dylan Bradshaw 1 , Stefano Ruberto 2 , Gunel Jahangirova 3 , and Valerio Terragni 1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23055
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.23613

Browse the full library · About the Tower of Babel