Loc2Repair: A Framework for Evaluating the Impact of File-Level Issue Localization in Repo-Level LLM Repair

Mohammad Nour Al Awad, Sergey Ivanov · 2026

Read Loc2Repair: A Framework for Evaluating the Impact of File-Level Issue Localization in Repo-Level LLM Repair by Mohammad Nour Al Awad, Sergey Ivanov (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30963.txt.

Introduction

Mohammad Nour Al Awad and Sergey Ivanov isolate one ingredient of AI code repair: knowing which file to fix. Repository-level repair is usually reported as a single end-to-end score, which hides whether failures come from poor file targeting, wrong patches or failed debugging loops. Their Loc2Repair framework decouples localisation from repair inside a shared runtime and harness, so different localisers and repair models can be mixed under matched conditions. They test three repair backbones on SWE-bench Verified, comparing no localisation, two predicted localisers, and the gold set of modified files.

Explicit localisation raised the pooled resolved rate in every configuration: from 44.7% with no localisation to 48.9% and 49.1% with predicted locations, and 52.4% with gold files. Mean repair time also fell, by about 101 and 52 seconds for the predicted settings, and 154 seconds for gold.

Catalog record

CREATORMohammad Nour Al Awad, Sergey Ivanov
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.30963

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Loc2Repair: A Framework for Evaluating the Impact of File-Level Issue Localization in Repo-Level LLM Repair Mohammad Nour Al Awad, Sergey Ivanov Abstract Repository-grounded automated repair is often reported as a single end-to-end capability, which hides distinct failure modes such as poor file targeting, incorrect patch synthesis, and failed iterative debugging. We present Loc2Repair , a modular evaluation framework for controlled analysis of repository-grounded repair pipelines, and use it to isolate file-level issue localization as an upstream variable. Loc2Repair decouples localization and repair under a shared runtime, artifact schema, and evaluation harness, allowing researchers to combine different localization models and repair backbones under matched conditions. Using three repair backbones on SWE-bench Verified, we compare baseline repair without explicit localization, repair guided by predicted localization from two localizers, and repair guided by gold modified-file sets. Explicit localization consistently improves resolved rate across all backbones: pooled performance increases from 44.7 % 44.7\% for baseline repair to 48.9 % 48.9\% and 49.1 % 49.1\% with predicted localization, and to 52.4 % 52.4\% with gold localization. Localization also reduces mean elapsed time overall: in pooled paired analysis, mean elapsed time decreases by 100.94 100.94 s and 52.25 52.25 s for the two predicted-localization settings, and by 154.45 154.45 s with gold guidance, although token effects remain heterogeneous across models. Overall, Loc2Repair shows file-level localization is a consistent repair lever, improving effectiveness and mean latency in pooled analysis, while gold-guided failures expose headroom beyond localization. [ [email protected] ] [ [email protected] ] keywords issue localization ,repository-grounded repair ,LLM coding agents ,LLM benchmarking ,SWE-bench † † copyrightyear: 2026 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: GeCoIn 2026: Generative Code Intelligence Workshop, co-located with the 35th International Joint Conference on Artificial Intelligence (IJCAI-ECAI 2026), August 15–17, 2026 — Bremen, Germany † † address: ITMO University 1 Introduction Repository-grounded software-engineering agents now operate over full repositories, inspect files, execute commands, run tests, and propose patches for realistic issues 9 ; 24 ; 23 ; 29 ; 22 ; 28 . This shift has made end-to-end issue resolution a central evaluation target for large language model (LLM) systems. However, end-to-end reporting alone is often too coarse for scientific diagnosis. When a repair attempt fails, the cause may lie in at least three distinct places: the agent may search the wrong region of the repository, synthesize an incorrect patch after reaching the right files, or fail to recover through iterative validation and debugging. For repository-grounded repair, file targeting is a particularly important upstream decision. Before modifying code, an agent must decide what to inspect, which files are likely relevant, and how to allocate limited attention over a repository. Errors at this stage propagate downstream by distorting context selection, tool use, and repair strategy. As a result, weak localization can suppress downstream repair performance even when the repair backbone itself is capable of producing a correct patch once given the right starting context. This paper introduces Loc2Repair , a modular evaluation framework for controlled analysis of repository-grounded repair pipelines. Loc2Repair decouples localization and repair under a shared runtime, artifact schema, and evaluation harness, allowing researchers to combine different localization models and repair backbones, compare them under matched conditions, and quantify both effectiveness and cost. In this paper, we use the framework to study one central question: how much does file-level issue localization change downstream repair when the repair backbone is otherwise held fixed? Concretely, for each repair backbone, we compare four conditions: baseline repair without explicit localization, repair guided by predicted localization from Qwen4B, repair guided by predicted localization from Gemma4E4B, and repair guided by gold modified-file sets derived from benchmark references. This design isolates localization as an experimental variable while simultaneously providing a reusable evaluation framework for future plug-and-play comparisons of new localizers and repair models. We study four research questions: • RQ1. Does explicit file-level localization improve downstream repair effectiveness? • RQ2. How consistent are localization-induced gains across repair backbones? • RQ3. What efficiency trade-offs does localization introduce? • RQ4. What bottlenecks remain beyond file-level localization? Across three repair backbones, explicit localization consistently improves resolved rate, while gold localization improves further and reveals headroom. Pooled analysis shows reliable aggregate gains and lower mean elapsed time, although token effects remain model-dependent. This combination of effectiveness and efficiency mirrors a broader lesson from LLM code-assistance research: operational choices around when model assistance is invoked or presented can affect both usefulness and wasted inference 2 . The paper makes four contributions: • We present Loc2Repair , a modular framework that decouples localization and repair under a shared runtime and evaluation harness, enabling controlled comparisons across localizers and repair backbones. • We provide cross-backbone evidence on SWE-bench Verified that explicit file-level localization consistently improves end-to-end repair effectiveness. • We show that localization can improve effectiveness and latency: pooled analysis yields resolved-rate gains and lower mean elapsed time, while token effects remain model-dependent. • We derive evaluation implications for repository-grounded code agents, showing how stage-aware analysis exposes headroom that end-to-end reporting alone would hide. 2 Related Work Repository-grounded repair. Recent benchmarks, datasets, and systems established realistic evaluation for issue resolution in full software repositories 9 ; 24 ; 23 ; 29 ; 4 ; 22 ; 26 ; 10 ; 11 ; 16 ; 28 . This line of work shifted repair toward realistic agentic settings with repository navigation, tool use, execution, validation, memory, and repair-data generation in the loop 13 ; 15 . Cost-aware invocation has also been studied in developer-facing LLM coding tools, where behavioral telemetry can suppress low-value model calls before generation 3 . At the same time, it made attribution harder: end-to-end success or failure does not by itself reveal whether a system failed because it searched the wrong files, generated the wrong patch, or failed during iterative repair. Bug and issue localization. Bug and issue localization have a long history in software engineering. Classical approaches emphasized information retrieval, ranking, and hybrid signals that combine textual and structural evidence 18 ; 25 ; 21 ; 1 ; 14 . More recent work has extended localization to the LLM era, including repository-level issue localization, graph-guided localization, and agentic localization strategies 5 ; 8 ; 27 ; 12 ; 17 . These works strengthen localization itself, but they do not directly answer a separate intervention question that matters for repository-grounded repair: how much downstream repair quality changes when file-level localization quality changes while the repair backbone is otherwise held fixed. Localization and repair together. A growing body of work combines localization and repair within integrated LLM-based pipelines 7 ; 6 ; 19 . This is an important systems direction, since realistic repair agents must ultimately coordinate search, reasoning, editing, and validation. However, integrated architectures make stage attribution difficult: when end-to-end performance improves, it is often unclear how much of the gain comes from stronger localization versus stronger downstream repair behavior. Our contribution is complementary to these directions. We perform a controlled intervention study that varies file-level localization while keeping the downstream repair setting fixed. In that sense, the paper is not only about repair performance, but also about evaluation methodology : it asks how stage-aware interventions

Read the complete text