Learning Project-wise Subsequent Code Edits via Interleaving Neural-based Induction and Tool-based Deduction

Chenyan Liu 1, 2 , Yun Lin 1 1 , Yuhuan Huang 1 , Jiaxin Chang 1 , Binhang Qi 2 , Bo Jiang 3 , Zhiyong Huang 2 , and Jin Song Dong 2 · 2026

Read Learning Project-wise Subsequent Code Edits via Interleaving Neural-based Induction and Tool-based Deduction by Chenyan Liu 1, 2 , Yun Lin 1 1 , Yuhuan Huang 1 , Jiaxin Chang 1 , Binhang Qi 2 , Bo Jiang 3 , Zhiyong Huang 2 , and Jin Song Dong 2 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12220.txt.

Introduction

Liu and seven colleagues propose TRACE, a system for later project-wide code edits by mixing neural induction for semantic edits with tool-based deduction for syntactic ones. Tools such as refactoring and linting aids deduce where edits go and what they say, while a learned model decides when to call them. A fine-grained edit representation further boosts neural prediction, pushing scope, accuracy, and efficiency at once.

Catalog record

CREATORChenyan Liu 1, 2 , Yun Lin 1 1 , Yuhuan Huang 1 , Jiaxin Chang 1 , Binhang Qi 2 , Bo Jiang 3 , Zhiyong Huang 2 , and Jin Song Dong 2
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62905
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.12220

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning Project-wise Subsequent Code Edits via Interleaving Neural-based Induction and Tool-based Deduction Thanks: This research is supported in part by National Natural Science Fundation of China (62572300), the Minister of Education, Singapore (MOE-T2EP20124-0017, MOET32020-0004), the National Research Foundation, Singapore and the Cyber Security Agency under its National Cybersecurity R&D Programme (NCRP25-P04-TAICeN), DSO National Laboratories under the AI Singapore Programme (AISG Award No: AISG2-GC-2023-008-1B), and Cyber Security Agency of Singapore under its National Cybersecurity R&D Programme and CyberSG R&D Cyber Research Programme Office. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not reflect the views of National Research Foundation, Singapore, Cyber Security Agency of Singapore as well as CyberSG R&D Programme Office, Singapore. 1 Corresponding author Chenyan Liu 1, 2 , Yun Lin 1 1 , Yuhuan Huang 1 , Jiaxin Chang 1 , Binhang Qi 2 , Bo Jiang 3 , Zhiyong Huang 2 , and Jin Song Dong 2 Abstract In industrial and open-source software engineering tasks, developers often perform project-wise code editing tasks, including feature enhancement, refactoring, and bug fixing, where the leading AI models are expected to support the productivity. Hence, researchers and practitioners have proposed and adopted many LLM-based solutions to facilitate their real-world development. However, they largely suffer from the balance among predicting scope, accuracy, and efficiency. For example, solutions like Cursor achieve high accuracy only in a local editing scope while its performance drops on cross-file edits. In contrast, solutions like CoEdPilot exhibit efficiency limitations when used to predict project-wise edits. In this work, we propose TRACE ( T ool-integrated R ecom-mend A tion for C ode E diting), a novel subsequent code editing solution to push the boundary of scope, accuracy, and efficiency. Our rationale lies in that code edits are triggered for either semantic or syntactic reasons. Therefore, TRACE predicts subsequent edits by interleaving neural-based induction for semantic edit prediction and tool-based deduction for syntactic edit prediction. The tools can be any IDE facilities, such as refactoring tools (e.g., rename) or linting tools (e.g., use-def), providing decent performance of deducing edit-location and edit-generation. Technically, we address the challenge of (1) when to interleave between neural-based and tool-based prediction and (2) how to further improve the performance of neural-based prediction. As for the former, we learn a neural model to detect when to invoke IDE editing tools. As for the latter, we propose a novel and fine-grained editing representation to further boost the performance of neural editing models. Our extensive experiments show that, in comparison to the state-of-the-arts such as CoEdPilot, GrACE, and CCT5, TRACE significantly improves the performance of edit location (by 43.76%) and edit generation (by 11.16%). Our simulation experiment on an interactive editing setting shows that TRACE achieves an acceptance rate 6.15% higher than Cursor. Moreover, our user study consists of 24 participants on Cursor, CoEdPilot, and TRACE, on three code editing tasks. The results show that the experimental group with TRACE achieves leading performance on cross-file global edits. In addition, we observe concerning user behaviours on how participants deal with false predictions by the tools, shedding light on the design of future code-editing tools. I Introduction Recent years have witnessed a surge in applying large language models (LLM) for code generation [ 15 , 22 , 60 , 20 , 43 ] . Despite their success in translating natural language descriptions into target code, incremental code edits across the project are more common in practice. Empirical observation shows that such incremental code edits account for over 70% of changes over the code commit history [ 41 ] . It highlights the need for predicting project-wise subsequent code edits, which can significantly improve the productivity of software developers. Existing works in the community have made the following efforts to address the problem. Local Edit Solution. A line of code edit works [ 58 , 23 , 32 , 65 , 11 ] simplifies the edit generation problem into a machine translation task. In general, these approaches take as input the pre-edit code, and generate the post-edit code as output. Since those approaches cannot predict the edit location, they are generally limited when being applied to predict project-wise subsequent edits. Project-wise Edit Solution. In this context, several industry solutions, such as Copilot Edits and Cursor’s next edit suggestion [ 13 , 25 ] , have emerged. However, due to latency and cost considerations, these solutions appear to be conservative when recommending cross-file edits, often degrading into merely local edit suggestions. When cross-file edits are expected, users typically rely on features like Copilot Chat or Cursor Chat, where they must specify files to edit, requiring prior knowledge and risking overlooked files. Meanwhile, in the research community, the most relevant work is CoEdPilot [ 36 ] , which provides a project-wise solution regarding both edit location and generation, by orchestrating a set of models. A locator model is trained to predict the edit type of each line of code in the code window. If a line is predicted to be modified (e.g., insert or replace), then a generator model generates its edit solution. Both the locator and generator models also incorporate prior edits as user feedback to infer the implicit edit specification. Despite these advances toward a practical AI pair programmer solution, they still suffer from the following challenges: • C1 (Location Overhead): A software project can be large, meaning the model may process numerous code windows to locate subsequent edits. Therefore, exhaustively monitoring the whole project upon any code edits, can incur non-trivial runtime overhead, and undermine the performance. • C2 (Overlooked Edit Composition): Existing neural-based solutions predict each code edit as an individual hunk (i.e., consecutive lines of code change, see example hunks in subsection III-A ). Despite its rapid evolution, neural-based induction inherently suffers from non-trivial computational overhead for scanning the entire codebase and remains fundamentally prone to hallucinations [ 62 ] . Moreover, [ 52 ] shows that LLMs perform poorly on static analysis tasks and that pre-training on such tasks does not improve general code intelligence. However, in practice, hunks can be highly associated or occur simultaneously, forming high-level actions like refactoring. We refer to these grouped edits as edit compositions , where edits exhibit coherence , meaning they are likely to propagate to each other, and this propagation can often be captured by static analysis tools, which guarantee both speed and correctness. • C3 (Coarse-grained Edit Representation): The existing state-of-the-arts [ 58 , 23 , 32 , 65 , 11 ] adopt the git-diff-style representation [ 18 ] , modeling code edits as replacements or insertions (see subsection III-B H1 as an example). While being widely adopted, such a coarse-grained edit representation can express semantically different editing scenarios in a similar way (see subsection III-B H2 as an example), leading to training inefficiency when learning the code-editing models. To address the above challenges, we propose TRACE ( T ool-integrated R ecommend A tion for C ode E diting), predicting project-wise subsequent code edits primarily based on a set of prior edits. Our rationale lies in that code edits are triggered for either semantic or syntactic reasons. Therefore, TRACE predicts subsequent edits by interleaving neural-based induction for semantic

Read the complete text