Agentic Generation of AST Transformation Rules for Fixing Breaking Updates

Frank Reyes Benoit Baudry Martin Monperrus KTH Royal Institute of Technology Université de Montréal KTH Royal Institute of Technology Stockholm, Sweden Montréal, Canada Stockholm, Sweden [email protected] [email protected] [email protected] · 2026

Read Agentic Generation of AST Transformation Rules for Fixing Breaking Updates by Frank Reyes Benoit Baudry Martin Monperrus KTH Royal Institute of Technology Université de Montréal KTH Royal Institute of Technology Stockholm, Sweden Montréal, Canada Stockholm, Sweden [email protected] [email protected] [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24446.txt.

Introduction

Reyes, Baudry, and Monperrus make software repairs reusable by writing them as transformations instead of one-off patches. Library updates routinely break client code with API changes, and when one update breaks many projects, conventional repair regenerates a bespoke patch per project. Their agentic framework, BigBag, instead generates fixing transformations: structured, executable programs encoding the repair logic at the API level, built from abstract syntax tree rewriting.

Evaluation uses the BUMP benchmark of compilation failures from breaking dependency updates, across eight configurations that combine four large language models with two transformation engines, Spoon and JavaParser. The best configuration produces compilable transformations at a high rate and fixes most failures. Crucially, generated transformations transfer between projects broken by the same update, with cross-project fix rates rising high for well-covered updates. Reyes's 2026 system reframes dependency repair as authoring a tool once and applying it everywhere the same break occurs.

Catalog record

CREATORFrank Reyes Benoit Baudry Martin Monperrus KTH Royal Institute of Technology Université de Montréal KTH Royal Institute of Technology Stockholm, Sweden Montréal, Canada Stockholm, Sweden [email protected] [email protected] [email protected]
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.24446

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Agentic Generation of AST Transformation Rules for Fixing Breaking Updates Frank Reyes Benoit Baudry Martin Monperrus KTH Royal Institute of Technology Université de Montréal KTH Royal Institute of Technology Stockholm, Sweden Montréal, Canada Stockholm, Sweden [email protected] [email protected] [email protected] Abstract Modern software projects depend on third-party libraries that evolve continuously, introducing breaking API changes that prevent client code from compiling after a dependency update. When the same library update breaks multiple projects, existing repair approaches generate project-specific patches that cannot be reused, requiring each affected project to be repaired independently. We present BigBag , an agentic framework that generates fixing transformations: structured, executable programs that encode the repair logic at the API level and transfer to any client broken by the same update. We evaluate BigBag on 157 compilation failure breaking dependency updates from the BUMP benchmark, across eight configurations combining four large language models and two AST transformation engines (Spoon and JavaParser). The best configuration achieves a compilable transformation rate of 94.3% and a fix rate of 78.6%. Generated transformations transfer across projects, achieving a cross-project fix rate of 33.3% overall and 80% or above for breaking updates where all clients invoke the affected API element uniformly. These results show that agentic generation of reusable fixing transformations is a viable approach to scalable repair of breaking updates. I Introduction Modern software systems heavily depend on third-party libraries managed through package managers such as Maven, npm, and PyPI [ 1 ] . These libraries continuously evolve [ 2 ] , and not all updates preserve backward compatibility. Keeping dependencies up to date is therefore an essential maintenance activity, and tools such as Dependabot and Renovate [ 3 ] automate the version-update step at scale. Removing a method, altering a signature, or relocating a type between packages causes dependent client projects to fail to build after the update [ 4 , 5 ] . These events are called breaking dependency updates , and they are common: Ochoa et al . [ 5 ] show that incompatible changes affect Maven clients even in minor and patch-level releases that should be safe according to SemVer. When multiple projects depend on the same library, the same breaking dependency update affects all of them, each requiring the same conceptual fix applied to different code. Yet, existing breaking update repair approaches address this one project at a time, generating project-specific code patches that cannot be reused across clients [ 6 , 7 ] . This limits the scalability of existing repair approaches: every affected project must be repaired independently, even when the underlying breaking dependency update is identical. We address this problem with BigBag , a novel technique based on reusable code transformations. BigBag exploits a structural property of breaking dependency updates: all clients broken by the same update are broken because of the same root cause. The core idea of BigBag is to generate fixing code transformations : structured, standalone, executable programs that traverse a client project’s AST, locate the constructs affected by a breaking change, and rewrite them to conform to the new API. Unlike project-specific patches, a fixing transformation encodes the repair logic at the API level; once it is generated from one affected client, it applies to any other client broken by the same breaking dependency update. BigBag generates those fixing transformations with a coding agent through a generate-apply-verify loop [ 8 ] in which: 1) the agent builds the transformation against an AST transformation engine, 2) applies it to the broken client until success based on compiler feedback; 3) deploys the transformation over other client projects affected by the same breaking update. To evaluate BigBag , we consider real world breaking dependency updates from BUMP [ 9 ] , a curated benchmark of reproducible breaking updates in real Maven projects. We study eight configurations combining four large language models (LLMs) and two AST transformation engines. Our evaluation on 157 breaking dependency updates across eight (model, engine) configurations shows that coding agents can reliably generate compilable fixing transformations. The best configuration reaches a compilable transformation rate of 94.3% and a fix rate of 78.6%. The choice of AST transformation engine is a first-order determinant of success: across four models, the two engines differ by up to 17.8% in the rate of compilable transformations generated: JavaParser works generally better. Next, we check whether generated transformations transfer across projects. They do, but not perfectly, with a cross-project fix rate of 33.3% overall and 80% or above for breaking updates where all clients invoke the affected API element uniformly. Transfer success depends on usage uniformity across clients. To the best of our knowledge, BigBag is the first approach to generate AST transformations for fixing breaking dependency updates. BigBag also provides the first evidence of how AST transformation engine choice impacts repair success. The closest contribution is [ 10 ] , which also generates LLM-based migration artifacts that transfer across projects affected by the same API change; the key difference is that BigBag targets Java breaking dependency updates using structured AST transformations rather than structural pattern-matching scripts for Python API migrations. To summarize, our contributions are: • BigBag , an agentic framework that generates AST transformations for fixing breaking dependency updates, available at https://github.com/chains-project/bigbag . • An empirical study across 157 real-world breaking dependency updates and eight (model, AST engine) configurations, measuring transformation well-formedness, effectiveness, and cross-project transferability. This systematic experimental campaign demonstrates the feasibility of generating fixing transformations for breaking dependency updates. • A characterization of failure modes, showing that compilation success is correlated to the AST transformation engine API complexity, and that transfer success is determined by usage uniformity across clients. The remainder of this paper is organized as follows. Section II introduces breaking dependency updates, AST transformation engines, and coding agents. Section III describes the BigBag framework. Section IV presents the experimental methodology. Section V reports the results for each RQ. Section VI discusses threats to validity. Section VII discusses related work, and Section VIII draws conclusions. II Background II-A Breaking Dependency Updates Third-party libraries continuously evolve, and some evolutions are not backward-compatible, e.g., by removing methods, altering signatures, or introducing checked exceptions. When client projects update a dependency to a new version, they fail to compile due to the resulting API incompatibilities. These events are called breaking dependency updates [ 9 ] . We adopt the following definitions from previous work [ 6 ] : Definition 1 A dependency update is a change made in a build specification file where the version of a specific dependency is updated to a new version. In this paper, we focus on the build file in Java/Maven: pom.xml . Definition 2 A breaking dependency update is a dependency update (L,\,v_{i}\!\to\!v_{j}) that introduces incompatibilities causing the Maven build to fail, where L denotes the updated library, v_{i} the previous version, and v_{j} the new version. Existing tools such as Dependabot and Renovate automate the version update step but do not repair the resulting compilation failures [ 3 , 11 ] . Recent LLM-based approaches address this repair step by generating code patches for individual affected projects [ 6 , 7 ] . BigBag instead generates structured, executable fixing transformations: a single transformation derived from one client applies to

Read the complete text