\System : Dynamic Autonomy for Coding Agents Under Local Oversight Conference: Proceedings of the 1st ACM Conference on Agentic and AI Systems; May 26, 2026; San Jose, CA, USA Proceedings of the 1st ACM Conference on Agentic and AI Systems (CAIS ’26), May 26, 2026, San Jose, CA, USA DOI: 10.1145/3786335.3813223 ISBN: 979-8-4007-2415-2/26/05 CCS: Human-centered computing User interface programming CCS: Software and its engineering Risk management CCS: Human-centered computing Command line interfaces CCS: Human-centered computing Text input

Tanjal Shukla, K. J. Kevin Feng, Leijie Wang, Mohammad Rostami, Amy X. Zhang · 2026

Read \System : Dynamic Autonomy for Coding Agents Under Local Oversight Conference: Proceedings of the 1st ACM Conference on Agentic and AI Systems; May 26, 2026; San Jose, CA, USA Proceedings of the 1st ACM Conference on Agentic and AI Systems (CAIS ’26), May 26, 2026, San Jose, CA, USA DOI: 10.1145/3786335.3813223 ISBN: 979-8-4007-2415-2/26/05 CCS: Human-centered computing User interface programming CCS: Software and its engineering Risk management CCS: Human-centered computing Command line interfaces CCS: Human-centered computing Text input by Tanjal Shukla, K. J. Kevin Feng, Leijie Wang, Mohammad Rostami, Amy X. Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11495.txt.

Introduction

Shukla and four colleagues present Hedwig, a coding agent that adjusts its autonomy level on the fly under local oversight. Coding agents still make unintended edits, subtle bugs and scope drift slipping past review, yet developers must choose how much freedom to grant. Fixed permission settings and instruction files cannot track tastes that shift across tasks and time. A survey of 21 engineers confirms frustration with setting autonomy levels. Hedwig learns changing rules from developer decisions and feedback, easing friction where trust is earned and tightening control in new territory.

Catalog record

CREATORTanjal Shukla, K. J. Kevin Feng, Leijie Wang, Mohammad Rostami, Amy X. Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39406
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11495

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

\System : Dynamic Autonomy for Coding Agents Under Local Oversight Conference: Proceedings of the 1st ACM Conference on Agentic and AI Systems; May 26, 2026; San Jose, CA, USA Proceedings of the 1st ACM Conference on Agentic and AI Systems (CAIS ’26), May 26, 2026, San Jose, CA, USA DOI: 10.1145/3786335.3813223 ISBN: 979-8-4007-2415-2/26/05 CCS: Human-centered computing User interface programming CCS: Software and its engineering Risk management CCS: Human-centered computing Command line interfaces CCS: Human-centered computing Text input Tanjal Shukla, K. J. Kevin Feng, Leijie Wang, Mohammad Rostami, Amy X. Zhang Abstract . Despite coding agents’ advances in handling increasingly complex tasks, their continued tendency to introduce unintended edits, subtle bugs, and scope drift that slip past code review means developers must still decide how much autonomy to grant them. However, existing approaches for setting an agent’s level of autonomy, such as static permission settings or instruction files, cannot account for how developers’ preferences for agent autonomy can shift across tasks and over time. We conducted a formative survey with 21 software engineers who use coding agents and found that they experience frustration with calibrating autonomy and have evolving preferences for level of oversight. Building on these insights, we present \System , a CLI coding agent that dynamically adjusts its autonomy level based on developer-agent interactions across sessions. Rather than operating on a global, fixed autonomy configuration, \System learns an evolving set of behavioral guidelines from developer decisions and feedback, reducing friction on work for which the agent has earned trust, while tightening oversight when the agent operates outside familiar territory. \System demonstrates the potential of a new paradigm where agents intelligently adapt their level of autonomy based on user trust through active, longitudinal collaboration. Figure 1. \System is a CLI coding agent that dynamically calibrates its level of autonomy in response to user interactions and feedback. \System records and reasons over user interactions (e.g., code edits, plan corrections, rejected/approved commands) over time to maintain an evolving set of behavioral policies. These policies are used to govern the agent’s actions and frequency of check-ins with the developer. 1. Introduction Coding agents are increasingly integrated into everyday programming practices. Modern coding agents inspect repositories, edit multiple files, run commands, and debug errors—capabilities that require deep access to developers’ working environments and can create risks of unintended edits, subtle bugs, or security issues. Field observations of professional developers confirm that effective use of agents is highly controlled in practice: developers retain responsibility for design decisions, verification, and code review rather than delegating end-to-end autonomy ( 5 ) . Consequently, collaborating with a coding agent is not only about judging the correctness of its outputs, but also effectively managing the agent through strategic calibration of its level of autonomy ( 2 ) . Yet what level of autonomy is desired can vary across developers, tasks, timelines, and projects. Some developers want to review every edit, while others prefer to step in only at key milestones or when evaluating the final artifact. Although today’s coding agents are shaped by large-scale post-training and alignment pipelines meant to capture generally useful developer preferences, these defaults often fail to match the autonomy expectations of a particular user in a specific project context ( 3 ; 10 ; 9 ) . As a result, the goal of human-AI collaboration should not be to maximize automation, but to maintain meaningful human oversight—calibrated to each developer’s risk tolerance, task stakes, and evolving trust in the agent ( 1 ) . This calibration requires understanding how oversight behavior actually varies across users and tasks ( 6 ) . Researchers and practitioners have explored several approaches for calibrating agent autonomy. Coding agents are often designed to ask for clarification or permission before taking risky actions, but the right frequency and timing of these check-ins is non-trivial: empirical work shows that deferring all confirmation to the end is suboptimal—81% of users preferred intermediate checkpoints in a recent 48-participant study ( 12 ) —yet frequent interruptions can disrupt workflow and become burdensome ( 4 ; 9 ) . Developers can also specify behavioral preferences through instruction files (e.g., AGENTS.md ), profile settings, or stored memories that guide future interactions. However, these approaches often assume that users’ preferred level of autonomy is stable and can be articulated in advance. In practice, autonomy preferences shift over time as users gain or lose trust in the agent, move across tasks with different stakes, or work under different constraints. To achieve this, high-quality feedback from human developers can be a more reliable signal than upfront preferences alone ( 8 ) . This points to a need for coding agents that can intelligently learn from interaction and continually adapt their level of autonomy. We present \System , a CLI coding agent that dynamically adapts its autonomy level based on developer interactions. We designed \System based on insights from a formative survey with 21 professional programmers with extensive experience with using coding agents. Rather than fixing its autonomy at a particular configuration, \System reasons about and adapts its autonomy level over time based on how the developer interacts with the agent in practice. \System has two main components. First, it records developer-agent interactions and categorizes them into two governance tiers: hard constraints enforced directly by the CLI, and behavioral guidance retrieved when relevant to shape how the model approaches the current task. Behavioral guidance is stored as compact feedback snippets and logic notes from related past work—capturing developer corrections, architectural decisions, and prior reasoning—and retrieved into future prompts when relevant to the current task, allowing the model to reuse prior decisions and corrections. Second, when the coding agent proposes reads, plans, check-ins, or code updates, \System audits those proposals against active hard constraints, retrieved behavioral context, the current task and specification, and interaction history (e.g., approvals, denials, and corrections). Over time, this history trains an online policy that adjusts when similar future actions require a check-in. Beyond instruction-file approaches, hard constraints are enforced at the CLI layer independently of the model’s reasoning, and the end-of-session summary separates policy-triggered from model-triggered check-ins—making each oversight decision legible to the developer. 2. Motivations and Design Goals 2.1. Motivations from a Developer Survey We conducted a formative survey with 21 experienced users of coding agents, which motivated the need for selective, legible oversight. Our sample mostly consisted of experienced engineers: 20 of 21 respondents reported at least 8 years of programming experience, and 20 of 21 used coding agents at least weekly. Their leading concerns were subtle bugs that pass review (13/21), erosion of their own understanding of the codebase (12/21), security vulnerabilities (10/21), and outdated or incorrect context (9/21). At the same time, respondents did not want constant interruption: 11 of 21 preferred check-ins at key milestones, and another 2 of 21 preferred check-ins only when something risky or unexpected occurred. These results point to the same design requirement: coding agents need oversight that is selective, legible, and adjustable rather than uniformly strict or uniformly permissive ( 4 ; 6 ; 8 ; 11 ; 1 ) . This study was reviewed and approved by the University of Washington IRB. 2.2. Design Goals We derive three design goals using insights from results of our

Read the complete text