Human-Guided Harm Recovery for Computer Use Agents

Christy Li, Sky CH-Wang, Andi Peng, Andreea Bobu · 2026

Read Human-Guided Harm Recovery for Computer Use Agents by Christy Li, Sky CH-Wang, Andi Peng, Andreea Bobu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18847.txt.

Introduction

Li and three colleagues formalize harm recovery for computer use agents. Recovery means bringing an agent back to safety from a harmful state, per human preferences, after prevention fails. A user study names valued recovery dimensions and yields a natural language rubric. Its 1,130 pairwise judgments show context dependent shifts in importance. The insights feed a reward model that reranks candidate plans, tested on BackBench, a benchmark of 50 tasks.

Catalog record

CREATORChristy Li, Sky CH-Wang, Andi Peng, Andreea Bobu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE92288
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18847

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Human-Guided Harm Recovery for Computer Use Agents Christy Li, Sky CH-Wang, Andi Peng, Andreea Bobu Abstract As LM agents gain the ability to execute actions on real computer systems, we need ways to not only prevent harmful actions at scale but also effectively remediate harm when prevention fails. We formalize a solution to this neglected challenge in post-execution safeguards as harm recovery : the problem of optimally steering an agent from a harmful state back to a safe one in alignment with human preferences. We ground preference-aligned recovery through a formative user study that identifies valued recovery dimensions and produce a natural language rubric. Our dataset of 1,150 pairwise judgments reveals context-dependent shifts in attribute importance, such as preferences for pragmatic, targeted strategies over comprehensive long-term approaches. We operationalize these learned insights in a reward model, re-ranking multiple candidate recovery plans generated by an agent scaffold at test time. To evaluate recovery capabilities systematically, we introduce BackBench , a benchmark of 50 computer-use tasks that test an agent’s ability to recover from harmful states. Human evaluation shows our reward model scaffold yields higher-quality recovery trajectories than base agents and rubric-based scaffolds. Together, these contributions lay the foundation for a new class of agent safety methods---ones that confront harm not only by preventing it, but by navigating its aftermath with alignment and intent. 1 1 1 Website: https://christykl.github.io/cua-harm-recovery-site/ 1 Introduction As LM agents gain the ability to execute actions in tool-use settings like computer systems ( 22 ; 26 ; 23 ) , ensuring the safety of their actions becomes increasingly critical. Most current approaches to agent safety rely on pre-execution safeguards, which tasks a system to prevent or avoid harm before it can occur ( 14 ; 21 ; 2 ) . Yet prevention alone is often insufficient in practice. Consider Figure 1 , where an agent is instructed to download a routine software update from a vendor’s official server. Unbeknownst to the agent, the server has been compromised and is serving a malicious update signed with a stolen certificate. The agent installs the update, inadvertently enrolling the host machine into a botnet for a large-scale DDoS attack. From the agent’s perspective, every next action in the process appeared safe at every step—yet it culminated in real harm. Once such failures occur, someone—or something—must take corrective action. Relying on human operators to take corrective action is neither scalable nor practical, especially as agents are granted increasing levels of autonomy in dynamic environments such as computer use. This motivates a complementary perspective on safety: post-execution recovery. This reframes safety not merely as preventing harmful actions, but also in guiding agents toward desirable ways of recovering from their consequences should prevention fail. We formalize this challenge as harm recovery : the problem of navigating from a harmful system state back to a safe one. Once a dangerous scenario has been detected, e.g. through the use of a harm classifier ( 18 ; 8 ) , effective recovery requires more than simply reaching any safe state—it requires doing so efficiently and in ways that align with the user’s preferences, such as fully mitigating harm, minimizing unintended consequences, or preventing recurrence. Effective alignment, then, is also a problem of optimization : among the many possible recovery paths, the agent must choose those that best reflect human judgments of what it means to recover well. Here, our central contribution is in characterizing what makes recovery effective and how these criteria depend on context. First, to understand how user preferences on harm recovery vary across contexts, we conduct a formative user study that surfaces the attributes people consider when judging recovery quality. We distill these insights into a natural language rubric and use it to collect a dataset of 1,150 multi-attribute ratings, where annotators assess recovery plans along each dimension and provide overall preference judgments. Our analysis reveals systematic, context-dependent shifts in attribute importance—for instance, users often prioritize pragmatic, targeted strategies over comprehensive long-term approaches. Second, we introduce BackBench —a novel benchmark of 50 backtracking scenarios built on top of the OSWorld environment ( 22 ) that evaluates agents on their ability to recover from harmful states within real-world Ubuntu computing environments. Drawing on a taxonomy of five distinct categories of computer-use harms, these scenarios span a range of incidents—from handling personal data exposure, to performing file recovery, to eliminating malicious processes—challenging agents to mitigate damage and restore safe operation after harm has occurred. Finally, we operationalize the insights gained from our user study and dataset by training a reward model that reranks candidate recovery plans generated by an agent scaffold at test time. Human evaluation shows our approach significantly outperforms rubric-based scaffolds and baseline by 45 and 120 Elo points, respectively, over all BackBench tasks. Notably, these gains persist even when building on Claude Sonnet 4.5 ( 3 ) , Anthropic’s most safety-aligned model, demonstrating that domain-specific preference alignment yields meaningful improvements beyond general safety tuning. In summary, this work makes three key contributions to post-execution agent safety: (1) we conduct a formative study revealing how human preferences for harm recovery vary systematically across contexts, distilling these insights into a multi-attribute evaluation framework; (2) we introduce BackBench , a benchmark of 50 realistic recovery scenarios spanning diverse computer-use harms that challenges agents to restore safe operation after failures; and (3) we demonstrate that training a reward model on context-dependent human preferences significantly improves recovery quality, outperforming both rubric-based approaches and the base model. Together, these contributions establish harm recovery as a critical dimension of agent safety and demonstrate that context-dependent human preferences are essential for effective remediation. Figure 1: Harm Recovery for Computer Use Agents. An agent installs a seemingly routine software update that turns out to be malicious, leading to system compromise. Several recovery options (e.g., system restore, antivirus sweep, network quarantine) illustrate the challenge of weighting different attributes people consider (e.g. effectiveness, efficiency, communication) when choosing strategies that effectively remediate harm. 2 Related Work Computer Use Agents. LMs and vision–language models (VLMs) have created agents capable of operating in open-ended software environments with real-world consequences. Prior work has taken the approach of prompting LLMs directly as policy ( 25 ) or value ( 24 ) functions, and integrating them into structured agentic frameworks by augmenting them with tool use capabilities ( 10 ) . Improving agent capabilities typically involves either retraining the underlying LLM on task-specific data or incorporating scaffolding that enhances search ( 15 ) , planning ( 13 ) , and reasoning ( 19 ) without modifying the base model. Harm recovery is fundamentally a higher-order planning problem that presupposes reliable execution of lower-level actions such as clicking, typing, and navigating interfaces. In practice, reliable GUI interaction often requires proprietary frontier models ( 22 ) , making direct fine-tuning for harm recovery behavior technically infeasible or prohibitively expensive. As such, we contribute a sub-policy scaffold that assumes the primary policy has detected harm and delegates control to a dedicated recovery subroutine. Agent Safety and Value Alignment. Alignment research treats safety as a core value for LMs. In RLHF, annotators are instructed to prefer safe outputs ( 17 ) , which inform reward models or direct optimization ( 4 ) . Constitutional

Read the complete text