Safe, or Simply Incapable? Rethinking Safety Evaluation for Phone-Use Agents

Zhengyang Tang, Yi Zhang, Chenxin Li, Xin Lai, Pengyuan Lyu, Yiduo Guo, Weinong Wang, Junyi Li, Yang Ding, Huawen Shen, Zhengyao Fang, Xingran Zhou, Liang Wu, Fei Tang, Sunqi Fan, Shangpin Peng, Zheng Ruan, Anran Zhang, Benyou Wang, Chengquan Zhang, Han Hu, [6pt] Tencent Hunyuan · 2026

Read Safe, or Simply Incapable? Rethinking Safety Evaluation for Phone-Use Agents by Zhengyang Tang, Yi Zhang, Chenxin Li, Xin Lai, Pengyuan Lyu, Yiduo Guo, Weinong Wang, Junyi Li, Yang Ding, Huawen Shen, Zhengyao Fang, Xingran Zhou, Liang Wu, Fei Tang, Sunqi Fan, Shangpin Peng, Zheng Ruan, Anran Zhang, Benyou Wang, Chengquan Zhang, Han Hu, [6pt] Tencent Hunyuan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-07630.txt.

Introduction

Zhengyang Tang and twenty co-authors ask an uncomfortable question about phone-use AI agents: when an agent avoids doing harm, is it being safe, or simply incapable? A dangerous action may be skipped because the agent spotted the risk, or because it could not work the screen at all. Existing evaluations usually cannot tell these apart.

Their benchmark, PhoneSafety, collects seven hundred safety-critical moments from real phone use across more than one hundred thirty apps. It scores whether the model acts safely, acts unsafely, or fails to act usefully. Testing eight agents, they found stronger general phone skill did not reliably mean safer choices, and that failures to act tracked capability rather than caution. A harmless outcome, they conclude, is not evidence of safety.

Catalog record

CREATORZhengyang Tang, Yi Zhang, Chenxin Li, Xin Lai, Pengyuan Lyu, Yiduo Guo, Weinong Wang, Junyi Li, Yang Ding, Huawen Shen, Zhengyao Fang, Xingran Zhou, Liang Wu, Fei Tang, Sunqi Fan, Shangpin Peng, Zheng Ruan, Anran Zhang, Benyou Wang, Chengquan Zhang, Han Hu, [6pt] Tencent Hunyuan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.07630

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Safe, or Simply Incapable? Rethinking Safety Evaluation for Phone-Use Agents Zhengyang Tang, Yi Zhang, Chenxin Li, Xin Lai, Pengyuan Lyu, Yiduo Guo, Weinong Wang, Junyi Li, Yang Ding, Huawen Shen, Zhengyao Fang, Xingran Zhou, Liang Wu, Fei Tang, Sunqi Fan, Shangpin Peng, Zheng Ruan, Anran Zhang, Benyou Wang, Chengquan Zhang, Han Hu, [6pt] Tencent Hunyuan Abstract When a phone-use agent avoids harm, does that show safety, or simply inability to act? Existing evaluations often cannot tell. A harmful outcome may be avoided because the agent recognized the risk and chose the safe action, or because it failed to understand the screen or execute any relevant action at all. These cases have different causes and call for different fixes, yet current benchmarks often merge them under task success, refusal, or final harmful outcome. We address this problem with PhoneSafety , a benchmark of 700 safety-critical moments drawn from real phone interactions across more than 130 apps. Each instance isolates the next decision at a risky moment and asks a simple question: does the model take the safe action, take the unsafe action, or fail to do anything useful? We evaluate eight representative phone-use agents under this framework. Our results reveal two main patterns. First, stronger general phone-use ability does not reliably imply safer choices at risky moments. Models that perform better on ordinary app tasks are not always the ones that behave more safely when the next action matters. Second, failures to do anything useful behave like a capability signal rather than a safety signal: they are concentrated in more visually and operationally demanding settings and remain stable when the evaluation protocol changes. Across models, failures split into two recurring patterns: unsafe choices in settings where the model can act but chooses wrongly, and inability to act in more visually and operationally demanding screens. Overall, a harmless outcome is not enough to count as evidence of safety. Evaluating phone-use agents requires separating unsafe judgment from inability to act. 1 Introduction Phone-use agents are moving beyond passive assistance toward systems that can directly operate smartphones for users 10 ; 9 ; 2 ; 18 . They can navigate apps, grant permissions, confirm transactions, send messages, and complete multi-step workflows across different interfaces. That shift creates a sharper safety problem than in text-only assistants. On a phone, one wrong tap can expose private information, approve a payment, grant an unnecessary permission, or trigger another irreversible action. As these agents become more operationally capable, it is no longer enough to ask whether they can complete tasks. We also need to know whether they make the right choice when the next action directly matters for safety. The difficulty is that harmless outcomes are easy to misread. When a phone-use agent does not cause harm at a risky moment, that may mean it recognized the safety boundary and chose correctly. But it may also mean that it failed to understand the screen, locate the relevant control, or produce any relevant action at all. From the outside, both outcomes can look equally harmless. They should not count as the same evidence. One reflects safe judgment. The other reflects inability to act. Figure 1 : Why harmlessness is ambiguous. A phone-use agent encounters a VIP subscription page while trying to download a song. Three qualitatively different next actions—safe, unsafe, and failing to do anything useful—can all produce a harmless outcome, but only the first is evidence of safety. Figure 1 illustrates this ambiguity with a concrete example. A user asks the agent to download a song, and the current screen is a subscription page that requires payment before download. The safe response is to stop and ask the user before paying. The unsafe response is to tap the subscription button and proceed. But there is also a third possibility: the agent leaves the page, taps elsewhere, or otherwise fails to interact meaningfully with the decision at hand. That outcome is harmless in the narrow sense that no payment is made, but it is not evidence that the agent made a safe choice. This is the core confound we study in this paper. Why does this distinction matter? Because the two harmless-looking outcomes imply very different kinds of systems. If a model can understand the interface, reach the relevant control, and still choose the wrong action, then the problem is one of judgment, policy following, or alignment. If a model avoids harm only because it cannot do anything useful, then that harmlessness is brittle. It may disappear as soon as the model becomes better at grounding the interface and executing actions. An evaluation that merges these cases can therefore overestimate weak models, misdiagnose stronger ones, and make it harder to tell what kind of improvement is actually needed. This ambiguity is difficult to resolve in task-level or episode-level safety evaluation. If we only ask whether a risky task was completed, refused, or ended without visible harm, we still do not know why the harmful outcome was avoided. The key question is not only what happened by the end of the episode, but what the agent did at the moment when the safety boundary became action-relevant. For this reason, we evaluate phone-use agents at safety-critical moments : interface states where the model’s next action can directly determine whether the interaction remains safe or becomes unsafe. We instantiate this idea in PhoneSafety , a benchmark of 700 safety-critical moments drawn from real phone interactions across more than 130 apps. The underlying trajectories provide realistic phone-use contexts and realistic interface states, not behavior targets that evaluated agents are expected to imitate. Our evaluation unit is the decision point itself. Given the user instruction, recent interaction history, and current screen context, the model must choose the next action at that moment. Each case is then interpreted through a simple three-way lens: the model may take the safe action, take the unsafe action, or fail to do anything useful at that decision point. This decomposition is the central methodological move of the paper. It separates safe choice from unsafe choice, and it also separates both from sheer inability to act. Across 8 representative models, we find that general phone-use capability does not reliably predict safe choices at risky moments, and that the third outcome—failing to do anything useful—behaves differently from unsafe choice: it tracks broader capability more closely, concentrates in operationally demanding screens, and remains stable when the safe/unsafe boundary is changed by protocol. These patterns suggest that failing to do anything useful should be interpreted differently from choosing an unsafe action. This paper identifies a central confound in phone-use agent evaluation—apparent harmlessness can reflect either safe choice or inability to act—and addresses it with PhoneSafety , a 700-case evaluation of safety-critical moments. Our results argue that safety evaluation for action-taking agents must distinguish unsafe judgment from inability to act, rather than treating all harmless outcomes as equivalent. A discussion of related work on GUI-agent safety benchmarks, attacks, and defenses appears in Appendix A . 2 Evaluating Safety-Critical Moments with PhoneSafety 2.1 Evaluation Unit: Safety-Critical Moments The evaluation unit in this paper is the safety-critical moment : a state in which the model’s next action can directly determine whether the interaction remains safe or

Read the complete text