Do Phone-Use Agents Respect Your Privacy?

Zhengyang Tang, Ke Ji, Xidong Wang, Zihan Ye, Xinyuan Wang, Yiduo Guo, Ziniu Li, Chenxin Li, Jingyuan Hu, Shunian Chen, Tongxu Luo, Jiaxi Bi, Zeyu Qin, Shaobo Wang, Xin Lai, Pengyuan Lyu, Junyi Li, Can Xu, Chengquan Zhang, Han Hu, Ming Yan, Benyou Wang · 2026

Read Do Phone-Use Agents Respect Your Privacy? by Zhengyang Tang, Ke Ji, Xidong Wang, Zihan Ye, Xinyuan Wang, Yiduo Guo, Ziniu Li, Chenxin Li, Jingyuan Hu, Shunian Chen, Tongxu Luo, Jiaxi Bi, Zeyu Qin, Shaobo Wang, Xin Lai, Pengyuan Lyu, Junyi Li, Can Xu, Chengquan Zhang, Han Hu, Ming Yan, Benyou Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-00986.txt.

Introduction

Tang and colleagues ask whether phone-use agents respect privacy on benign mobile tasks, introducing MyPhoneBench, a verifiable evaluation framework built on a minimal privacy contract called iMy. Privacy-respecting use means permissioned access, minimal disclosure, and user-controlled memory, checked by mock apps and rule audits. Across five frontier models on 10 apps and 300 tasks, no model leads on all three: task success, privacy-compliant completion, and later use of saved preferences. The most persistent failure is filling optional personal entries the task does not require.

Catalog record

CREATORZhengyang Tang, Ke Ji, Xidong Wang, Zihan Ye, Xinyuan Wang, Yiduo Guo, Ziniu Li, Chenxin Li, Jingyuan Hu, Shunian Chen, Tongxu Luo, Jiaxi Bi, Zeyu Qin, Shaobo Wang, Xin Lai, Pengyuan Lyu, Junyi Li, Can Xu, Chengquan Zhang, Han Hu, Ming Yan, Benyou Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36254
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.00986

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Do Phone-Use Agents Respect Your Privacy? Zhengyang Tang, Ke Ji, Xidong Wang, Zihan Ye, Xinyuan Wang, Yiduo Guo, Ziniu Li, Chenxin Li, Jingyuan Hu, Shunian Chen, Tongxu Luo, Jiaxi Bi, Zeyu Qin, Shaobo Wang, Xin Lai, Pengyuan Lyu, Junyi Li, Can Xu, Chengquan Zhang, Han Hu, Ming Yan, Benyou Wang Abstract We study whether phone-use agents respect privacy while completing benign mobile tasks. This question has remained hard to answer because privacy-compliant behavior is not operationalized for phone-use agents, and ordinary apps do not reveal exactly what data agents type into which form entries during execution. To make this question measurable, we introduce MyPhoneBench , a verifiable evaluation framework for privacy behavior in mobile agents. We operationalize privacy-respecting phone use as permissioned access, minimal disclosure, and user-controlled memory through a minimal privacy contract, iMy , and pair it with instrumented mock apps plus rule-based auditing that make unnecessary permission requests, deceptive re-disclosure, and unnecessary form filling observable and reproducible. Across five frontier models on 10 mobile apps and 300 tasks, we find that task success, privacy-compliant task completion, and later-session use of saved preferences are distinct capabilities, and no single model dominates all three. Evaluating success and privacy jointly reshuffles the model ordering relative to either metric alone. The most persistent failure mode across models is simple data minimization: agents still fill optional personal entries that the task does not require. These results show that privacy failures arise from over-helpful execution of benign tasks, and that success-only evaluation overestimates the deployment readiness of current phone-use agents. All code, mock apps, and agent trajectories are publicly available at https://github.com/FreedomIntelligence/MyPhoneBench . Figure 1: Real-app examples of how a phone-use agent can cross privacy boundaries during a benign mobile task. 1 Introduction Phone-use agents, which operate smartphones through GUI interactions on behalf of users, are becoming deployment-relevant. Recent systems such as AutoGLM ( 8 ) , UI-TARS ( 12 ) , and Claude Computer Use ( 1 ) now exceed 70% task success on AndroidWorld ( 13 ) , while open-source frameworks such as OpenClaw ( 11 ) already manage messaging, email, and app interactions on real devices. As these systems become more capable, however, the central question is no longer only whether they can finish tasks. It is whether they handle user data responsibly while doing so. This question is easy to underestimate because the privacy risk does not require malicious users or adversarial instructions. A user can ask an agent to perform a completely benign task, such as ordering food, booking travel, or scheduling care, and the agent can still overstep: it may request access it did not need, disclose contact information to a plausible but unnecessary destination, or carry personal information across sessions without clear user control. The task succeeds, but privacy fails. Figure 1 shows a benign KFC ordering scenario in which an agent may proceed through phone-number login without explicit approval and later re-disclose the same number to a coupon pop-up. These are not benchmark-specific tricks but recurring privacy-risk structures in commercial mobile apps ( 5 ; 9 ) . In this paper, we focus on the subset of these failures that can be tested reproducibly in controlled apps. Current evaluation stacks are largely blind to exactly this behavior ( 13 ; 7 ; 3 ; 4 ) : they reward task completion but do not reveal whether agents requested extra permissions, filled optional personal entries, or re-submitted contact data to irrelevant widgets. Success-only evaluation therefore cannot tell us whether a phone-use agent respects privacy while being helpful. To answer this deployment question rigorously, two conditions are necessary. First, privacy compliance must be made explicit for phone-use agents. In this setting, privacy is not an abstract principle. It is a set of execution-time boundaries: which user data the agent may use by default, which data requires explicit user approval, and what information may be written into memory for later tasks. Without making these boundaries explicit, a privacy violation is difficult to define, compare, or audit. Second, the agent’s data handling during execution must be observable and auditable. Even with a clear privacy contract, ordinary apps do not reveal which values the agent typed into which entries, whether it filled optional entries and later backed out, or whether it re-disclosed data to a non-essential destination. Existing deterministic benchmarks mostly check page progress or end states ( 13 ; 7 ; 3 ) , while LLM-based judging ( 4 ) is too coarse for this level of auditing. We introduce MyPhoneBench to satisfy both: an explicit privacy contract paired with an auditable execution environment. Our goal is not to reproduce commercial apps pixel by pixel. It is to preserve recurring privacy-risk structures and make them auditable. The controlled apps in MyPhoneBench turn these structures into controlled measurements with deterministic checks at the level of individual form entries. More concretely, we make three contributions: 1. We operationalize privacy-respecting phone use as permissioned access, minimal disclosure, and user-controlled memory. We instantiate this through iMy , a minimal privacy contract that distinguishes default access from permission-gated access and gives users control over persistent memory across sessions. 2. We build a verifiable evaluation framework for privacy behavior in mobile tasks. This framework combines instrumented mock apps, structured privacy probes, and rule-based auditing to make these privacy-relevant behaviors observable and verifiable during task execution. 3. We show empirically that task success, privacy-compliant task completion, and later-session use of saved preferences are distinct capabilities in current frontier agents. Across five models, 10 apps, and 300 tasks, we find that no single model dominates all three axes. Together, these pieces turn behavioral privacy in phone-use agents into a measurable property rather than a vague concern. 2 Making Privacy Measurable in Phone-Use Agents We evaluate phone-use agents along three questions. First, can the agent finish the user’s task? Second, can it finish the task without crossing privacy boundaries during execution? Third, if the user allows memory, can the agent use a preference it saved earlier when that preference matters in a later session? Answering these questions requires more than checking the final app state. We need three pieces: (1) a privacy contract that defines what acceptable data handling looks like during execution, (2) app environments that record what the agent actually types during the task, and (3) controlled probes that expose recurring privacy-risk structures in a measurable way. The rest of this section describes how we build each piece and combine them into a single evaluation framework. Rather than reproduce the full privacy surface of commercial mobile apps, we preserve recurring privacy-risk structures in a reproducible form that can be audited deterministically at the level of individual form entries. 2.1 The iMy privacy contract We begin by making privacy compliance explicit. In phone-use tasks, privacy is not a vague norm. It is a set of execution-time boundaries: which user data the agent may use by default, which data requires explicit user approval, and what information may be saved for later tasks. We define a simple contract that makes these boundaries executable and call it the iMy privacy contract. iMy divides user data and apps into two categories. LOW means the agent may use the item by default during

Read the complete text