V-Droid : Advancing Mobile GUI Agent Through Generative Verifiers
Gaole Dai, Shiqi Jiang, Ting Cao, Yuanchun Li, Yuqing Yang, Rui Tan, Mo Li, Lili Qiu · 2025
Read V-Droid : Advancing Mobile GUI Agent Through Generative Verifiers by Gaole Dai, Shiqi Jiang, Ting Cao, Yuanchun Li, Yuqing Yang, Rui Tan, Mo Li, Lili Qiu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15937.txt.
Introduction
Gaole Dai and seven co-authors present a phone-operating agent with a twist in a 2025 paper. Most mobile agents let a language model pick each tap directly. Their agent, V-Droid, instead has the model act as a verifier: it scores candidate actions and picks the best before anything is tapped.
The team built the supporting pieces: a cleaned-up action space, a fast check-only workflow, and training that teaches the verifier from pairwise progress judgments. Human and agent annotators together gathered the needed data at scale. V-Droid beat rival agents on three public benchmarks, with success rates near sixty percent on the hardest. It also ran each step in about four seconds, six times faster than earlier agents.
Catalog record
| CREATOR | Gaole Dai, Shiqi Jiang, Ting Cao, Yuanchun Li, Yuqing Yang, Rui Tan, Mo Li, Lili Qiu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-15937
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
V-Droid : Advancing Mobile GUI Agent Through Generative Verifiers Gaole Dai, Shiqi Jiang, Ting Cao, Yuanchun Li, Yuqing Yang, Rui Tan, Mo Li, Lili Qiu Abstract . We propose V-Droid , a mobile GUI task automation agent. Unlike previous mobile agents that utilize Large Language Models (LLMs) as generators to directly generate actions at each step, V-Droid employs LLMs as verifiers to evaluate candidate actions before making final decisions. To realize this novel paradigm, we introduce a comprehensive framework for constructing verifier-driven mobile agents: the discretized action space construction coupled with the prefilling-only workflow to accelerate the verification process, the pair-wise progress preference training to significantly enhance the verifier’s decision-making capabilities, and the scalable human-agent joint annotation scheme to efficiently collect the necessary data at scale. V-Droid obtains a substantial task success rate across several public mobile task automation benchmarks: 59.5% on AndroidWorld, 38.3% on AndroidLab, and 49% on MobileAgentBench, surpassing existing agents by 5.2%, 2.1%, and 9%, respectively. Furthermore, V-Droid achieves a remarkably low latency of 4.3s per step and 0.7s per decision, which are 6.1 × 6.1\times and 32.1 × 32.1\times faster compared with existing mobile agents. The source code is available at https://github.com/V-Droid-Agent/V-Droid . Conference: The 32nd Annual International Conference on Mobile Computing and Networking; October 26–30, 2026; Austin, TX, USA The 32nd Annual International Conference on Mobile Computing and Networking (MobiCom ’26), October 26–30, 2026, Austin, TX, USA DOI: 10.1145/3795866.3796681 ISBN: 979-8-4007-2505-0/2026/10 CCS: Human-centered computing Ubiquitous and mobile computing CCS: Computing methodologies Artificial intelligence † † cc-license: by 1. Introduction Controlling mobile devices via natural language has been a longstanding aspiration in the mobile domain ( Wen et al., 2024a ; Lee et al., 2024 ; Wen et al., 2024b ; Shvo et al., 2021 ) , promising opportunities to automate repetitive tasks and elevate user convenience. Unlike API-based agents that rely on predefined function calls ( Li et al., 2023 ; Chen and Li, 2024 ) , mobile GUI agents simulate human interactions, allowing them to operate across diverse applications through Graphical User Interface (GUI). However, developing such an agent poses significant challenges: it needs to not only interpret on-screen content but also make reasonable decisions to execute multi-step tasks within dynamic and complex GUI environments. In recent years, a variety of LLM-powered mobile GUI agents have been proposed ( Wen et al., 2024a ; Agashe et al., 2025 ; Qin et al., 2025 ; Gou et al., 2025 ; Zheng et al., 2024 ; Wang et al., 2024c ; Wang et al., 2024e ; Hong et al., 2024 ; Yang et al., 2024 ) . These agents typically utilize LLMs as generators , generating decisions ( e.g., reasoning and actions) based on the current task states ( e.g., user interfaces, task descriptions), leveraging the contextual understanding and reasoning abilities inherent to LLMs. These agents, however, fall short of meeting practical deployments. Fig. 2 presents the performance of state-of-the-art (SOTA) mobile agents in terms of task success rate (SR) and stepwise latency on the AndroidWorld ( Rawles et al., 2024 ) . As shown, the highest SR achieved by existing agents is only 54.3%, significantly lower than the human performance of 80%. Additionally, latency remains a critical challenge. Agent-S2 ( Agashe et al., 2025 ) , powered by GPT-4o and UI-TARS-72B ( Qin et al., 2025 ) , takes over 25 seconds for a single step. Figure 1 . Task success rate and latency per step of current mobile agents 2 2 2 The task success rate achieved by GPT-4 and 4o, Claude, Llama, Gemini and Qwen is measured with the default prompt templates i.e., T3A and M3A, in AndroidWorld benchmark. and V-Droid evaluated on AndroidWorld benchmark. The latency of 2B, 7B and 8B agents are measured on 2\times Nvidia 4090. For 72B or MoE agents, the latency is measure on 4\times Nvidia A100 80G. The suboptimal SR is predominantly hindered by the limited decision-making capabilities of existing agents when performing mobile tasks. While techniques such as prompt engineering ( Wen et al., 2024a ; Wei et al., 2022 ) and GUI fine-tuning ( Gou et al., 2025 ; Yang et al., 2024 ; Qin et al., 2025 ) are commonly employed, these methods primarily focus on enhancing general performance of LLM, such as instruction-following, or refining agents’ adaptability to mobile interfaces. However, they fail to adequately address task-specific, multi-step decision-making challenges, particularly in the context of mobile GUI control. The high latency of existing mobile agents primarily stems from the autoregressive decoding mechanism of LLMs. These agents generate multiple tokens sequentially for each decision at every step. For instance, SeeAct ( Zheng et al., 2024 ) generates around 100 tokens per step for one decision. Moreover, techniques like Chain-of-Thought (CoT) ( Wei et al., 2022 ) and ReAct ( Yao et al., 2023 ) are widely employed to enhance reasoning and mitigate hallucination, further increasing output length, worsening latency issues. The fundamental research problem in developing practical mobile agents lies in enhancing their decision-making capabilities for mobile tasks while simultaneously maintain reasonable latency. To achieve this goal, we introduce V-Droid , which, as illustrated in Fig. 2 , achieves a marked improvement in task success rate, refreshing the record to 59.5% on the AndroidWorld benchmark, while achieves 6.1\times speed up on the step-wise latency. The key idea behind V-Droid is transforming the paradigm of mobile agents by using LLM as verifiers instead of generators , which is illustrated in Fig. 2 : rather than directly generating the final decision, when LLMs are used as verifiers, potential actions are first extracted. The verifier-driven agents then explicitly evaluate each candidate action e.g., by prompting, " Is action X helpful for completing the task ?" Following these evaluations, the agent selects the action with the highest value, e.g., the likelihood of generating a ’Yes’ token. Essentially, the verifier-driven architecture decouples one action decision-making process into two discrete processes: action extraction and action verification. This decoupling offers substantial advantages for advancing mobile agents: (i) Intuitively, verifying an answer is much easier than generating one from scratch, a phenomenon known as the generation-verification gap ( Song et al., 2025 ; Lightman et al., 2023 ) . Instead of directly making decisions within an expansive and infinite action space, the verifier-driven agent evaluates actions within an extractable and enumerable space, thereby simplifying the decision-making process. More importantly, for mobile devices, the interactive UI elements is rather limited (see § 2.2 ) at each task step. (ii) The verification process typically requires generating fewer tokens, such as simple outputs like "Yes" or "No", which dramatically reduces latency. Moreover, actions to be verified can be processed in batches, fully leveraging hardware parallelism and further improving efficiency. However, to fully unleash the potential of verifier-driven mobile agents, several technical challenges must be addressed: (i) Effectively extracting action from UI and constructing clean and complete action space, while efficiently verifying multiple available actions at each task execution step. (ii) Designing effective training methods for the verifier to improve decision-making capabilities, particularly since directly utilizing pre-trained LLMs as verifiers is inadequate as detailed in § 2.2 . (iii) Collecting and organizing the necessary data to support the training process at scale. To address these challenges,