GAIA: A Data Flywheel System for Training GUI Test-Time Scaling Critic Models
Shaokang Wang †, Pei Fu†, Ruoceng Zhang, Shaojie Zhang, Xiuwen Xi · 2026
Read GAIA: A Data Flywheel System for Training GUI Test-Time Scaling Critic Models by Shaokang Wang †, Pei Fu†, Ruoceng Zhang, Shaojie Zhang, Xiuwen Xi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18197.txt.
Introduction
Shaokang Wang and co-authors build a data flywheel that trains critic models for screen agents. Their 2026 preprint presents GAIA. Vision-language models have made GUI agents far better at reading screens and following instructions. One flaw stands out: agent actions cannot be undone. A single wrong click can cascade into a failed or harmful run. Critic models that judge actions before they run could catch such errors, and test-time scaling lets agents try more options.
GAIA gathers data in a loop that keeps improving those critics. Better critics make safer, more reliable agents. The flywheel idea ties data growth to model growth. The work targets a trust problem at the heart of computer-using AI.
Catalog record
| CREATOR | Shaokang Wang †, Pei Fu†, Ruoceng Zhang, Shaojie Zhang, Xiuwen Xi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18197
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
GAIA: A Data Flywheel System for Training GUI Test-Time Scaling Critic Models Shaokang Wang †, Pei Fu†, Ruoceng Zhang, Shaojie Zhang, Xiuwen Xi Abstract While Large Vision-Language Models (LVLMs) have significantly advanced GUI agents’ capabilities in parsing textual instructions, interpreting screen content, and executing tasks, a critical challenge persists: the irreversibility of agent operations—where a single erroneous action can trigger catastrophic deviations. To address this, we propose the G UI A ction Cr i tic’s Dat a Flywheel System (GAIA), a training framework that enables the models to have iterative critic capabilities, which are used to improve the Test-Time Scaling (TTS) of basic GUI agents’ performance. Specifically, we train an Intuitive Critic Model (ICM) using positive and negative action examples from a base agent first. This critic evaluates the immediate correctness of the agent’s intended actions, thereby selecting operations with higher success probability. Then, the initial critic guides agent actions to collect refined positive/negative samples, initiating the self-improving cycle. The augmented data then trains a second-round critic with enhanced discernment capability. We conduct experiments on various datasets and demonstrate that the proposed ICM can improve the test-time performance of various closed-source and open-source models, and the performance can be gradually improved as the data is recycled. The code and dataset will be publicly released. 1 Introduction The automation of Graphical User Interface (GUI) interactions represents a critical frontier in developing intelligent digital assistants ( 43 ; 14 ; 29 ) . Recent breakthroughs in Large Vision-Language Models (LVLMs) ( 42 ; 1 ) , leveraging advanced post-training techniques, have substantially enhanced agents’ capabilities in interpreting natural language commands, perceiving visual elements, and executing multi-step tasks ( 12 ; 6 ) . Within this rapidly evolving landscape, the development of robust GUI agents has largely converged on two primary methodological paradigms. The first approaches ( 48 ; 52 ; 33 ; 22 ) train models through Supervised Fine-Tuning (SFT) to directly align their behavior with predefined task objectives. The second approaches employ Reinforcement Fine-Tuning (RFT) ( 26 ; 49 ; 23 ) , which significantly enhances generalization in complex tasks by adopting a reasoning format. Despite these advances, the dynamic and continuous nature of real-world GUI tasks means that agents can still produce ambiguous or incorrect action proposals at any step. A single mis-click or mis-typed output can be irreversible , derailing the entire workflow and leaving the system in an unrecoverable state. This high-stakes environment imperatively demands a mechanism for pre-execution validation. To avoid irreversible errors in execution and improve the performance of basic GUI agents during testing, previous studies have designed action verifiers for GUI agents ( 47 ; 50 ; 54 ) , which are used to judge and filter GUI agents’ actions. However, these existing implementations suffer from two primary limitations. First, training a correctness verifier requires defining positive and negative action samples. Existing work on defining negative samples relies on heuristic algorithms, such as randomly selecting click locations on the current screenshot ( 50 ) , which fails to capture the realistic action distribution and leads to suboptimal judgment performance. Second, the reasoning-based verifiers ( 45 ) implemented in existing work violate the intuitive properties of binary judgments. For an intuitive correctness judgment problem, biological research suggests that higher-level judgment pathways are often more adept than performing extensive multi-step reasoning ( 20 ; 31 ; 9 ) , which indicates that excessive reasoning can be less effective ( 2 ; 41 ) . Furthermore, reasoning-based judgment outputs more tokens, thereby reducing the efficiency of test-time scaling. (a) The promotion process of the critic model to the GUI Agent during testing. (b) Comparison of high-level task performance improvements on closed-source and open-source GUI Agents. Figure 1: Intuitive results. ICM guides agents’ action during testing, as shown in (a), thereby improving the agent’s accuracy, and is continuously improved by the data flywheel, as shown in (b). To fully leverage pre-execution evaluation to enhance GUI agent capabilities and execution correctness, we developed a G UI A ction Cr i tic’s Dat a Flywheel System (GAIA). This system comprises two core phases: the initialization phase (Phase 1) and the iteration phase (Phase 2), yielding the Intuitive Critic Model (ICM). In Phase 1 , we use real GUI agents to act on an existing dataset to collect positive and negative action data that are random but consistent with the behavior distribution. Using this binary-labeled action dataset, we train ICM to assess action correctness given environmental context. In Phase 2 , as illustrated in Figure 1 (a), ICM employs a Best-of-N approach to select the highest-probability correct actions from agent rollouts. While ICM guidance significantly improves action accuracy, challenging samples persist and produce errors. These difficult cases are annotated and fed back into the data flywheel. Through iterative data augmentation, the flywheel continuously incorporates new action samples, progressively covering challenging scenarios within the action space. Driven by this enriched dataset, we train an enhanced critic—Intuitive Critic Model on Round Two (ICM-r2)—which achieves higher discriminative accuracy for more precise behavioral guidance. This establishes a self-evolutionary virtuous cycle between the data flywheel and critic models, continuously improving GUI agent action accuracy. Leveraging the proposed system GAIA, ICM achieves SOTA performance in action critique. Naturally, we integrate it into Test-Time Scaling (TTS) ( 37 ; 5 ; 36 ; 32 ; 44 ; 40 ) during inference, where ICM evaluates stochastically generated actions from the TTS process, releasing only high-confidence operations surpassing predetermined thresholds for execution. To validate the framework’s general applicability, we conduct joint experiments using mainstream GUI Agents (including GPT-4o ( 15 ) and UI-TARS ( 33 ) ) on several GUI Agent benchmarks. As shown by the comparative results in Figure 1 (b), the guidance from our iteratively evolved critic models (ICM and ICM-r2) leads to significant performance improvements in basic GUI agents, including GUI operation task planning and grounding capabilities. Overall, the main contributions are summarized as follows: 1. We introduce GAIA—a novel Data Flywheel System designed for training GUI action-critic models. By iteratively curating positive and negative samples from real-world action data, GAIA continuously boosts model performance and robustness. 2. We propose the ICM for GUI interaction tasks, a critic model trained on data curated by our data flywheel. The ICM enhances the performance of existing GUI agents by employing a best-of-N approach to select the most probable correct action with TTS. This initial boost is then continuously refined as the ICM’s discriminatory accuracy is iteratively improved by the data flywheel. 3. We comprehensively demonstrate across multiple datasets that ICM trained with our proposed GAIA system significantly enhances the overall performance of both closed-source and open-source GUI agents. 2 Related Work 2.1 GUI Agent The development of autonomous agents powered by LLMs and LVLMs has significantly advanced interactive functionalities within digital environments. Early GUI systems primarily leveraged LLMs to interpret structured representations ( 12 ; 30 ; 38 ) . The development of LVLM simplifies the paradigm, allowing GUI agents to receive raw visual signals from the screenshots ( 14 ; 21 ; 35 ; 39 ; 7 ; 59 ; 10 ; 48 ) . Recent efforts, such as Aguvis ( 52 ) and UI-TARS ( 33 ) ,