CovAgent : Overcoming the 30% Curse of Mobile Application Coverage with Agentic AI and Dynamic Instrumentation CCS: Software and its engineering Software testing and debugging
Wei Minn, Biniam Fisseha Demissie, Yan Naing Tun, Jiakun Liu, Mariano Ceccato, Lwin Khin Shar, David Lo · 2026
Read CovAgent : Overcoming the 30% Curse of Mobile Application Coverage with Agentic AI and Dynamic Instrumentation CCS: Software and its engineering Software testing and debugging by Wei Minn, Biniam Fisseha Demissie, Yan Naing Tun, Jiakun Liu, Mariano Ceccato, Lwin Khin Shar, David Lo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21253.txt.
Introduction
Wei Minn and six co-authors tackle a stubborn limit in automatic testing of Android apps. Good testing should visit as much of an app as it can. In practice, even the best current tools reach less than a third of an app's screens in real-world cases.
Their system, CovAgent, uses smart agents plus live changes to the running app. The agents plan what to try next, and the live tools let them get past screens that block simple scripts. The goal is to push coverage well past the old ceiling. Higher coverage means more bugs found before users ever see the app.
Catalog record
| CREATOR | Wei Minn, Biniam Fisseha Demissie, Yan Naing Tun, Jiakun Liu, Mariano Ceccato, Lwin Khin Shar, David Lo |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21253
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CovAgent : Overcoming the 30% Curse of Mobile Application Coverage with Agentic AI and Dynamic Instrumentation CCS: Software and its engineering Software testing and debugging Wei Minn, Biniam Fisseha Demissie, Yan Naing Tun, Jiakun Liu, Mariano Ceccato, Lwin Khin Shar, David Lo Abstract . Automated GUI testing is crucial for ensuring the quality and reliability of Android apps. However, the efficacy of existing UI testing techniques is often limited, especially in terms of coverage. Recent studies, including the state-of-the-art, struggle to achieve more than 30% activity coverage in real-world apps. This limited coverage can be attributed to a combination of factors such as failing to generate complex user inputs, unsatisfied activation conditions regarding device configurations and external resources, and hard-to-reach code paths that are not easily accessible through the GUI. To overcome these limitations, we propose CovAgent , a novel agentic AI-powered approach to enhance Android app UI testing. Firstly, our fuzzer-agnostic framework runs a standard and widely adopted GUI fuzzer such as APE and Fastbot to identify unreachable activities. Then, those unreachable activities are analyzed by an AI agent that inspects the app’s decompiled smali code and component transition graph, and reasons about unsatisfied activation conditions within the app code logic that prevent access to the activities. Based on this analysis, another agent generates dynamic instrumentation scripts that are injected into the running app instance to satisfy activation conditions required for successful transitions to the target activity. In the evaluation, we show that augmenting existing fuzzing approaches with our framework achieves a significant improvement in test coverage. Compared to the state-of-the-art, LLMDroid, and other baselines such as Fastbot and APE, CovAgent achieves 101.1%, 116.3% and 179.7% higher activity coverage, respectively. CovAgent also outperforms all the baselines in other metrics such as class, method, and line coverage. We also conduct investigations into components within CovAgent to reveal further insights regarding the efficacy of Agentic AI in the field of automated app testing such as the agentic activation condition inference accuracy, and agentic activity-launching success rate. To foster further research and development in this area, we open-source CovAgent at ( rep 2026 ) . 1. Introduction Automated testing of Android apps is an active area of research nowadays. Android apps are event-driven programs with complex GUIs, and manual testing is labor-intensive and may overlook many corner cases. To automatically test Android apps, generating meaningful event sequences (e.g., add items to the shopping cart before checking out) and producing semantically meaningful inputs (e.g., math operators for a calculator app) are necessary ( Choudhary et al. 2015 ; Yu et al. 2024 ) . To fill the gap, researchers proposed a series of approaches to explore the app’s GUI components (e.g., activities, fragments, dialogs) randomly (e.g., Monkey ( Android 2024 ) ), systematically (e.g., A3E ( Azim and Neamtiu 2013 ) , Stoat ( Su et al. 2017 ) , Sapienz ( Mao et al. 2016 ) , APE ( Gu et al. 2019 ) ), and intelligently (e.g., Humanoid ( Li et al. 2019 ) ). In addition, some approaches leverage program analysis to understand the app’s code and generate test inputs accordingly ( Gu et al. 2019 ; Mahmood et al. 2014 ) . Recently, with the advance of large language models (LLMs), some approaches leverage LLMs to understand the app’s GUI and code and generate test inputs accordingly (e.g., DroidAgent ( Yoon et al. 2024 ) , GPTDroid ( Liu et al. 2024 ) , LLMDroid ( Wang et al. 2025a ) ). Yet, challenges remain in terms of code coverage as studies show that even the state-of-the-art tools struggle when testing industrial-scale apps ( Akinotcho et al. 2025 ; Wang et al. 2025a ) . Specifically, Akinotcho et al. ( Akinotcho et al. 2025 ) analyzed 103 industrial-scale apps and reported 10 new reasons why current testing approaches “hit a ceiling” of 30% coverage. Specifically, the launch of these activities (1) needs the input from a third-party server, (2) needs to be accessed from the alternate entry (rather than starting from the main activity), (3) needs external resources (e.g., another equipments or additional information), (4) is disabled for a version or user, (5) is triggered by errors, (6) needs specific hardware/software, (7) needs certain environment (e.g., location), (8) needs a certain usage pattern (e.g., the number of times the users switch the channel), (9) requires the launch of the caller activity, and (10) is impossible because no entry point triggering the activity. Theoretically, if we could design a tool to solve these constraints automatically, we could break the 30% coverage curse. We take Samsung Smart Switch app’s IosOtgContentsListActivity activity as an example, which is not reachable by existing tools and is used to transfer app data between the device and an SD card. To launch this activity, following the suggestion provided by Akinotcho et al. ( Akinotcho et al. 2025 ) , we need to: C1) Identify the activation conditions (e.g., guard conditions, and launch sites) of the unreachable activities. We observe that the IosOtgContentsListActivity contains a guard condition that checks for connection to SD card and terminates if there is no connection. Listing depicts decompiled Smali assembly code of the onCreate lifecycle hook inside ContentsListBaseActivity which is the parent class of IosOtgContentsListActivity . Line 14 calls ShowNeedSdCardPopup sub-procedure and line 15 stores its return value into v0 . Afterwards, the conditional statement line 18 is the guard condition that checks if the return value stored in v0 is true or False . If v0 is true from ShowNeedSdCardPopup , the onCreate procedure terminates immediately by calling the return statement in line 11, and the activity will not be successfully launched. To identify this kind of code-level activation conditions, the latest work by Akinotcho et al. ( Akinotcho et al. 2025 ) involves decompiling the app’s APK file using JADX decompiler ( jad 2026 ) for the authors to manually inspect the decompiled code of the app, and identify guard conditions. Not only this is time-consuming and labour-intensive, it also requires the analysts to possess thorough knowledge of the app’s features and user scenarios, and how they could be represented inside the decompiled code. ⬇ 1 // Inside ContentsListBaseActivity . smali 2 . class public abstract ContentsListBaseActivity ; 3 . super ActivityBase ; 4 . source " ContentsListBaseActivity . java " 5 ... 6 . method protected onCreate ( Landroid / os / Bundle ;) V 7 ... 8 // logic for terminating 9 : cond_0 10 : goto_0 11 return - void 12 ... 13 // calling subprocedure 14 invoke - virtual { p0 }, ContentsListBaseActivity ;-> ShowNeedSdCardPopup () Z 15 move - result v0 16 ... 17 // guard condition to check the return value 18 if - nez v0 , : cond_0 19 ... 20 ... 21 22 // Inside IosOtgContentsListActivity . smali 23 . class public IosOtgContentsListActivity ; 24 . super ContentsListBaseActivity ; 25 . source " IosOtgContentsListActivity . java " 26 ... Listing 1: onCreate lifecycle hook of ContentsListBaseActivity that is defined inside ContentsListBaseActivity.smali and is the parent class of IosOtgContentsListActivity defined inside IosOtgContentsListActivity.smali C2) Develop techniques for generating data values needed for successful activation of an activity. We observe that the onCreate of