gigiProfiler: Diagnosing Performance Issues by Uncovering Application Resource Bottlenecks

Yigong Hu, Haodong Zheng, Yicheng Liu, Dedong Xie, Youliang Huang, Baris Kasikci · 2025

Read gigiProfiler: Diagnosing Performance Issues by Uncovering Application Resource Bottlenecks by Yigong Hu, Haodong Zheng, Yicheng Liu, Dedong Xie, Youliang Huang, Baris Kasikci (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06452.txt.

Introduction

A profiler that hunts app-level resource jams is built by Yigong Hu and co-authors in a 2025 arXiv paper. Old profilers trace system loads well but miss waits on app-made resources. Their tool, gigiProfiler, pairs a chat model with static code reads to find such resources ahead of time. It then logs key values in bad runs and sets them against good runs.

Twelve real slow-downs across five apps were all pinned right. Two fresh, unsolved cases were cracked and backed by the apps' own coders. Root causes, not just hot spots, are the prize.

Catalog record

CREATORYigong Hu, Haodong Zheng, Yicheng Liu, Dedong Xie, Youliang Huang, Baris Kasikci
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-06452

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

gigiProfiler: Diagnosing Performance Issues by Uncovering Application Resource Bottlenecks Yigong Hu, Haodong Zheng, Yicheng Liu, Dedong Xie, Youliang Huang, Baris Kasikci Abstract Abstract Diagnosing performance bottlenecks in modern software is essential yet challenging, particularly as applications become more complex and rely on custom resource management policies. While traditional profilers effectively identify execution bottlenecks by tracing system-level metrics, they fall short when it comes to application-level resource contention caused by waiting for application-level events. In this work, we introduce OmniResource Profiling , a performance analysis approach that integrates system-level and application-level resource tracing to diagnose resource bottlenecks comprehensively. gigiProfiler , our realization of OmniResource Profiling , uses a hybrid LLM-static analysis approach to identify application-defined resources offline and analyze their impact on performance during buggy executions to uncover the performance bottleneck. gigiProfiler then samples and records critical variables related to these bottleneck resources during buggy execution and compares their value with those from normal executions to identify the root causes. We evaluated gigiProfiler on 12 real-world performance issues across five applications. gigiProfiler accurately identified performance bottlenecks in all cases. gigiProfiler also successfully diagnosed the root causes of two newly emerged, previously undiagnosed problems, with the findings confirmed by developers. 1. Introduction Diagnosing performance issues in modern software is both essential and challenging, particularly as applications grow more complex. Among various performance issues, resource bottlenecks, caused by poor resource management, inefficient algorithms, or contention between application components, are especially difficult to diagnose. Identifying these bottlenecks requires understanding not only where resources are consumed but also how contention arises from interactions within the application. Developers often turn to state-of-the-art profilers ( Ren et al. 2023 ; Zhou et al. 2018 ; Weng et al. 2023 ; Curtsinger and Berger 2015 ; Attariyan et al. 2012 ) to analyze execution time and locate potential bottlenecks. For example, CoZ ( Curtsinger and Berger 2015 ) identifies optimization opportunities by analyzing causal relationships in program execution, while relational debugging ( Ren et al. 2023 ) captures and reasons about the causal relationships between input and output events to diagnose performance issues. However, these tools often fail to capture the interactions within applications that are critical to diagnosing performance issues. Many performance issues are caused by application-defined resource contention ( MySQL 2015 ; Percona 2017b ; MySQL 2020 ) such as buffer pool evictions or log contention, which are often overlooked. Previous studies ( Percona 2017a ; Hu et al. 2023 ; Yhuelf 2021 ; Percona 2023 ) have shown that these interactions are essential for understanding the root causes of performance degradation. Without a tool that captures application-level resource interactions, developers are forced to rely on their own understanding of the software or manually add instrumentation to trace resource usage and contention, making the process both time-consuming and error-prone. (a) Pseudo code of a resource contention issue in MySQL. (b) OmniResource profiling to diagnose the contention. Figure 1 . (a) Example of resource contention in program logic. (b) Diagnosing the contention using OmniResource Profiling. Figure 1(a) shows the pseudocode of a real-world performance issue ( Percona 2017b ) in MySQL. When the buf is dirty, thread B must call funcB to clean it, a process that takes approximately 50 ms. During this cleanup, thread A, which is processing a request, must wait for the buf to become available. Thread A periodically checks the flag and yields execution until the cleanup is complete. As a result, the request in thread A takes 70 ms to finish instead of the expected 20 ms. The root cause of this issue is frequent writes by other threads to the buf , marking it as dirty and creating buffer pool contention. To identify the root cause of this performance issue, developers must locate the buffer contention between thread A and thread B, as well as determine which threads are marking buf as dirty. Unfortunately, existing tools are limited to reporting system-level waiting events (e.g., lock or I/O wait times). However, in this case, there are no explicit system-level waiting events—thread A simply sleeps while repeatedly checking the is_dirty flag, and the contention arises entirely from application-level logic. While manually identifying resource contention in a simple example like Figure 1 may be manageable, it becomes challenging for developers to locate the root cause in large-scale, complex software. This paper proposes OmniResource Profiling , which integrates system-level and application-level resource tracing to diagnose application resource bottlenecks. The key idea is to trace application resources with the same level of detail as system resources to identify bottlenecks comprehensively. Figure 1(b) shows how OmniResource Profiling is used to diagnose the root cause of contention on buf . OmniResource Profiling first identifies buf as application resource and traces its usage. It records that the thread A is waiting on thread B and the time spent in thread B is in funB . A core challenge in enabling OmniResource Profiling is accurately identifying application-defined resources and their usage. These resources are often deeply embedded within the internal logic of the application and are not directly observable by external monitoring tools. Moreover, their design and implementation are tightly coupled with application-specific semantics and developer preferences, leading to a lack of common code patterns. Consequently, traditional static analysis techniques face significant challenges in accurately and efficiently detecting these resources. Static analysis must either extend its coverage to include a wide range of application-level code patterns, risking false positives, or limit its scope to specific patterns and rely on manual annotations, which reduces coverage. Both approaches significantly limit their effectiveness in diagnosing performance issues. Our key insight is that application-defined resources’ information can be inferred from program metadata, such as function definitions, comments, and documentation. Based on this, we propose a hybrid approach that combines large language models (LLMs) with static analysis to accurately identify application-defined resources and their usage. LLMs analyze metadata to infer high-level application semantics, enabling broad coverage in identifying potential resources and usage. Static analyzer then validates these inferred results, ensuring accuracy by leveraging precise code patterns. By dividing the task into two steps—LLMs for high coverage and static analysis for validation—the approach overcomes the traditional trade-off static analysis faces between coverage and accuracy. This combination allows the hybrid method to achieve comprehensive resource discovery and precise identification, making it particularly effective for diagnosing performance issues. To show the effectiveness of OmniResource Profiling , we developed a tool called gigiProfiler . Using the hybrid LLM-static analysis approach described earlier, gigiProfiler identifies application-defined resources and their operator functions offline. After this step, gigiProfiler runs a buggy execution to uncover performance bottlenecks and associates them with the identified resources. Beyond identifying bottleneck resources, gigiProfiler seeks to explain why the contention occurs in the code. To achieve this, gigiProfiler records the values of critical variables related to these resources during the buggy execution. These recorded values are then compared with those from a normal execution to identify anomalies. For example, to understand why buf is frequently marked as dirty, gigiProfiler samples and records the value of buf->dirty during buggy and normal executions. By comparing these samples, OmniResource Profiling reveals that in the buggy execution, the value of buf->dirty is frequently modified by specific client threads absent in the normal

Read the complete text