TraceLens : Question-Driven Debugging for Taint Flow Understanding
Burak Yetiştiren, Hong Jin Kang, Miryung Kim · 2025
Read TraceLens : Question-Driven Debugging for Taint Flow Understanding by Burak Yetiştiren, Hong Jin Kang, Miryung Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-07198.txt.
Introduction
Burak Yetiştiren, Hong Jin Kang, and Miryung Kim build a question-driven debugger for taint analysis. Taint tools track risky data as it flows through an app and its libraries. Users need to ask why a flow showed up or why one is missing. Their tool, WhyFlow, lets users pose why, why-not, and what-if questions in plain form.
What-if runs test how changes to sources, sinks, or library models shift all flows at once. A study with twelve users compared the tool with a standard query system. Users of the new tool scored twenty-one percent higher on flow tasks. They also felt far less mental strain and more trust in their finds. The authors frame inquiry as the core of sense-making here.
Catalog record
| CREATOR | Burak Yetiştiren, Hong Jin Kang, Miryung Kim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-07198
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
TraceLens : Question-Driven Debugging for Taint Flow Understanding Burak Yetiştiren, Hong Jin Kang, Miryung Kim Abstract Taint analysis is a security analysis technique used to track the flow of potentially dangerous data through an application and its dependent libraries. Investigating why certain unexpected flows appear and why expected flows are missing is an important sensemaking process during end-user taint analysis. Existing taint analysis tools often do not provide this end-user debugging capability, where developers can ask why , why-not , and what-if questions about dataflows and reason about the impact of configuring sources and sinks, and models of 3rd-party libraries that abstract permissible and impermissible data flows. Furthermore, a tree-view or a list-view used in existing taint-analyzer’s visualization makes it difficult to reason about the global impact on connectivity between multiple sources and sinks. Inspired by the insight that sensemaking tool-generated results can be significantly improved by a QA inquiry process, we propose TraceLens , a first end-user question-answer style debugging interface for taint analysis. It enables a user to ask why , why-not , and what-if questions to investigate the existence of suspicious flows, the non-existence of expected flows, and the global impact of third-party library models. TraceLens performs speculative what-if analysis, to help a user in debugging how different connectivity assumptions affect overall results. A user study with 12 participants shows that participants using TraceLens achieved 21% higher accuracy on average, compared to CodeQL. They also reported a 45% reduction in mental demand (NASA-TLX) and rated higher confidence in identifying relevant flows using TraceLens . This shows TraceLens ’s potential to significantly reduce sensemaking effort. Figure 1: TraceLens supports interrogative debugging by enabling a user to ask why , why-not , and what-if questions about taint-analysis. A user can select one among templated queries (shown in Q ) and contextualize their inquiry with respect to a specific source, sink, and 3rd party library model using a drop-down menu, shown in ( D-SRC ), ( D-SNK ), and ( D-API ). Once configured, a background question-and-answer analysis is conducted to help a user with their sensemaking process of taint analysis results. To aid in their sensemaking process about global connectivity, permissible and impermissible data flows, a user can see the result in a graph view ( G ) with color-code annotation. I Introduction To prevent security vulnerabilities, developers use taint analysis. This technique tracks potentially dangerous data as it moves through a program. Data from untrusted sources, like user input, is marked as "tainted" The analysis then monitors how this tainted data spreads. If it reaches a critical point in the code, known as a "taint sink," a warning is generated. Tainted data can be made safe by "sanitizers," which are functions that clean or encode the data. For example, the java.net.URLEncoder.encode(String input, String encoding) function escapes potentially harmful characters, preventing security issues. Since analyzing the entire program is usually impossible, practical taint analysis requires configuring simplified models of external libraries [ 1 ] . These models abstract the behavior of third-party libraries, allowing an analysis to track taint flow without analyzing the libraries’ internals. Taint analysis tools often come with default configurations, including pre-built models of external libraries . However, these default models, often automatically generated, can be inaccurate. This is because they rely on assumptions, which may be incorrect, about how libraries handle data flow. Incorrect configurations can lead to significant problems. For example, if a model incorrectly allows tainted data to flow through a library function that should sanitize it, the analysis will produce unexpected taint flows (i.e, false positives) [ 2 , 3 ] . This means it will report potential vulnerabilities that do not actually exist, creating extra, unexpected warnings for the user. Conversely, if a model incorrectly blocks the flow of tainted data when it should not, the analysis will produce missing flows (i.e., false negatives). This means it will miss real vulnerabilities, failing to report flows expected by the user. This paper focuses on end-user debugging of taint analysis that do not match a user’s expectations, in other words, debugging an end-user configuration, as opposed to debugging a taint analysis implementation. To correct configuration errors, developers must understand the impact of configuration on tool-generated warnings. This sensemaking process involves tracing the reported dataflows, understanding why specific warnings are generated, and how these warnings relate to the models of third-party libraries. We introduce TraceLens , a novel end-user debugger that brings interactive, question-based sensemaking to taint analysis. Drawing inspiration from interrogative debugging principles, TraceLens enables developers to ask why , why not , and what if questions about their analysis configuration. TraceLens provides six customizable question templates, which are then concretized by a user. A user can make sense of currently detected taint flows and hypothetical flows through interactive QA. Unlike state-of-the-art tools like CodeQL that rely on list views, TraceLens visualizes these reported and hypothetical flows graphically, offering a more intuitive understanding of configuration changes. Below, we discuss two key features, Inquiry-based Sensemaking and Visualization of Global Impact in detail. Inquiry-based Sensemaking. To effectively debug taint analysis results, developers need to investigate why specific dataflows are reported and why others are not. Unfortunately, many tools don’t allow developers to interactively ask questions about these flows. Furthermore, to efficiently narrow down their analysis, developers must understand how modifying the models of external libraries impacts the permitted or blocked dataflows. In the Query Options pane of TraceLens (shown in Figure 1 ), users can select from pre-defined question templates. These templates allow users to investigate taint analysis results by asking specific questions about dataflows. To make these questions concrete, users specify the configuration they are interested in, including the source of the data, the destination (sink), and the models of third-party libraries involved. For example, a user might choose the why-flow template, which asks, “why is there a taint flow from a source to a sink?” They can then concretize this question by specifying a specific source and sink. For instance, they could ask, “Which third-party library models currently allow taint flows from the source java.net.InetAddress.getHostName(...) to the sink org.apache.dubbo.metrics.model.ConfigCenterMetric.getTags(…) ?” Similarly, a user could select the why-not template, which asks, “Why is there no taint flow from a source to a sink?” They can then specify the source and sink of interest. For example, they could ask, “Which third-party library models could potentially block taint flows from the source msg:HttpRequest to the sink ErrorTypeAwareLogger.warn() ?” Alternatively, a user could also select the what-if template, which asks a speculative analysis question about “which sinks would no longer be reachable if third-party library models were to be configured as a sanitizer from source to sink?” Visualization of Global Impact. Once a user initiates a query within TraceLens , specifying their target source, sink, and any relevant external API calls, TraceLens generates an interactive graph visualization, providing a holistic view of the taint flow. This graph, as seen in the G pane of Figure 1 , visually maps the program’s taint flows as interconnected nodes, each representing a distinct stage in the taint flow. This visualization reveals the global impact of configuration choices through the network of connected nodes. To facilitate sensemaking, TraceLens employs a color-coded