Managing Data for Scalable and Interactive Event Sequence Visualization

Sayef Azad Sakin, Katherine E. Isaacs · 2025

Read Managing Data for Scalable and Interactive Event Sequence Visualization by Sayef Azad Sakin, Katherine E. Isaacs (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-03974.txt.

Introduction

Sayef Azad Sakin and Katherine Isaacs tackle slow charts of event sequences in a 2025 paper. Such charts show many timelines side by side, for tasks like tracing how a program ran. As data grows, simple acts like zooming or filtering start to lag, and quick summary tricks can distort what the chart shows.

Their system, called ESeMan, stores the data in layered structures and caches smartly, so a chart fetches only what it needs. The user can trade a little accuracy for speed when wanted. In tests on program traces, ESeMan beat three rival methods, pulling data in under a tenth of a second while keeping the picture accurate down to the pixel. The team also released their test harness for later work.

Catalog record

CREATORSayef Azad Sakin, Katherine E. Isaacs
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-03974

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Managing Data for Scalable and Interactive Event Sequence Visualization Sayef Azad Sakin, Katherine E. Isaacs Abstract Parallel event sequences, such as those collected in program execution traces and automated manufacturing pipelines, are typically visualized as interactive parallel timelines. As the dataset size grows, these charts frequently experience lag during common interactions such as zooming, panning, and filtering. Summarization approaches can improve interaction performance, but at the cost of accuracy in representation. To address this challenge, we introduce ESeMan (Event Sequence Manager), an event sequence management system designed to support interactive rendering of timeline visualizations with tunable accuracy. ESeMan employs hierarchical data structures and intelligent caching to provide visualizations with only the data necessary to generate accurate summarizations with significantly reduced data fetch time. We evaluate ESeMan’s query times against summed area tables, M4 aggregation, and statistical sub-sampling on a variety of program execution traces. Our results demonstrate ESeMan provides better performance, achieving sub-100ms fetch times while maintaining visualization accuracy at the pixel level. We further present our benchmarking harness, enabling future performance evaluations for event sequence visualization. \onlineid 1017 \vgtccategory Research \ieeedoi xx.xxxx/TVCG.201x.xxxxxxx \teaser Parallel timeline charts constructed from 160K events distributed across 49 processors (rows) of a parallel program. Individual gray boxes with darker borders represent single events. The upper left (a) shows a naive rendering of all of the data, while (b - d) show renderings from data fetches against our ESeMan solution configured with different levels of summarization. The naive solution requires 499 milliseconds (ms) for the data fetch, which is outside best practices for interactivity. Our ESeMan solution retrieves data for an equivalent chart in one tenth the time. Furthermore, ESeMan can be tuned to trade off accuracy for fetch time. For example, in (c), the summarization window is increased to 16 pixels, resulting in noticeable differences in the visualization (quantified by the SSIM score), but half the fetch time. We go further in (d), increasing the summarization window to 32 pixels for a significant decrease in data fetch time with further degradation to accuracy. (a) Raw Visualization, Horizontal Resolution = 3672, Data Fetch Time 499ms, Ground Truth (b) Summarized using ESeMan, Summarization window size = 1 pixel, Data Fetch Time 53ms, SSIM=1.00 (c) Summarized using ESeMan, Summarization window size = 16 pixels, Data Fetch Time 22ms, SSIM=0.74 (d) Summarized using ESeMan, Summarization window size = 32 pixels, Data Fetch Time 3ms, SSIM=0.67 Introduction keywords Event sequence visualization, temporal visualization, hierarchical summarization, hierarchical indexing Event sequence data is prevalent in domains like healthcare, manufacturing, and computer program monitoring where they are frequently analyzed for event progression, relative durations of events, and similarities between sequences in time. For example, in computing, execution traces are sequences of events describing computing activity per hardware resource and are used in identifying performance bottlenecks and assessing optimization of resource use [ 38 , 20 ] . In healthcare, patient timelines encode clinical events such as diagnoses, treatments, and medication administration; analyzing these sequences can inform personalized care decisions and improve treatment outcomes [ 4 , 14 ] . In manufacturing, managers track sequences of operations across distributed facilities to monitor progress, detect delays, and coordinate workflows [ 48 , 70 ] . Across all these domains, effective analysis of event sequences enables domain experts to extract actionable insights from complex, time-evolving systems. Several of these domains can produce datasets with millions of events. In the computing case, datasets grow as the execution time and number of parallel resources increases. Manufacturing similarly can exhibit lengthy time span broken into sequences by large numbers of machines. As the number of events increases, so does the computational burden of querying, aggregating, and redrawing them. Therefore, these datasets can tax interactive visual representations of this data, leading to significant lag. For parallel timeline charts , a widely-use visual idiom for event sequences and a key component of a Gantt chart, this lag can limit common exploratory operations such as panning and zooming. This problem generally arises in domains where automated event logs are generated over time. For example, during software performance analysis using event traces, a timestamped log of software in execution, programs running for a longer time on a higher number of computing resources generally create execution traces with large numbers of events [ 38 ] . While execution traces can theoretically grow to hundreds of millions or even billions of events, such massive traces are generally impractical for visual analysis. Similarly, in healthcare systems, patient monitoring devices can generate a large stream of time-stamped health indicators or biometric readings [ 7 ] . In practice, for visual exploratory analysis, analysts extract a specific and manageable set of events, such as events around certain I/O operations in high performance computing (HPC) systems [ 20 ] , or a harmful period of certain disease spread [ 34 ] in healthcare. A targeted and manageable event subset for interactive analysis typically contains thousands to millions of events. This selective strategy helps reduce both system overhead during data collection and improves analysts’ experience in comprehension and visual exploration. However, even with reduced data size, visualizing and interacting with millions of events in a parallel timeline still results in obstructive visual latency , the delay between when a user initiates an interaction (such as zooming, panning, or filtering) and when the system completes rendering the updated view. For exploratory visual analysis, latency should be less than 100 milliseconds (ms) to achieve interactivity [ 9 ] . When latency exceeds the 100 ms threshold, it disrupts users’ iterative analytical workflow and reduces the ability to explore relationships, test hypotheses, and gain insights from the event data [ 49 , 10 , 9 ] . Balancing interactivity while maintaining an accurate representation remains a significant challenge in visualizing large event sequences [ 31 , 75 ] , requiring careful coordination of data management throughout the entire visualization pipeline. Managing the data for visualization includes identifying user-driven queries, fetching relevant data from storage, passing it efficiently between components (disk, memory, cache), processing it based on interaction context, and preparing it for rendering. Poor data management, such as fetching irrelevant data, redundant data transfers, format mismatches, or lack of reuse—can significantly increase both latency and memory consumption. These inefficiencies accumulate across the pipeline and undermine the overall responsiveness and usability of the system. To address the need for interactivity in parallel timeline charts with millions of events, we introduce ESeMan (Event SEquence MANager) , a data management solution for efficient data fetching for parallel timeline charts. ESeMan uses an internal hierarchical spatial index that produces event summaries matching the resolution of the visualization, thereby avoiding querying individual events less than a pixel wide. This approach provides near pixel-perfect accuracy while greatly reducing data fetch time. Furthermore, by tuning the fidelity requested, ESeMan can produce more aggressive summaries, allowing users to tune the balance between accuracy and latency. We compare ESeMan to common data management strategies for efficient querying of interactive charts, including in-memory databases, summed area tables, statistical sub-sampling, and M4 optimization. ESeMan outperformed the alternatives, achieving sub-100 ms fetch times for datasets with millions of events while maintaining near perfect similarity when compared to the non-summarized parallel timeline chart. We also

Read the complete text