The Kieker Observability Framework Version 2
Shinhyung Yang, David Georg Reichelt, Reiner Jung, Marcel Hansson, Wilhelm Hasselbring · 2025
Read The Kieker Observability Framework Version 2 by Shinhyung Yang, David Georg Reichelt, Reiner Jung, Marcel Hansson, Wilhelm Hasselbring (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-09189.txt.
Introduction
Shinhyung Yang, David Georg Reichelt, Reiner Jung, Marcel Hansson, and Wilhelm Hasselbring present version 2 of the Kieker observability framework in a 2025 paper. Observability means engineers can watch a running software system closely enough to keep it robust and available. Kieker 2 succeeds a long-used monitoring framework from the same community.
Rather than only describing the tool, the authors demonstrate it on TeaStore, a standard benchmark application. The demo pairs Kieker with ExplorViz, a visual analytics tool, so users can explore system behavior interactively. The demonstration runs as an online service and as a package readers can deploy themselves, making the framework easy to try before adopting.
Catalog record
| CREATOR | Shinhyung Yang, David Georg Reichelt, Reiner Jung, Marcel Hansson, Wilhelm Hasselbring |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-09189
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Kieker Observability Framework Version 2 Thanks: This is the author’s version of the work for an arXiv submission. The definitive Version of Record can be found at https://doi.org/10.1145/3680256.3721972 , published in Companion of the 16th ACM/SPEC International Conference on Performance Engineering (ICPE Companion ’25), May 5–9, 2025, Toronto, ON, Canada. CCS: Software and its engineering Software reverse engineering CCS: Software and its engineering Traceability CCS: Software and its engineering Interoperability CCS: Software and its engineering Software performance Shinhyung Yang, David Georg Reichelt, Reiner Jung, Marcel Hansson, Wilhelm Hasselbring Abstract . Observability of a software system aims at allowing its engineers and operators to keep the system robust and highly available. With this paper, we present the Kieker Observability Framework Version 2, the successor of the Kieker Monitoring Framework. In this tool artifact paper, we do not just present the Kieker framework, but also a demonstration of its application to the TeaStore benchmark, integrated with the visual analytics tool ExplorViz. This demo is provided both as an online service and as an artifact to deploy it yourself. 1. Introduction Observability is a fundamental property of a software system that should be considered during system design ( Kálmán 1960 ) . Using telemetry data allows various stakeholders to understand the system and answer key questions. Monitoring and testing are integral parts of observability, and both benefit from and contribute to it. Observability of a system has become significant as the architecture of software systems is increasingly containerized with distributed microservices. These requirements have conceived observability tools that provide insights into the internal behavior of software systems using traces, metrics, and logs ( Gatev 2021 ) . In this tool artifact paper, we introduce the Kieker Observability Framework Version 2, the successor of the Kieker Monitoring Framework. We demonstrate Kieker’s observability, analysis, and visualization with our TeaStore-Kieker-ExplorViz demo ( Reichelt et al. 2024b ) , which includes our initial effort for the interoperability between Kieker and OpenTelemetry ( Gomez Blanco 2023 ) . The new contribution of this tool artifact paper is not just the Kieker framework, but also a demonstration of its application to the TeaStore benchmark ( Von Kistowski et al. 2018 ) , integrated with the visual analytics tool ExplorViz ( Hasselbring et al. 2020 ) . This demo is provided both as an online service and as an artifact to deploy it yourself. Section 2 summarizes Kieker’s impact, so far. Observability Engineering is introduced in Section 3 , before instrumentation and data collection for observability with Kieker is presented in Section 4 . The tool artifact is described in Section 5 . Section 6 discusses some related work, before the paper is summarized in Section 7 with an outlook to future work. 2. Impact of Kieker The Kieker Observability Framework started as a monitoring framework in 2006 ( Hasselbring and van Hoorn 2020 ) , supporting application performance monitoring and analysis. Kieker enables observing software systems with Java agents, which produce metrics, logs, and trace data. Using the trace data, Kieker allows for reverse engineering and visualization of the software architecture. The Kieker developers have been continuously monitoring its performance overhead with the MooBench monitoring overhead microbenchmark ( Waller et al. 2015 ; Reichelt et al. 2021 ) . Kieker allows for the analysis of observed data. The new Kieker Version 2 incorporates the TeeTime pipe-and-filter framework ( Wulf et al. 2017 ) , which has restructured the analysis pipeline. It provides an intuitive way for Kieker users to build new analysis applications. Research areas in which Kieker was successfully employed are performance analysis ( Rohr et al. 2008 ; Zirkelbach et al. 2015 ; Cito et al. 2018 ; Reichelt and Kühne 2016 ; Reichelt et al. 2019 ) , benchmarking streaming engines ( Yang et al. 2018 ) , anomaly detection ( Marwede et al. 2009 ; Ehlers et al. 2011 ) , online capacity management ( van Hoorn et al. 2009 ; von Massow et al. 2011 ) , analysis of software structure and metrics ( Jin et al. 2021 ; Qu et al. 2015 ; Schnoor and Hasselbring 2020 ; Liu et al. 2022 ; Cao and Zhang 2022 ; Andrade et al. 2023 ) , software architecture reconstruction ( Dabrowski 2012 ) , test case prioritization ( Chi et al. 2020 ) , and extraction of load profiles ( van Hoorn et al. 2014 ; Vögele et al. 2018 ) . Martinez Saucedo et al. 2025 recently identified Kieker as the most cited tool to assist with the migration of monolithic systems to microservices. Several Kieker-related research projects have been and are being conducted over the years. Examples are diagnoseIT (Expert-Guided Automatic Diagnosis of Performance Problems) ( Heger et al. 2016 ) , DynaMod (Dynamic Analysis for Model-Driven Software Modernization) ( van Hoorn et al. 2011 ) , and OceanDSL (Architecture analysis, interactive visualization) ( Jung et al. 2021b ) . As reported by Hasselbring and van Hoorn 2015 , Kieker was also employed in several industrial collaborations and technology transfer projects. More information on Kieker’s impact may be found in Hasselbring and van Hoorn 2020 . Kieker is included in the SPEC Research Group’s repository of peer-reviewed tools for quantitative system evaluation and analysis. 1 1 1 https://research.spec.org/tools/overview/ The review process and the final acceptance of Kieker for this tool repository triggered manifold activities in the Kieker project and helped to further improve Kieker’s product quality (both code and documentation); Kieker’s visibility increased considerably, with 480 citations to the ICPE 2012 Kieker tool demo paper ( van Hoorn et al. 2012 ) , so far. 2 2 2 https://scholar.google.com/scholar?cluster=11724904481060384258 (Jan. 15, 2025) 3. Observability Engineering The term observability has been introduced in the context of control theory ( Kálmán 1960 ) . In this context, observability is a measure of how well the internal states of a system can be inferred from knowledge of its external outputs. For software systems, this means how well the internal state of a software system can be inferred from its monitoring data. Observability Engineering ( Majors et al. 2022 ) focuses on designing, building, and maintaining systems that enable us to understand the internal state of software systems based on monitoring data. It is a crucial part of software engineering, especially in the context of complex distributed systems such as microservices and cloud-native architectures. Figure 1 (introduced by Peter Bourgon 3 3 3 https://peter.bourgon.org/blog/2017/02/21/metrics-tracing-and-logging.html ) presents the three pillars of observability: metrics, logging, and tracing ( Gatev 2021 ) : ThreePillarsOfObservability Figure 1. Visual illustration of metrics, logging, and tracing. They are ordered vertically with a higher data volume at the bottom. ThreePillarsOfObservability The Three Pillars of Observability • Metrics are aggregated numerical data representing the performance and behavior of systems (e.g., CPU usage, response time, error rates), which are collected at regular intervals. • Logging is the collection of text-based records of discrete events or activities within a system (e.g., status and debugging messages). • Tracing is the collection of information about the path a request takes as it moves through a distributed system. Traces are aggregations of highly structured log events, which are called spans ( Gomez Blanco 2023 ) . Observability is not