The Missing Dimensions in Geo-Distributed Database Evaluation
Oto Mraz 1 , Kyriakos Psarakis 2 , George Christodoulou 1 , Paris Carbone 3 , and Asterios Katsifodimos 1 · 2026
Read The Missing Dimensions in Geo-Distributed Database Evaluation by Oto Mraz 1 , Kyriakos Psarakis 2 , George Christodoulou 1 , Paris Carbone 3 , and Asterios Katsifodimos 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30156.txt.
Introduction
Oto Mraz and four colleagues argue that current tests of databases spread across regions miss what matters most. Benchmarks assume stable networks, ignore where data and users sit, and overlook transfer costs, while covering few spread patterns. Their Gaia framework tests existing transaction systems spread across cloud regions under varied patterns and shaky networks. Most systems prove sensitive to network wobbles, network costs dominate bills, and fault tolerance adds critical-path overhead. Future designs, they argue, must rethink speed, fault tolerance and cost together.
Catalog record
| CREATOR | Oto Mraz 1 , Kyriakos Psarakis 2 , George Christodoulou 1 , Paris Carbone 3 , and Asterios Katsifodimos 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62588 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30156
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Missing Dimensions in Geo-Distributed Database Evaluation Oto Mraz 1 , Kyriakos Psarakis 2 , George Christodoulou 1 , Paris Carbone 3 , and Asterios Katsifodimos 1 Abstract Geo-distributed OLTP databases are widely deployed across cloud regions, yet current evaluation practices do not cover the challenges of this aspect. Existing benchmarks assume stable network conditions; they lack explicit settings for data and client locality, and they largely ignore data transfer costs across regions. In addition, most evaluations rely on a limited set of geo-distribution patterns. In this paper, we propose Gaia, a comprehensive evaluation framework that addresses these gaps. We use Gaia to perform a comprehensive evaluation of existing geo-distributed OLTP systems. We deploy them across multiple cloud regions, using different geo-distribution patterns and variable cross-region network conditions. Among other interesting findings, our framework reveals that: OPEN i ) i) most systems are sensitive to network instabilities, OPEN i i ) ii) network costs dominate cloud deployment expenses OPEN i i i ) iii) multi-region fault-tolerance mechanisms incur measurable critical-path overhead that is often overlooked in prior evaluations. We argue that for the design of future geo-distributed databases, we must rethink the trade-offs between performance, fault-tolerance, and cost. I Introduction Geo-distributed transactional databases are fundamental to modern applications across banking, e-commerce, and financial trading. By partitioning and replicating data across different geographical regions, these systems increase availability, tolerate regional failures, and provide low-latency access to users. However, ensuring strong consistency and atomicity across regions requires complex coordination protocols that may entail multiple communication rounds. Due to wide-area network (WAN) latencies and cross-region communication, transactions may incur significant overhead compared to single-region deployments. Such coordination and concurrency control protocols have been the subject of research in recent years [ 35 , 18 , 40 , 46 , 21 , 45 , 14 , 61 , 36 ] . To manage these trade-offs, many systems adopt deterministic execution models [ 46 , 40 ] , in which transaction order is determined before execution. Determinism is particularly attractive in geo-replicated settings, where timestamp-based approaches suffer from clock skew and message delays [ 8 ] . Without determinism, conflicting transactions may be aborted or reordered inconsistently, leading to replica divergence. By processing transactions in a predefined global order, deterministic databases enforce convergence and reduce coordination. TABLE I: A comparison of the scenarios and metrics used in the evaluations of geo-distributed databases. Evaluation Scenario Metric Publication Scalability Access patterns Access skew Network conditions Fault tolerance Resource allocation Data transfers Monetary costs Calvin [ 46 ] ✓ ⚫ ✓ ⚫ ⚫ ⚫ ⚫ ⚫ SLOG [ 40 ] ✓ ✓ ✓ ⚫ ⚫ ⚫ ⚫ ⚫ Detock [ 35 ] ✓ ✓ ✓ ✓ ⚫ ⚫ ⚫ ⚫ Caerus [ 21 ] ✓ ✓ ⚫ ⚫ ⚫ ⚫ ⚫ ⚫ Aria [ 29 ] ✓ ⚫ ✓ ⚫ ⚫ ⚫ ⚫ ⚫ CRDB [ 45 ] ✓ ⚫ ⚫ ⚫ ✓ ⚫ ⚫ ⚫ Spanner [ 12 ] ✓ ⚫ ⚫ ⚫ ⚫ ⚫ ⚫ ⚫ Aurora [ 54 ] ✓ ⚫ ⚫ ⚫ ⚫ ✓ ⚫ ⚫ TAPIR [ 58 ] ✓ ⚫ ✓ ⚫ ✓ ⚫ ⚫ ⚫ Janus [ 33 ] ✓ ⚫ ✓ ⚫ ⚫ ⚫ ⚫ ⚫ Mako [ 42 ] ✓ ✓ ⚫ ⚫ ✓ ⚫ ⚫ ⚫ MaaT [ 30 ] ✓ ✓ ⚫ ⚫ ✓ ⚫ ⚫ ⚫ EC [ 16 ] ✓ ✓ ✓ ⚫ ⚫ ⚫ ⚫ ⚫ Q-Store [ 39 ] ✓ ✓ ✓ ⚫ ⚫ ⚫ ⚫ ⚫ Deneva [ 18 ] ✓ ⚫ ✓ ✓ ⚫ ⚫ ⚫ ⚫ CRDB-MR [ 53 ] ✓ ✓ ⚫ ⚫ ⚫ ⚫ ⚫ ⚫ DB sen. [ 55 ] ✓ ⚫ ✓ ✓ ⚫ ⚫ ⚫ ⚫ Gaia ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ Despite the growing adoption of geo-distributed systems in industry (e.g., Spanner [ 12 ] , Aurora [ 54 ] , CockroachDB [ 45 ] ), current benchmarking practices do not capture the intricacies of their deployments. Standard OLTP benchmarks such as TPC-C [ 47 ] , YCSB [ 11 ] , and SmallBank [ 2 ] were originally designed for traditional single-region deployments more than a decade ago. As we show in this paper, their schemata and data distributions offer limited support for modeling important geo-distributed transactional patterns. However, more complex geo-distribution patterns would better reflect the variations of real-world workloads. Moreover, most evaluations [ 46 , 40 , 35 , 29 , 58 , 33 , 18 , 55 ] focus on scalability and skewed data distribution, but they rarely model failures, unstable networks, or heterogeneous cloud infrastructures ( Table I ). Although WAN communication can be costly in cloud deployments, data transfer volumes and pricing implications are often overlooked in the literature. Given the increasing adoption of geo-distributed databases nowadays, novel benchmarking methods, evaluation scenarios, and metrics have become especially important and timely. To address these issues, we develop Gaia, a benchmarking framework tailored to geo-distributed OLTP databases. We use Gaia to evaluate existing state-of-the-art geo-distributed databases across scenarios that were not tested in their original publications. Gaia integrates a range of OLTP systems and evaluates them under different scenarios derived from existing benchmarks such as TPC-C [ 47 ] and YCSB [ 11 ] ( Figure 1 ). These scenarios model realistic conditions, including transaction locality, submission-placement asymmetry, hardware instability, and varying hardware configurations. In addition, Gaia introduces new metrics, including cross-region data transfers and monetary costs, to provide a complete picture of system behavior under varying deployment conditions. Gaia is designed to be extensible, allowing new geo-distributed protocols to be integrated with minimal effort. Using Gaia, we evaluate five geo-distributed OLTP systems deployed across multiple cloud regions. We analyze system performance across eight scenarios and examine how design decisions affect performance and costs in WAN deployments. Note that our goal in this work is not to compare systems but to identify key limitations in current evaluation approaches and propose new metrics and evaluation scenarios. In short, this paper makes the following contributions: • The first geo-distributed database evaluation framework that considers data transfers, and cloud deployment costs alongside the traditional latency and throughput metrics. • A taxonomy of scenarios for geo-distributed transactions. • A comprehensive performance evaluation using our framework of five database systems in different deployment scenarios, yielding new insights on geo-distributed database designs and their tradeoffs. • Identification of high-latency cross-regional data transfers as the primary cost for geo-distributed systems. • Quantification of how network instability affects the performance of existing systems. • Demonstration of the overhead that multi-region fault-tolerance mechanisms impose on transaction performance in geo-distributed systems. The rest of the paper is organized as follows. We first provide an access pattern taxonomy ( II ), summarize geo-distribution modeling in existing benchmarks ( III ) and system evaluations ( IV ). We derive a more holistic set of evaluation scenarios ( V ) and metrics ( VI ). In ( VII ) we discuss the insights our framework reveals about system capabilities and outline open challenges ( VIII ). ( IX ) provides a related work overview. Gaia is available at https://github.com/delftdata/gaia . We present additional metrics in our extended