Ira: Efficient Transaction Replay for Distributed Systems
Adithya Bhat, Harshal Shah, Mohsen Minaei · 2026
Read Ira: Efficient Transaction Replay for Distributed Systems by Adithya Bhat, Harshal Shah, Mohsen Minaei (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21286.txt.
Introduction
Adithya Bhat, Harshal Shah, and Mohsen Minaei speed up backup copies in distributed systems. In primary-backup setups, the main node sends work out and backups must replay each transaction. The total delay is capped by how fast backups can redo that work.
Their framework, Ira, sends small hints along with each batch of transactions. The hints let backups skip much of the slow re-execution. Faster replay means the whole system can confirm work sooner. It also means backups fall behind less during busy periods. The design targets systems that must stay both fast and consistent.
Catalog record
| CREATOR | Adithya Bhat, Harshal Shah, Mohsen Minaei |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 94 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21286
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Ira: Efficient Transaction Replay for Distributed Systems Adithya Bhat, Harshal Shah, Mohsen Minaei Abstract In primary-backup replication, consensus latency is bounded by the time for backup nodes to replay (re-execute) transactions proposed by the primary. In this work, we present Ira, a framework to accelerate backup replay by transmitting compact hints alongside transaction batches. Our key insight is that the primary, having already executed transactions, possesses knowledge of future access patterns which is exactly the information needed for optimal replay. We use Ethereum for our case study and present a concrete protocol, Ira-L, within our framework to improve cache management of Ethereum block execution. The primaries implementing Ira-L provide hints that consist of the working set of keys used in an Ethereum block and one byte of metadata per key indicating the table to read from, and backups use these hints for efficient block replay. We evaluated Ira-L against the state-of-the-art Ethereum client reth over two weeks of Ethereum mainnet activity ( 100,800 100,800 blocks containing over 24 24 million transactions). Our hints are compact, adding a median of 47 47 KB compressed per block ( ∼ 5 % \sim 5\% of block payload). We observe that the sequential hint generation and block execution imposes a 28.6 % 28.6\% wall-time overhead on the primary, though the direct cost from hints is 10.9 % 10.9\% of execution time; all of which can be pipelined and parallelized in production deployments. On the backup side, we observe that Ira-L achieves a median per-block speedup of 25 × 25\times over baseline reth. With 16 16 prefetch threads, aggregate replay time drops from 6.5 6.5 hours to 16 16 minutes ( 23.6 × 23.6\times wall-time speedup). 1 Introduction The primary-backup paradigm forms the cornerstone of fault-tolerant distributed systems, from traditional databases [ 25 , 30 ] to modern blockchain networks [ 62 , 68 ] . In the standard State Machine Replication (SMR) model [ 50 ] , a designated primary executes batches of transactions and propagates them to backup replicas, who must replay these transactions to maintain consistent state. We can decompose each transaction into a sequence of read and write operations against a key-value store. The primary executes these operations, leveraging caches and indexes to optimize performance. When propagating the transaction batch to backups, the current systems transmit only the transaction data itself, forcing each backup to independently reconstruct the execution path. Transmitting all read/write values would incur prohibitive bandwidth, whereas replaying compact transaction logs allows backups to independently reconstruct the state. SMR protocols [ 33 , 45 ] run a consensus protocol to ensure consistency of the state machine, but the latency of consensus depends on the response from a quorum of replicas (typically a majority or a super-majority). This makes replay critical to consensus performance. This replay is inherently inefficient as the backups must make decisions (e.g., cache management) without knowledge of future access patterns, leading to sub-optimal eviction choices such as unnecessary waiting for I/O, redundant disk I/O, etc. To illustrate this, consider a cache of size 2 containing keys \{A,B\} , with upcoming accesses C , A , C . When C arrives, we must evict one key. LRU evicts the least recently used key ( A ), causing a miss when we access A next. An optimal strategy would be to evict B avoiding the subsequent miss on A . Figure 1 illustrates this difference: LRU incurs 2 misses while optimal incurs only 1 . Generalizing this, without knowledge of future accesses, backups using LRU or other heuristic policies cannot make these optimal decisions. Operation LRU Cache Optimal Cache Initial \{A,B\} \{A,B\} access C \{B,C\} \{A,C\} evict B access A \{C,A\} \{A,C\} access C \{C,A\} \{A,C\} Cache Misses 2 1 hit miss Figure 1: LRU vs. Belady-optimal caching (cache size is 2 ). For access sequence C , A , C starting with cache \{A,B\} : LRU evicts A (least recently used) when C arrives, then misses when it accesses A next. Optimal evicts B (never accessed again), achieving one fewer miss. With hints, backups can make optimal eviction decisions. 1.1 Our Approach: Hint-Based Replay Figure 2: Ira architecture. The primary executes transactions while building a hint that records access information. Backups use these hints to implement optimal cache eviction during replay. In the case where the exact access pattern is known, the optimal solution is the Belady [ 4 , 38 ] algorithm for caching, which informally states that the optimal caching algorithm is to evict the keys that are used furthest from the current operation. Implementing it is traditionally impossible as the access pattern can never be determined a priori. Our key insight is that the inefficiency from Fig. 1 stems from information asymmetry : the primary possesses complete knowledge of the access pattern but discards this information when communicating with backups. The primary can encode this knowledge compactly and transmit it as hints that enable backups to implement near-optimal replay. We propose Ira, a framework to accelerate replay through hint-based replay. Ira operates two components: • Primary. This component executes transactions while recording keys and their accesses, producing a hint. The concrete details of the hints depend on the execution and storage details of the application. This component is also responsible for delivering the hint to the backups. • Backups. This component replays transactions using the hint to improve the storage access. This component is also responsible for receiving the hints from the primary. 1.2 Contributions In summary, we make the following contributions: 1. Ethereum Case Study: We systematically perform measurement studies on execution in Ethereum. We identify that I/O is a bottleneck, and caching plays a major role in improving the replay performance. 2. Hint-Based Replay Architecture: We design a system where the primary generates compact hints during execution that enable backups to implement optimal caching. Hints are advisory, i.e., incorrect hints affect performance but do not affect correctness, thus enabling incremental deployment. 3. Ira for Ethereum. We present Ira-L, which achieves optimal cache performance through per-block hints that enable Belady-optimal eviction. 4. Performance evaluation: We implement Ira by modifying the state-of-the-art Rust Ethereum implementation (reth) and demonstrate 24.9{}\times faster replay with only 10.9{}\% hint generation overhead. With even a single backup node, Ira achieves net speedup; benefits grow with additional replicas. Paper Organization. Section 2 presents our system model and the two-pass protocol. Section 4 describes the Ira-L algorithm. Section 5 presents experimental results. Section 6 discusses limitations and future work. Section 7 surveys related work, and Section 8 concludes. 2 Model and Preliminaries Belady’s MIN Algorithm. Belady’s MIN algorithm [ 4 ] , proved optimal by Mattson et al. [ 38 ] , provides the theoretically optimal cache replacement policy: when eviction is necessary, evict the item whose next access is furthest in the future . This policy minimizes total cache misses but requires knowledge of future accesses; information that is typically unavailable. In primary-backup replication, however, the primary has already executed the workload and possesses this knowledge. Ira exploits this observation: the primary encodes future access information as hints that enable backups to implement near-optimal cache replacement. 2.1 Primary-backup system model We assume the standard primary-backup replication model. Primary Node. The