COLE + : Towards Practical Column-based Learned Storage for Blockchain Systems

Ce Zhang, Cheng Xu, Haibo Hu, Jianliang Xu, Department of Computer Science, Hong Kong Baptist University, Hong Kong SAR · 2026

Read COLE + : Towards Practical Column-based Learned Storage for Blockchain Systems by Ce Zhang, Cheng Xu, Haibo Hu, Jianliang Xu, Department of Computer Science, Hong Kong Baptist University, Hong Kong SAR (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00509.txt.

Introduction

Zhang and three colleagues extend COLE, a column based learned store for blockchains, to handle forks and pruning that the original handled poorly. A rewind capable in memory tree with content defined chunking keeps a consistent hash digest per block through chain reorganisations. On disk, a new two level Merkle tree called a prunable version tree enables efficient state pruning. The enhanced COLE design thus keeps the storage and throughput gains of columnar learned indexing while supporting reorganisation and pruning.

Catalog record

CREATORCe Zhang, Cheng Xu, Haibo Hu, Jianliang Xu, Department of Computer Science, Hong Kong Baptist University, Hong Kong SAR
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE86820
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.00509

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

COLE + : Towards Practical Column-based Learned Storage for Blockchain Systems Ce Zhang, Cheng Xu, Haibo Hu, Jianliang Xu, Department of Computer Science, Hong Kong Baptist University, Hong Kong SAR Abstract Blockchain provides a decentralized and tamper-resistant ledger for securely recording transactions across a network of untrusted nodes. While its transparency and integrity are beneficial, the substantial storage requirements for maintaining a complete transaction history present significant challenges. For example, Ethereum nodes require around 23TB of storage, with an annual growth rate of 4TB. Prior studies have employed various strategies to mitigate the storage challenges. Notably, COLE significantly reduces storage size and improves throughput by adopting a column-based design that incorporates a learned index, effectively eliminating data duplication in the storage layer. However, this approach has limitations in supporting chain reorganization during blockchain forks and state pruning to minimize storage overhead. In this paper, we propose COLE + , an enhanced storage solution designed to address these limitations. COLE + incorporates a novel rewind‐supported in-memory tree structure for handling chain reorganization, leveraging content‐defined chunking (CDC) to maintain a consistent hash digest for each block. For on‐disk storage, a new two-level Merkle Hash Tree (MHT) structure, called prunable version tree, is developed to facilitate efficient state pruning. Both theoretical and empirical analyses show the effectiveness of COLE + and its potential for practical application in real-world blockchain systems. I Introduction Blockchain, a decentralized and append-only ledger, leverages cryptographic hash chains and distributed consensus protocols to securely record transactions across a network of untrusted nodes [ 1 , 2 ] . Its inherent transparency and tamper-resistance have established it as a foundational technology for cryptocurrencies and a wide range of decentralized applications. To ensure complete and verifiable data provenance, blockchain nodes must maintain a comprehensive history of transactions and ledger states, enabling users to query historical data with strong integrity guarantees. However, this comprehensive record-keeping incurs substantial storage overhead, which grows rapidly as the blockchain expands. For example, as of October 2025, Ethereum nodes require approximately 23 TB of storage, with an annual growth rate of \sim 4 TB [ 3 ] . Prior studies [ 4 , 5 ] show that the excessive storage overhead stems from the underlying index, Merkle Patricia Trie (MPT) [ 2 ] . MPT retains obsolete nodes during data updates to enable data provenance via pointer chasing. For example, as shown in Figure 1 , updating address a71f37 with value v_{3}^{\prime} in block i+1 adds a new path ( n_{1}^{\prime} , n_{2}^{\prime} , n_{4}^{\prime} , n_{6}^{\prime} ) for the updated value while retaining the existing path ( n_{1} , n_{2} , n_{4} , n_{6} ) for the historical value v_{3} . This design allows access to any historical value by traversing the index nodes under a specific historical block (e.g., traversing n_{1} , n_{2} , n_{4} , n_{6} retrieves v_{3} in block i ). However, it also introduces significant storage overhead due to duplication along the updated path (e.g., n_{1}^{\prime} , n_{2}^{\prime} , n_{4}^{\prime} , n_{6}^{\prime} , and n_{1} , n_{2} , n_{4} , n_{6} ). Fig. 1: An Example of Merkle Patricia Trie Existing work has explored various strategies to address the storage challenges posed by MPT. LETUS [ 4 ] uses delta-encoding to reduce the storage requirements of the blockchain index. It also adopts page-based, simple file storage instead of key-value databases (e.g., RocksDB [ 6 ] ) to enable fine-grained I/O optimizations. Compared with MPT, LETUS achieves up to 4 \times storage reduction, as reported in [ 4 ] . However, its proposed index, DMM-Tree, still employs an MPT-like node duplication strategy during data updates, leaving room for further storage optimization. SlimArchive [ 7 ] opts to eliminate the Merkle-based structures and flattens the minimal blockchain state changes. However, this approach no longer supports data authentication and provenance, which are critical security features of blockchain systems. In contrast, COLE employs a column-based design coupled with a learned index to significantly reduce storage overhead (by up to 5.8 \times against MPT) while maintaining efficient data access [ 5 ] . Figure 2 illustrates the overall design of COLE, where a log-structured merge-tree (LSM-tree) consisting of multiple sorted runs is used to manage blockchain states. For each on-disk sorted run, COLE uses a value file to store the ledger states as a database column, an index file to predict the states’ positions in the value file via a tailored learned index, and a Merkle file to ensure the data integrity of the value file. COLE’s column-based design, in which successive versions of each state are stored contiguously, enables efficient data retrieval and reduces storage size. The learned index leverages the inherent ordering of the data for fast data access. At the same time, maintaining the historical states within the index of the latest block eliminates MPT tree node duplication, thereby yielding substantial storage savings and enabling rapid historical state retrieval without the need to traverse prior block indexes. Fig. 2: Structure of COLE [ 5 ] Despite COLE’s effectiveness in reducing storage size and enhancing system throughput, several limitations hinder its wide practical deployment: • Limited Chain Reorganization Support : COLE struggles to handle chain reorganizations during blockchain forks [ 8 ] . These forks can arise from either consensus protocols (e.g., Proof of Work [ 1 ] ) or software upgrades (e.g., post-Ethereum DAO attack hard fork [ 9 ] ). The former, which occurs frequently, typically rewinds a few recent blocks and thus requires COLE’s in-memory states to revert to a previous version. However, this is infeasible because its underlying in-memory Merkle B-tree structure depends on both the data values and their insertion order [ 10 , 11 ] . Rewinding blockchain states in this manner would introduce inconsistencies in the tree index across nodes and violate the requirement for a globally agreed-upon root hash. In the latter, rarer case, reversing the index is also difficult due to modifications in on-disk runs caused by flush and recursive merge operations in the LSM-tree. As a result, COLE is limited to blockchain systems that do not fork [ 12 , 13 , 14 ] . • Lack of State Pruning Support : COLE does not support state pruning, a common technique used by blockchain full nodes to reduce storage overhead by retaining only recent state versions. Because COLE’s Merkle file constructs a complete Merkle Hash Tree (MHT) over all historical state versions for the corresponding value file, pruning historical states would disrupt its ability to correctly construct the Merkle file and compute the root hash for the new compacted run during subsequent LSM-tree merge operations. This makes it impossible for full archive nodes and pruned nodes to agree on a consistent tree index and root hash for blockchain states. Consequently, all blockchain full nodes in COLE must maintain all historical states, even those that are rarely queried. • Uniform Indexing of State Versions : COLE treats all state versions equally, neglecting to account for their disparate access frequencies. Since blockchain queries predominantly access the latest state values, this uniform approach introduces inefficiencies by unnecessarily expanding the search space from the current state to all historical versions during data queries. To address the aforementioned limitations of

Read the complete text