Jelly: a fast and convenient RDF serialization format

Piotr Sowiński, Karolina Bogacka, Anastasiya Danilenka, Nikita Kozlov · 2025

Read Jelly: a fast and convenient RDF serialization format by Piotr Sowiński, Karolina Bogacka, Anastasiya Danilenka, Nikita Kozlov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-11298.txt.

Introduction

Four authors led by Piotr Sowinski forge Jelly, a fast binary tongue for web data graphs called RDF. Old text forms for such graphs are slow, fat, and mute on live streams. Jelly packs graph triples on a wire frame built for speed, with a light squeeze as it flows. Both batch files and live feeds speak it in the design.

An open spec and free code in Java and Python ship with the form. A shell tool rides along for quick turns of old files. Graphs for sense webs and fact banks move by this tongue in the use tales. Speed, size, and stream fit are the three wins the team claims.

Catalog record

CREATORPiotr Sowiński, Karolina Bogacka, Anastasiya Danilenka, Nikita Kozlov
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-11298

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Jelly: a fast and convenient RDF serialization format Piotr Sowiński, Karolina Bogacka, Anastasiya Danilenka, Nikita Kozlov Abstract Existing RDF serialization formats such as Turtle, N-Triples, and JSON-LD are widely used for communication and storage in knowledge graph and Semantic Web applications. However, they suffer from limitations in performance, compression ratio, and lack of native support for RDF streams. To address these shortcomings, we introduce Jelly, a fast and convenient binary serialization format for RDF data that supports both batch and streaming use cases. Jelly is designed to maximize serialization throughput, reduce file size with lightweight streaming compression, and minimize compute resource usage. Built on Protocol Buffers, Jelly is easy to integrate with modern programming languages and RDF libraries. To maximize reusability, Jelly has an open protocol specification, open-source implementations in Java and Python integrated with popular RDF libraries, and a versatile command-line tool. To illustrate its usefulness, we outline concrete use cases where Jelly can provide tangible benefits. By combining practical usability with state-of-the-art efficiency, Jelly is an important contribution to the Semantic Web tool stack. [orcid=0000-0002-2543-9461, [email protected], url=https://ostrzyciel.eu/, ] *1 [orcid=0000-0002-7109-891X, [email protected], ] [orcid=0000-0002-3080-0303, [email protected], ] [orcid=0009-0003-1634-9194, [email protected], ] keywords RDF ,Serialization format ,RDF stream processing ,Knowledge graphs ,Semantic Web data formats † † copyrightyear: 2025 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: SEMANTiCS 2025 Developers Workshop, September 03, 2025, Vienna, Austria † † address: NeverBlink, ul. Wspólna 56, 00-684 Warsaw, Poland † † address: Warsaw University of Technology, Pl. Politechniki 1, 00-661 Warsaw, Poland † † corresp: Corresponding author. 1 Introduction Knowledge graph and Semantic Web systems use serialization formats such as Turtle, N-Triples, and JSON-LD to exchange and store RDF data in scenarios ranging from database dumps to client-server communication. However, common RDF formats are limited in terms of their serialization/deserialization speeds, compression ratios, and processing efficiency, which can become a performance bottleneck. Additionally, no W3C format can natively represent streams of RDF data, which could be beneficial in some applications (e.g., industrial IoT, clickstreams, real-time user interaction). Although several new RDF formats were proposed in the past to solve some of these issues (see Section 5 ), none have reached wider adoption, either due to missing tooling, incomplete use case coverage, or other practical issues. In this contribution we present Jelly , a high-performance binary RDF serialization format designed specifically to be easy to use, utilize as little compute resources as possible, and cover practical use case requirements. It natively supports RDF stream processing, but can also be applied in batch settings, in place of W3C-standard formats. In this work, we describe Jelly’s contribution to the Semantic Web community tool stack that includes: (1) a robust and open Jelly protocol specification; (2) implementations for Java and Python compatible with popular RDF libraries; (3) an easy to use command-line tool; (4) several concrete use cases where Jelly can provide tangible benefits. 2 Jelly protocol Jelly is a binary serialization format for streams of RDF triples, quads, graphs, or datasets Sowiński et al. 2022 . It can be used in place of W3C-standard formats like N-Triples or Turtle, to simply represent a sequence of statements (a flat RDF stream in the RDF Stream Taxonomy Sowiński et al. 2024 ). It can also be used to represent a sequence of graphs or datasets (grouped RDF stream) – this would be a series of files in W3C-standard formats. A Jelly file is split into frames , where each frame corresponds to either a batch of RDF statements, or a complete RDF graph/dataset. In streaming settings (e.g., Kafka, gRPC), each frame corresponds to a separate message, allowing for efficient compression over the entire stream. Serialization. Jelly uses the industry-standard Protocol Buffers (Protobuf) serialization framework as its basis. The binary layout of Jelly is specified in a Protobuf interface definition file, which can then be used by compilers to generate serialization/deserialization code in one of the many supported programming languages (e.g., C++, Python, Java, Rust, C#). This greatly simplifies implementing the format, as all binary-level manipulation code is generated automatically, and the developer only needs to implement a translation layer between Protobuf messages and RDF types of the given library. The mechanism for this translation is defined in the open Jelly specification 1 1 1 https://w3id.org/jelly/dev/specification/serialization . Compression. The design goals of Jelly are to: (1) maximize serialization/deserialization throughput, (2) provide a relatively good compression ratio, and (3) operate in a fully streaming manner. We understand the third goal as meeting the common criteria for stream processing systems: process only one triple at time, use a limited amount of time per triple, use a limited amount of memory (overall), output the results on demand, and adapt to temporal changes Bifet et al. 2023 . This essentially would allow Jelly to process arbitrarily large (potentially indefinite) RDF files in constant memory. To meet these criteria, Jelly employs a streaming compression algorithm, defined in the aforementioned specification. The full description of the algorithm is beyond the scope of this contribution – here we provide only a brief summary. Three fixed-sized string lookup tables are used, for IRI prefixes, suffixes, and datatypes. The serializer populates these tables until they are full, after which old lookup entries can be replaced by new ones using any policy (e.g., least recently used). Entries in these tables are referenced using variable-length integer identifiers, also utilizing simple delta compression to minimize their size. For consecutive RDF statements with repeating terms (e.g., same triple subject), the repeated term is not serialized, further reducing the file size. These compression methods are relatively easy to implement and can work in a fully streaming manner, processing one triple at a time. Performance. We regularly publish performance benchmarks for the Jelly-JVM implementation on the Jelly website 2 2 2 https://w3id.org/jelly/dev/performance , using a diverse mix of datasets from RiverBench Sowiński and Ganzha 2024 . In summary, Jelly-JVM 2.7.0 achieves an average compression ratio of 16.2% (compared to a baseline of 100% for N-Triples), serialization speed of 7.28 MT/s (millions of triples per second), and deserialization speed of 15.16 MT/s with Eclipse RDF4J. As far as we are aware, this currently makes Jelly the most compressed and the fastest RDF format implemented in either Apache Jena or RDF4J. 3 Implementations and tooling Jelly currently has implementations for Python and the Java Virtual Machine. Both implementations are designed around a generic core that can be used in conjunction with multiple different RDF libraries – at the moment supported are: Apache Jena, Eclipse RDF4J, Titanium RDF API, and rdflib. 3.1 Java Virtual Machine: Jelly-JVM Jelly-JVM 3 3 3 https://w3id.org/jelly/jelly-jvm is the more mature and heavily optimized implementation. It is organized into a set of modular components. The jelly-core module encapsulates the base functionality for encoding, decoding and transcoding Jelly-formatted data, independent of any particular RDF library, along with necessary utilities and abstractions to facilitate the development of integrations with various RDF libraries. The jelly-jena module provides full interoperability with Apache Jena by converting between Jelly Protobuf messages and Jena’s data structures. It includes an integration with Jena’s RIOT subsystem, making it possible to use Jelly in Jena just like any

Read the complete text