ONTO: A Token-Efficient Columnar Notation for LLM Input Optimization
Harshavardhanan Deekeswar · 2026
Read ONTO: A Token-Efficient Columnar Notation for LLM Input Optimization by Harshavardhanan Deekeswar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17512.txt.
Introduction
Deekeswar proposes ONTO, a columnar notation that trims the token cost of feeding operational data to large language models. JSON repeats field names on every record, so 1,000 sensor readings can burn about 80,000 tokens; ONTO names each field once and lines values up in pipe-separated rows. Tests on three synthetic sets cut tokens by 46 to 51 percent against JSON, sped inference 5 to 10 percent on Qwen2.5-7B, and kept task accuracy intact.
Catalog record
| CREATOR | Harshavardhanan Deekeswar |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29787 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17512
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ONTO: A Token-Efficient Columnar Notation for LLM Input Optimization Harshavardhanan Deekeswar Abstract Serialization formats designed for document interchange impose structural overhead that becomes prohibitive when large language models consume operational data at scale. A modest dataset of 1,000 IoT sensor readings serialized as JSON requires approximately 80,000 tokens—the majority spent on repeated field names, nested braces, and structural punctuation rather than semantic content. We present Onto (Object Notation for Token Optimization), a columnar notation that declares field names once per entity and arranges values in pipe-delimited rows with indentation-based hierarchy. This schema-once, data-many design eliminates per-record key repetition while preserving human readability and nested structure support. Evaluation across three synthetic operational datasets demonstrates 46–51% token reduction versus JSON, with stable scaling from 100 to 1,000 records. Controlled inference benchmarks on Qwen2.5-7B show corresponding 5–10% latency improvement. Comprehension validation confirms no material degradation in LLM task accuracy across lookup, counting, extraction, and aggregation operations when format context is provided. Ablation analysis reveals that key repetition accounts for the majority of JSON overhead, with indentation costs in nested structures explaining the 4-percentage-point gap between flat and hierarchical data. Onto occupies a previously unfilled position in the serialization landscape: columnar efficiency with hierarchical structure, optimized for LLM context windows rather than document interchange. Code and specification are available at https://github.com/harsh-aranga/onto . 1 Introduction A single analytical query over 1,000 device telemetry records consumed over 700,000 tokens when serialized as JSON. Inspecting the payload revealed the problem: field names like device_id , temperature , timestamp repeated 1,000 times each. Structural punctuation—braces, brackets, quotation marks, colons—accounted for thousands more. The actual sensor values, the semantic content the LLM needed to reason over, represented a fraction of the token budget. This is not an edge case. As large language models transition from conversational assistants to operational intelligence systems—analyzing telemetry streams, detecting anomalies in logs, performing root cause analysis across distributed metrics—they increasingly consume large volumes of structured data. The serialization format chosen for this data has direct consequences: token costs scale linearly with input size, context windows impose hard capacity limits, and inference latency correlates with prompt length. The problem is that we are using the wrong tool. JSON was designed in 2001 for document interchange between web services ( Bray 2017 ) . Its design priorities—self-description, human readability, language independence—served that goal well. But self-description means repeating field names with every record. Human readability means verbose punctuation. These properties, virtues in their original context, become liabilities when the consumer is an LLM processing thousands of records under token constraints. The core insight: Serialization for LLM input is a fundamentally different problem than serialization for document interchange. LLM prompts are ephemeral, consumed once by a single system with known capabilities. They do not require the defensive redundancy of interchange formats. A format optimized for this use case can assume the consumer will parse the schema once and apply it to all records— schema-once, data-many —eliminating the overhead that dominates JSON token counts. We present Onto (Object Notation for Token Optimization), a columnar notation designed specifically for LLM input serialization. Onto declares field names once per entity, arranges values in pipe-delimited rows, and uses indentation to represent hierarchy. This structure achieves 46–51% token reduction compared to JSON while maintaining human readability and full support for nested data. 1.1 Contributions 1. Problem characterization: We identify LLM input serialization as a distinct problem from document interchange, with different optimization criteria. 2. Format design: We present Onto , a columnar notation achieving 46–51% token reduction through schema-once design while preserving hierarchy and readability. 3. Empirical validation: We demonstrate stable token reduction across nested, flat, and mixed data structures at multiple scales, with corresponding latency improvements and no comprehension degradation. 4. Ablation analysis: We decompose token savings by source—key elimination, punctuation reduction, structural simplification—and quantify the overhead cost of indentation-based nesting. 5. Open implementation: We release a Python reference parser, benchmark suite, and synthetic datasets for reproducibility. 1.2 Scope and Non-Goals Onto is designed as an input preprocessing optimization, not a general-purpose serialization format. It does not aim to replace JSON for API communication, YAML for configuration, or Parquet for storage. The target use case is narrow but significant: preprocessing large structured datasets before injection into LLM prompts for analytical tasks. 2 The Serialization Gap Existing formats occupy distinct points in the design space, each optimized for different constraints. None adequately addresses LLM input optimization. JSON ( Bray 2017 ) prioritizes self-description and interoperability. Every record carries its own schema through repeated field names. This redundancy enables schema evolution and partial parsing but wastes tokens when records share identical structure. Additionally, deeply nested brace hierarchies create long-range dependencies in token sequences. YAML ( Ben-Kiki et al. 2021 ) reduces punctuation overhead through significant whitespace but retains per-record key repetition. Our benchmarks show only 1–6% token reduction versus JSON—insufficient to change the economics of large-scale LLM input. CSV achieves columnar efficiency through header-once design, eliminating key repetition. However, CSV fundamentally cannot represent nested structures, limiting its applicability to flat tabular data. Many operational datasets—telemetry with location coordinates, logs with structured metadata—require hierarchy. Parquet/Arrow provide excellent compression and columnar storage for analytical workloads. But binary formats are not human-readable, cannot be directly embedded in text prompts, and require serialization to text before LLM consumption—reintroducing overhead. Prompt compression ( Jiang et al. 2023 ; Pan et al. 2024 ) takes a different approach: reducing token count through selective removal of low-information tokens from existing text. These methods are lossy, operate on arbitrary text rather than structured data, and cannot exploit the regularity of repeated-record datasets. Schema-aware JSON optimization approaches such as TOON ( TOON 2024 ) achieve compression through key shortening and structure flattening. Such methods may perform comparably on flat structures but provide limited benefit on nested data where key repetition is compounded by hierarchy—the columnar approach addresses both cases through structural redesign rather than incremental optimization. Table 1: Serialization format comparison for LLM input. Format Columnar Nested Readable Promptable JSON × ✓ ✓ ✓ YAML × ✓ ✓ ✓ CSV ✓ × ✓ ✓ Parquet ✓ ✓ × × TOON ✓ \sim ✓ ✓ Onto ✓ ✓ ✓ ✓ Table 1 summarizes the gap. No existing format combines columnar efficiency (eliminating key repetition), full nested structure support (representing arbitrary hierarchy), human readability (enabling inspection and debugging), and direct promptability (embedding in LLM context without conversion). Onto fills this gap. 3 ONTO Design Onto ’s design follows from a single principle: declare once, reference many . Every design decision serves this principle while respecting operational constraints. 3.1 Syntax Overview An Onto document consists of entity declarations followed by field definitions with columnar values: ⬇ Telemetry [3]: device_id : sensor -001| sensor -002| sensor -003 temperature : 23.5|24.1|22.9 humidity : 45.2|43.8|46.1 location : lat : 37.77|37.78|37.79 lon : -122.41|-122.42|-122.43 The equivalent JSON requires approximately 450 tokens; Onto requires approximately 120—a 73% reduction for this small example. At scale (1,000 records), reduction stabilizes at 46–51%. The savings derive from three mechanisms: 1. Schema-once: Field names ( device_id , temperature , etc.) appear exactly once, not per-record. 2. Minimal delimiters: Pipe ( | ) separates values; no braces, brackets, quotes, or colons per value. 3. Implicit