HYVE: Hybrid Views for LLM Context Engineering over Machine Data
Jian Tan ∗ , Fan Bu ∗ , Yuqing Gao, Dev Khanolkar, Jason Mackay, Boris Sobolev, Lei Jin, Li Zhang · 2026
Read HYVE: Hybrid Views for LLM Context Engineering over Machine Data by Jian Tan ∗ , Fan Bu ∗ , Yuqing Gao, Dev Khanolkar, Jason Mackay, Boris Sobolev, Lei Jin, Li Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05400.txt.
Introduction
Tan and seven colleagues cut the cost of feeding machine data to language models. Logs and telemetry traces often arrive as long, nested, repetitive payloads that choke these models. Their HYVE framework stores repeated structure in a request-scoped store with schema notes. It then shows the model only the most useful hybrid view. Across varied workloads it cuts token use by 50 to 90 percent while holding or improving quality, and lifts chart accuracy by up to 132 percent.
Catalog record
| CREATOR | Jian Tan ∗ , Fan Bu ∗ , Yuqing Gao, Dev Khanolkar, Jason Mackay, Boris Sobolev, Lei Jin, Li Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 108430 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.05400
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
HYVE: Hybrid Views for LLM Context Engineering over Machine Data Jian Tan ∗ , Fan Bu ∗ , Yuqing Gao, Dev Khanolkar, Jason Mackay, Boris Sobolev, Lei Jin, Li Zhang Abstract Machine data is central to observability and diagnosis in modern computing systems, appearing in logs, metrics, telemetry traces, and configuration snapshots. When provided to large language models (LLMs), this data typically arrives as a mixture of natural language and structured payloads such as JSON or Python/AST literals. Yet LLMs remain brittle on such inputs, particularly when they are long, deeply nested, and dominated by repetitive structure. We present HYVE (HYbrid ViEw), a framework for LLM context engineering for inputs containing large machine-data payloads, inspired by database management principles. HYVE surrounds model invocation with coordinated preprocessing and postprocessing, centered on a request-scoped datastore augmented with schema information. During preprocessing, HYVE detects repetitive structure in raw inputs, materializes it in the datastore, transforms it into hybrid columnar and row- oriented views, and selectively exposes only the most relevant representation to the LLM. During postprocessing, HYVE either returns the model output directly, queries the datastore to recover omitted information, or performs a bounded additional LLM call for SQL-augmented semantic synthesis. We evaluate HYVE on diverse real-world workloads spanning knowledge QA, chart generation, anomaly detection, and multi-step network troubleshooting. Across these benchmarks, HYVE reduces token usage by 50–90% while maintaining or improving output quality. On structured generation tasks, it improves chart-generation accuracy by up to 132% and reduces latency by up to 83%. Overall, HYVE offers a practical approximation to an effectively unbounded context window for prompts dominated by large machine-data payloads. I Introduction Machine data, such as logs, metrics, telemetry traces, and configuration snapshots, is ubiquitous in modern computing systems and underpins observability. When fed into LLM prompts or carried across multi-turn interactions, it often appears as an interleaving of natural language and large structured payloads. LLMs continue to struggle with such inputs for three recurring reasons: • Token explosion from verbosity: Nested keys and repeated schema consume the context window, fragmenting relevant evidence and crowding out useful data. • Context rot: The model misses the “needle” buried in large payloads and drifts from the instruction, losing track of task-relevant signals. • Weaknesses in numeric and categorical sequence reasoning: Long sequences obscure patterns such as anomalies, trends, and entity relationships that are critical for data analytics. Fig. 1: HYVE architecture. The preprocessor parses input strings with embedded structured segments into hybrid tabular views; the request-scoped datastore retains the full data; and the postprocessor inspects LLM outputs and, when needed, queries the datastore to enrich the response. Machine data often becomes long because system code naturally emits repeated structures: loops generate arrays, repeated keys, and nested records in the observable representation. The bottleneck is therefore not raw length alone. Effective use of such data requires structural transformation and signal enhancement , so that the same information is presented in forms better aligned with the reasoning strengths of LLMs [ 1 ] 1 1 1 HYVE was initially developed as DNM-ACE (Analytics Context Engineering for the Cisco Deep Network Model) and later renamed DNM-HYVE. Section V-F discusses its synergy with the DNM model. . Empirically, we observe that, in long-context settings, LLMs still make errors when correlating multiple arrays through their indices, whereas a row-oriented view makes this easier by presenting related values side by side. Conversely, LLMs often struggle to extract values from the same field across a list of dictionaries, such as when generating a line chart, whereas a column-oriented view places those values consecutively in order. I-A Motivating examples We illustrate the problem with two real examples. Figure 2 shows a slot-filling task, i.e., semantic querying over network telemetry data subject to specified requirements. Baseline GPT-4.1 consumes more than 5,000 tokens per request yet fails on 30.6% of samples (scores \leq 2), showing that naively embedding raw machine data in prompts is both inefficient and unreliable. In contrast, HYVE reduces token usage by 53% while achieving near-perfect quality (mean score 4.98) on all 700 test cases. Figure 3 shows a second example: when asked to generate a line chart from 778 exchange-rate points, baseline GPT-4.1 truncates output arrays to 40–120 points, causing most of the data to disappear and collapsing detailed time series into sparse straight-line segments. With HYVE, all 778 points are recovered, producing a faithful chart. HYVE has been deployed in Cisco AI products and is effective across a broad range of machine-data analytics tasks. Fig. 2: Slot-filling tasks over 700 network telemetry samples. Top: baseline GPT-4.1 consumes {\sim} 5000 tokens per request; HYVE reduces usage by 53%. Bottom: baseline GPT-4.1 fails on 30.6% of samples (scores \leq 2); HYVE achieves almost perfect scores on all samples. I-B Guiding principles HYVE is guided by database-inspired principles for analytics-oriented context engineering. It treats prompt construction not as ad hoc compression, but as a disciplined process of structure discovery, information preservation, and queryable representation. • Guarantee data fidelity: Context reduction must not lose information. Every part of the raw input is either preserved verbatim in the visible LLM context or retained in a request-scoped datastore with explicit schema information, so that omitted content remains fully recoverable. • Avoid semantic compression: Context reduction does not rely on LLM-based summarization, which may be ineffective for machine data. Instead, HYVE detects repetitive structures, organizes them into tables with precise schema, and exposes only a subset of entries selected by statistical ranking, while explicitly indicating that additional data remain available in the datastore. When hidden data are needed, the LLM can generate SQL over the provided schema, after which the postprocessor either backfills the result into a template or performs one additional synthesis step. • Limit LLM calls: HYVE is not an open-ended iterative agent. Instead, it operates as a service that preserves the same interface as a standard LLM endpoint. Beyond the primary LLM call, the system makes at most one additional LLM call by default; this can be configured to a small fixed number for SQL refinement, and is only needed when semantic synthesis over the retrieved evidence is required. Accurately generating SQL in a general open-ended environment remains challenging for LLMs. Our setting, however, is controlled: the preprocessor and postprocessor are tightly coupled within the scope of a single request. HYVE exploits this local request context to guide the LLM toward generating high-quality SQL queries tailored to each request. Because this scope is intentionally confined to a single request, HYVE provides only short-term memory. Section VI-B further discusses the distinction between short- and long-term memory. Unlike long-horizon agent memory in systems such as OpenClaw [ 24 ] , Claude Code [ 4 ] , Codex [ 23 ] , Gemini CLI [ 11 ] , OpenCode [ 25 ] , and Pi [ 27 ] , which often compress prior interaction history through summarization, HYVE uses exact request-scoped state for query-based recovery, making it a complementary approach. Fig. 3: Line chart over three years of USD exchange-rate data (778 points per series). Baseline GPT-4.1 truncates output arrays to 40–120 points, collapsing detailed time series into sparse straight-line segments. HYVE recovers all 778 points through data backfilling. I-C High-level design As illustrated in