Neural Router: Semantic Content Matching for Agentic AI Journal: TAAS Volume: 0 0 0 0 CCS: Computer systems organization Self-organizing autonomic computing CCS: Computer systems organization Cloud computing CCS: Theory of computation Distributed computing models CCS: Computing methodologies Natural language processing CCS: Networks Middleware for databases
Lauri Lovén, Abhishek Kumar, Alexander Engelhardt, Alaa Saleh, Roberto Morabito, Xiaoli Liu, Naser Hossein Motlagh, Sasu Tarkoma · 2026
Read Neural Router: Semantic Content Matching for Agentic AI Journal: TAAS Volume: 0 0 0 0 CCS: Computer systems organization Self-organizing autonomic computing CCS: Computer systems organization Cloud computing CCS: Theory of computation Distributed computing models CCS: Computing methodologies Natural language processing CCS: Networks Middleware for databases by Lauri Lovén, Abhishek Kumar, Alexander Engelhardt, Alaa Saleh, Roberto Morabito, Xiaoli Liu, Naser Hossein Motlagh, Sasu Tarkoma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25701.txt.
Introduction
Lovén and colleagues test large language models as semantic matchers for agentic AI brokers. Keyword and embedding filters fail on vocabulary and modality gaps. Framed as offline multi-label retrieval across social, legal and sensor domains, they offer a two-crossover cost-accuracy account. Below a context-window limit, CoverAndMerge cuts LLM calls; above a discrimination-capacity limit, accuracy collapses no matter the budget. Their findings: compression cannot rescue scores past that point, only frontier-scale models clear large sets, and backend choice beats settings.
Catalog record
| CREATOR | Lauri Lovén, Abhishek Kumar, Alexander Engelhardt, Alaa Saleh, Roberto Morabito, Xiaoli Liu, Naser Hossein Motlagh, Sasu Tarkoma |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 116177 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25701
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Neural Router: Semantic Content Matching for Agentic AI Journal: TAAS Volume: 0 0 0 0 CCS: Computer systems organization Self-organizing autonomic computing CCS: Computer systems organization Cloud computing CCS: Theory of computation Distributed computing models CCS: Computing methodologies Natural language processing CCS: Networks Middleware for databases Lauri Lovén, Abhishek Kumar, Alexander Engelhardt, Alaa Saleh, Roberto Morabito, Xiaoli Liu, Naser Hossein Motlagh, Sasu Tarkoma Abstract . Large language models (LLMs) can serve as the semantic-matching engine of a content-based publish/subscribe broker for agentic AI across the edge–cloud computing continuum, bridging the vocabulary and modality gaps that defeat keyword and embedding filters. Framed as offline multi-label retrieval over three public datasets spanning social-media, legal, and smart-home sensor domains (six LLMs, seven baselines), our central contribution is a two-crossover cost–accuracy characterisation: an analytical context-window crossover below which a CoverAndMerge compression pipeline reduces LLM invocations, and an empirical discrimination-capacity crossover above which matching accuracy collapses independently of context budget, by a model-dependent factor of parameter count and training generation. Two findings carry practical weight: above the discrimination crossover, compression cannot recover accuracy and only frontier-scale models clear large subscription sets; and there backend choice dominates configuration choice, so model selection, not pipeline tuning, is the primary operator lever. We accompany this with three composable algorithms and a per-cluster Quality-of-Experience framework for autonomic LLM-tier selection. 1. Introduction As autonomous AI agents increasingly operate across the computing continuum, from cloud services through network-edge infrastructure to IoT devices, they must discover and consume information produced by other agents and services whose data formats, vocabularies, and modalities they do not control ( 37 ; 41 ) ; ( 29 ) . A monitoring agent may need regulatory alerts written in legal jargon; a smart-environment agent must interpret raw sensor activations as human activities; a social-analytics agent consumes user-generated text in constantly evolving slang. Content-based publish/subscribe (pub/sub) systems ( 14 ; 8 ) provide a natural communication substrate for such loosely coupled, data-driven interactions, but traditional designs rely on keyword matching or attribute-based filters ( 7 ; 42 ) that are increasingly limited as the semantic gap between publishers and subscribers grows; embedding-based semantic-matching pipelines (e.g., Sentence-BERT cosine over the same description vocabulary) provide a natural intermediate, but stop short of the abductive reasoning required when modalities or vocabularies do not align. This paper studies the matching engine for such a broker as an offline multi-label retrieval problem; deployment-side concerns (online operation, fault tolerance, multi-tenant load) are scoped explicitly in Section 6.3 . Recent advances in Large Language Models (LLMs), built on deep neural architectures such as Transformers ( 43 ; 12 ) , have demonstrated remarkable semantic understanding of text. A growing body of work uses LLMs for routing , but the term is overloaded: in the LLM literature, “routing” typically means selecting which model should handle a given query ( 32 ; 15 ; 45 ) , or classifying user intent to trigger a predefined action ( 5 ) . These systems route queries to models. In contrast, content-based pub/sub requires matching published content against subscriber interests, a fundamentally different problem in which the LLM must evaluate whether a piece of content satisfies a natural-language interest description. To date, no system places an LLM inside the pub/sub matching loop. Surveys on message brokers for generative AI ( 37 ) and pub/sub for edge intelligence ( 39 ) identify the need to adapt brokers for AI workloads but do not propose LLM-based matching. Recent poster work explores LLM-generated notifications ( 16 ) , and the AI Interconnect concept envisions LLMs as orchestrators within pub/sub ( 41 ) , but neither replaces the matching function itself. In this paper, we propose the Neural Router ( Fig. 1 ), a content-based pub/sub matching engine that makes LLMs a first-class component of the content matching loop. Figure 1 . Conceptual overview of the Neural Router. Two pure-publisher agents (Sensor, Legal library) and four prosumer agents (Social, Activity recognition, Compliance, Brand monitoring) communicate through a single broker that matches published content to each agent’s natural-language interest via LLM reasoning; prosumers both publish and subscribe (content/interest in, matched content out). The highlighted link (bold red) marks the widest vocabulary/modality gap (raw sensor activations vs. a plain-language interest) where keyword and embedding matching fail by construction. Illustrative, not a deployment; the content types correspond to the evaluated domains ( Section 4 ). The design explicitly trades per-invocation latency for semantic accuracy: embedding-based clustering, subscription compression, batching, and parallel LLM invocation collectively keep end-to-end matching latency within the bounds acceptable for analytics, notification, and content-dissemination workloads. Our contributions are: (1) A cost-accuracy trade-off characterization for LLM-based content matching with two crossover points: an analytically derived context-window crossover predicting when subscription compression becomes cost-effective, and an empirically identified discrimination-capacity crossover above which LLM matching accuracy declines, with the magnitude of decline determined by the model’s effective capability rather than by parameter count alone ( Section 3 ). (2) A semantic matching architecture with three composable algorithms ( OptimizeSubscriptions , MatchEvents , CoverAndMerge ) and a QoE-based backend assignment mechanism for heterogeneous LLM backends ( Section 3 ). (3) An empirical validation across three content domains (CardiffNLP tweets, EUR-Lex legal documents, CASAS smart-home sensor logs), evaluating six LLM backends (open-weight Qwen 2.5 at 1.5B/7B/32B and Mistral 7B; closed-API Claude Haiku and Sonnet) and seven ablation configurations against seven baselines, including zero-shot NLI with DistilBART-MNLI. The results confirm the cost model’s polarity: raw matching (A0) dominates above the context-window crossover, while below it the compression pipeline’s empirical recall is conditional on the merged set’s discrimination structure ( Section 5.4 ). The four-model open-weight sweep shows the discrimination-capacity decline at |\mathcal{S}|{=}201 is monotonic in parameter count within the Qwen family and is lifted, at fixed scale, by newer training generations (Mistral 7B > Qwen 2.5 7B at matched scale; broader cross-family validation deferred) ( Sections 4 and 5 ). (4) A QoE-based heterogeneous backend assignment framework , with an empirical analysis identifying the calibration-sample-to-discrimination-gap ratio as the binding parameter. The framework routes subscription clusters to backends by per-cluster min-max-normalised weighted scoring of accuracy, cost, and latency, with three operator presets ( accuracy_first , balanced , cost_first ) yielding three distinct assignments. On CardiffNLP at a Qwen-2.5 (7B, 32B) gradient in the offline-batch single-tenant regime, round-robin is a strong calibration-free baseline — closing 83\% of the F1 gap at 0.7\times the larger-tier latency — and greedy QoE separates from it only at cost_first ; a calibration-fraction sweep ( \{0.05,\ldots,1.00\} ) never crosses \alpha{=}0.05 (Friedman p{=}0.290 ), so the ratio holds only in its weak, cost-side form on this gradient. Value under load skew, throughput heterogeneity, backend failure, and SLA constraints is left to deployment studies ( Sections 5 and 6.3 ). The Neural Router specifies a single-node content matching engine. The question of how multiple matching engine instances can be federated across a distributed computing continuum (e.g., across 6G network slices) is an important extension that we discuss as future work in Section 6 . The remainder of this article is organised as follows. Section 2 surveys related work and positions our contribution. Section 3 presents the Neural Router’s design, including the problem statement, architecture, algorithms, and cost model. Section