Neural Router: Semantic Content Matching for Agentic AI Journal: TAAS Volume: 0 0 0 0 CCS: Computer systems organization Self-organizing autonomic computing CCS: Computer systems organization Cloud computing CCS: Theory of computation Distributed computing models CCS: Computing methodologies Natural language processing CCS: Networks Middleware for databases

Lauri Lovén, Abhishek Kumar, Alexander Engelhardt, Alaa Saleh, Roberto Morabito, Xiaoli Liu, Naser Hossein Motlagh, Sasu Tarkoma · 2026

Read Neural Router: Semantic Content Matching for Agentic AI Journal: TAAS Volume: 0 0 0 0 CCS: Computer systems organization Self-organizing autonomic computing CCS: Computer systems organization Cloud computing CCS: Theory of computation Distributed computing models CCS: Computing methodologies Natural language processing CCS: Networks Middleware for databases by Lauri Lovén, Abhishek Kumar, Alexander Engelhardt, Alaa Saleh, Roberto Morabito, Xiaoli Liu, Naser Hossein Motlagh, Sasu Tarkoma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25701.txt.

Introduction

Lovén and colleagues test large language models as semantic matchers for agentic AI brokers. Keyword and embedding filters fail on vocabulary and modality gaps. Framed as offline multi-label retrieval across social, legal and sensor domains, they offer a two-crossover cost-accuracy account. Below a context-window limit, CoverAndMerge cuts LLM calls; above a discrimination-capacity limit, accuracy collapses no matter the budget. Their findings: compression cannot rescue scores past that point, only frontier-scale models clear large sets, and backend choice beats settings.

Catalog record

CREATORLauri Lovén, Abhishek Kumar, Alexander Engelhardt, Alaa Saleh, Roberto Morabito, Xiaoli Liu, Naser Hossein Motlagh, Sasu Tarkoma
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE116177
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25701

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Neural Router: Semantic Content Matching for Agentic AI Journal: TAAS Volume: 0 0 0 0 CCS: Computer systems organization Self-organizing autonomic computing CCS: Computer systems organization Cloud computing CCS: Theory of computation Distributed computing models CCS: Computing methodologies Natural language processing CCS: Networks Middleware for databases Lauri Lovén, Abhishek Kumar, Alexander Engelhardt, Alaa Saleh, Roberto Morabito, Xiaoli Liu, Naser Hossein Motlagh, Sasu Tarkoma Abstract . Large language models (LLMs) can serve as the semantic-matching engine of a content-based publish/subscribe broker for agentic AI across the edge–cloud computing continuum, bridging the vocabulary and modality gaps that defeat keyword and embedding filters. Framed as offline multi-label retrieval over three public datasets spanning social-media, legal, and smart-home sensor domains (six LLMs, seven baselines), our central contribution is a two-crossover cost–accuracy characterisation: an analytical context-window crossover below which a CoverAndMerge compression pipeline reduces LLM invocations, and an empirical discrimination-capacity crossover above which matching accuracy collapses independently of context budget, by a model-dependent factor of parameter count and training generation. Two findings carry practical weight: above the discrimination crossover, compression cannot recover accuracy and only frontier-scale models clear large subscription sets; and there backend choice dominates configuration choice, so model selection, not pipeline tuning, is the primary operator lever. We accompany this with three composable algorithms and a per-cluster Quality-of-Experience framework for autonomic LLM-tier selection. 1. Introduction As autonomous AI agents increasingly operate across the computing continuum, from cloud services through network-edge infrastructure to IoT devices, they must discover and consume information produced by other agents and services whose data formats, vocabularies, and modalities they do not control ( 37 ; 41 ) ; ( 29 ) . A monitoring agent may need regulatory alerts written in legal jargon; a smart-environment agent must interpret raw sensor activations as human activities; a social-analytics agent consumes user-generated text in constantly evolving slang. Content-based publish/subscribe (pub/sub) systems ( 14 ; 8 ) provide a natural communication substrate for such loosely coupled, data-driven interactions, but traditional designs rely on keyword matching or attribute-based filters ( 7 ; 42 ) that are increasingly limited as the semantic gap between publishers and subscribers grows; embedding-based semantic-matching pipelines (e.g., Sentence-BERT cosine over the same description vocabulary) provide a natural intermediate, but stop short of the abductive reasoning required when modalities or vocabularies do not align. This paper studies the matching engine for such a broker as an offline multi-label retrieval problem; deployment-side concerns (online operation, fault tolerance, multi-tenant load) are scoped explicitly in Section 6.3 . Recent advances in Large Language Models (LLMs), built on deep neural architectures such as Transformers ( 43 ; 12 ) , have demonstrated remarkable semantic understanding of text. A growing body of work uses LLMs for routing , but the term is overloaded: in the LLM literature, “routing” typically means selecting which model should handle a given query ( 32 ; 15 ; 45 ) , or classifying user intent to trigger a predefined action ( 5 ) . These systems route queries to models. In contrast, content-based pub/sub requires matching published content against subscriber interests, a fundamentally different problem in which the LLM must evaluate whether a piece of content satisfies a natural-language interest description. To date, no system places an LLM inside the pub/sub matching loop. Surveys on message brokers for generative AI ( 37 ) and pub/sub for edge intelligence ( 39 ) identify the need to adapt brokers for AI workloads but do not propose LLM-based matching. Recent poster work explores LLM-generated notifications ( 16 ) , and the AI Interconnect concept envisions LLMs as orchestrators within pub/sub ( 41 ) , but neither replaces the matching function itself. In this paper, we propose the Neural Router ( Fig. 1 ), a content-based pub/sub matching engine that makes LLMs a first-class component of the content matching loop. Figure 1 . Conceptual overview of the Neural Router. Two pure-publisher agents (Sensor, Legal library) and four prosumer agents (Social, Activity recognition, Compliance, Brand monitoring) communicate through a single broker that matches published content to each agent’s natural-language interest via LLM reasoning; prosumers both publish and subscribe (content/interest in, matched content out). The highlighted link (bold red) marks the widest vocabulary/modality gap (raw sensor activations vs. a plain-language interest) where keyword and embedding matching fail by construction. Illustrative, not a deployment; the content types correspond to the evaluated domains ( Section 4 ). The design explicitly trades per-invocation latency for semantic accuracy: embedding-based clustering, subscription compression, batching, and parallel LLM invocation collectively keep end-to-end matching latency within the bounds acceptable for analytics, notification, and content-dissemination workloads. Our contributions are: (1) A cost-accuracy trade-off characterization for LLM-based content matching with two crossover points: an analytically derived context-window crossover predicting when subscription compression becomes cost-effective, and an empirically identified discrimination-capacity crossover above which LLM matching accuracy declines, with the magnitude of decline determined by the model’s effective capability rather than by parameter count alone ( Section 3 ). (2) A semantic matching architecture with three composable algorithms ( OptimizeSubscriptions , MatchEvents , CoverAndMerge ) and a QoE-based backend assignment mechanism for heterogeneous LLM backends ( Section 3 ). (3) An empirical validation across three content domains (CardiffNLP tweets, EUR-Lex legal documents, CASAS smart-home sensor logs), evaluating six LLM backends (open-weight Qwen 2.5 at 1.5B/7B/32B and Mistral 7B; closed-API Claude Haiku and Sonnet) and seven ablation configurations against seven baselines, including zero-shot NLI with DistilBART-MNLI. The results confirm the cost model’s polarity: raw matching (A0) dominates above the context-window crossover, while below it the compression pipeline’s empirical recall is conditional on the merged set’s discrimination structure ( Section 5.4 ). The four-model open-weight sweep shows the discrimination-capacity decline at |\mathcal{S}|{=}201 is monotonic in parameter count within the Qwen family and is lifted, at fixed scale, by newer training generations (Mistral 7B > Qwen 2.5 7B at matched scale; broader cross-family validation deferred) ( Sections 4 and 5 ). (4) A QoE-based heterogeneous backend assignment framework , with an empirical analysis identifying the calibration-sample-to-discrimination-gap ratio as the binding parameter. The framework routes subscription clusters to backends by per-cluster min-max-normalised weighted scoring of accuracy, cost, and latency, with three operator presets ( accuracy_first , balanced , cost_first ) yielding three distinct assignments. On CardiffNLP at a Qwen-2.5 (7B, 32B) gradient in the offline-batch single-tenant regime, round-robin is a strong calibration-free baseline — closing 83\% of the F1 gap at 0.7\times the larger-tier latency — and greedy QoE separates from it only at cost_first ; a calibration-fraction sweep ( \{0.05,\ldots,1.00\} ) never crosses \alpha{=}0.05 (Friedman p{=}0.290 ), so the ratio holds only in its weak, cost-side form on this gradient. Value under load skew, throughput heterogeneity, backend failure, and SLA constraints is left to deployment studies ( Sections 5 and 6.3 ). The Neural Router specifies a single-node content matching engine. The question of how multiple matching engine instances can be federated across a distributed computing continuum (e.g., across 6G network slices) is an important extension that we discuss as future work in Section 6 . The remainder of this article is organised as follows. Section 2 surveys related work and positions our contribution. Section 3 presents the Neural Router’s design, including the problem statement, architecture, algorithms, and cost model. Section

Read the complete text