NOEM 3 A: a Neuro-symbolic Ontology-Enhanced Method for Multi-intent understanding in Mobile Agents
Ioannis Tzachristas, Aifen Sui · 2025
Read NOEM 3 A: a Neuro-symbolic Ontology-Enhanced Method for Multi-intent understanding in Mobile Agents by Ioannis Tzachristas, Aifen Sui (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-19780.txt.
Introduction
Ioannis Tzachristas and Aifen Sui help phone agents understand requests that carry several intents at once. A mobile agent must turn natural language into executable actions under tight speed and privacy limits, and simply enlarging the language model is wasteful. Their layer, NOEM3A, adds an intent ontology to compact models.
For each query, the system pulls a small neighborhood of the ontology, feeds candidate action labels into the prompt, and biases decoding toward valid labels. A hierarchy-aware score judges near misses by meaning, not spelling. On MultiWOZ dialogues, the ontology boost improves small Llama models on exact match and slot scores alike.
Catalog record
| CREATOR | Ioannis Tzachristas, Aifen Sui |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 16 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-19780
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NOEM 3 A: a Neuro-symbolic Ontology-Enhanced Method for Multi-intent understanding in Mobile Agents Ioannis Tzachristas, Aifen Sui Abstract Mobile agents must map natural-language requests to executable intents under tight latency and privacy constraints. Scaling the language model is often an inefficient way to improve this component. We present NOEM 3 A, a lightweight neuro-symbolic layer that augments compact language models with an intent ontology. For each query, NOEM 3 A retrieves a small ontology neighborhood, injects candidate action labels into the prompt and applies a token-level decoding prior toward valid labels. This injects symbolic intent structure into both input and output representations while keeping inference suitable for local interaction. We also use Semantic Intent Similarity (SIS), a hierarchy-aware diagnostic based on ontology depth, to capture semantic proximity when predicted intents differ lexically. Experiments on MultiWOZ 2.3 dialogues show that ontology augmentation consistently improves TinyLlama and Llama-3.2-3B on exact match and Slot-F1. Our results suggest that symbolic alignment is an effective strategy for accurate, responsive and privacy-preserving on-device NLU. 1 Introduction Mobile assistants and GUI-based agents increasingly perform actions rather than only answer questions ( Tzachristas, 2024 ) : booking travel, creating reminders, ordering food, searching products or coordinating several tools. A single utterance may contain multiple intents ( Gangadharaiah and Narayanaswamy, 2019 ) , as in "find a hotel near the station, book a taxi and remind me before departure". The language component must therefore produce a valid set of tool-facing labels, and it must do so fast enough for local interaction. Large Language Models are effective semantic parsers, but they are not always the right deployment primitive for mobile agents. Cloud inference introduces privacy exposure and tail latency, while larger local models increase memory pressure and token-by-token compute. We study a complementary efficiency strategy: keep the neural model compact and supply an explicit symbolic action space at inference time. We propose NOEM 3 A (Neuro-symbolic Ontology-Enhanced Method for Multi-intent understanding in Mobile Agents). Following ontology/knowledge-guided NLP work ( Pinhanez et al., 2021 ; He et al., 2021 ; Yu et al., 2023 ; He et al., 2023 ) , the method uses an ontology whose nodes are mobile-agent domains, categories and executable intents. At runtime, the system retrieves a query-specific subgraph and uses it as both input context and output constraint. This shifts part of the reasoning burden from parametric generation to a small, inspectable symbolic lookup. Related work further includes out-of-scope and zero-shot intent detection ( Cavalin et al., 2020 ; Siddique et al., 2021 ) , LLM-assisted ontology construction and graph prompting ( Doumanas et al., 2025 ; Wen et al., 2024 ; Liu et al., 2025 ) , knowledge-injected language models ( Zhang et al., 2019 ) and dialogue-state methods used as MultiWOZ 2.3 context ( Hu et al., 2022 ; Lee and Lee, 2024 ; Heck et al., 2023 ; Chung et al., 2023 ; Li et al., 2024 ) . This paper focuses on efficient inference. We use exact match and Slot-F1 as primary task measures. We also report Semantic Intent Similarity ( SIS ) as an auxiliary diagnostic for whether an error stays near the correct ontology branch, but we avoid treating it as a standalone claim of success. Our contributions are: (i) a formalized ontology-guided inference layer for multi-intent mobile NLU; (ii) a latency-focused accounting that separates retrieval, decoding bias and neural inference; and (iii) an evaluation showing that symbolic guidance improves compact models without requiring a larger generator. Figure 1: The NOEM 3 A pipeline. A user query is matched to candidate ontology nodes; the retrieved candidates are serialized into a structured prompt and used as a decoding prior so that the compact model emits ontology-valid intent labels. All Intents Ticket Booking Flight Booking Event Ticket Food Delivery Restaurant Order Grocery Order Holiday Planning Itinerary Planning Hotel Search Online Shopping Product Search Purchase Order Order Tracking Figure 2: Excerpt from the ontology graph of mobile intents. Four top-level domains (Ticket Booking, Food Delivery, Holiday Planning, Online Shopping) are shown with some of their sub-intents. Each intent label is split over two lines for improved visual clarity. 2 Formal Method Intent ontology. We represent the action space as a directed ontology \mathcal{O}=(V,E) , where each node v\in V is a domain, category or executable intent and edges encode typed relations such as is-a or related-to . Each node stores a label \ell(v) , description d(v) and embedding e_{v}=f\bigl(\ell(v)\oplus d(v)\bigr)\in\mathbb{R}^{m}, (1) where f is the same lightweight encoder used at inference time. The ontology therefore acts as both an action schema and a searchable memory over valid labels. Subgraph retrieval. Given a query q , we compute e_{q}=f(q) and rank ontology nodes by cosine similarity, s(q,v)=\frac{e_{q}^{\top}e_{v}}{\lVert e_{q}\rVert_{2}\lVert e_{v}\rVert_{2}}. (2) The raw candidate set is C_{q}=\operatorname{TopK}_{v\in V}s(q,v) . We then retrieve a local neighborhood G_{q}=\operatorname{Expand}(\mathcal{O},C_{q};r), (3) where r controls optional parent, child or sibling expansion. In practice, G_{q} is small and fixed, so the downstream prompt remains short even when the ontology grows. Ontology-augmented prompt. The retrieved labels are serialized into a compact instruction. Abstractly, P_{q}=\bigl[q;\ell(v_{1}),\ldots,\ell(v_{k})\bigr], (4) where the concrete prompt asks the model to choose one or more intents from the listed labels. This changes the task from unconstrained generation to selection among plausible ontology labels. Unlike document retrieval methods ( Lewis et al., 2020 ; Hu et al., 2025 ; Edge et al., 2025 ) , the retrieved objects are not evidence passages but executable action types. Figure 3 illustrates this token-to-node alignment. Order a pizza and track my order User Query Tokens Restaurant Order Order Tracking Ontology Nodes 0.88 0.75 0.80 0.79 Figure 3: Semantic alignment between query tokens and ontology node embeddings. For the query "Order a pizza and track my order", food-ordering tokens align with Restaurant Order , while the tracking context aligns with Order Tracking . This alignment allows the retriever to select both intent nodes as relevant. Token-level decoding prior. Let T(G_{q}) be the set of tokenizer IDs appearing in labels from G_{q} . During decoding, we add a small bias to candidate-label tokens and a mild penalty to unrelated label tokens: b_{t}=\begin{cases}\beta,&t\in T(G_{q}),\\ -\gamma,&t\in T(V\setminus G_{q}),\\ 0,&\text{otherwise,}\end{cases}\qquad z^{\prime}_{t}=z_{t}+b_{t}. (5) The next-token distribution is then p_{t}=\operatorname{softmax}(z^{\prime})_{t} . We tune \beta and \gamma conservatively; the goal is to regularize labels rather than force an intent when the query does not support it. Figure 4 shows the intended effect of the decoding prior. BookFlight BookHotel OrderPizza CheckWeather Other 0 0.2 0.4 0.6 0.8 1 Logit Value Original logits After logit bias Figure 4: Effect of logit biasing in ontology-augmented inference. Ontology-relevant intents like BookFlight and BookHotel receive higher logits, while less relevant or unrelated intents are suppressed. Auxiliary classifier. When labeled data are available, we attach a multi-label classifier to the pooled hidden state h_{q} : p^{\mathrm{clf}}=\operatorname{sigmoid}(Wh_{q}+a), (6) \begin{split}\mathcal{L}_{\mathrm{clf}}=-\sum_{v\in V}\bigl[&y_{v}\log p_{v}\\ &+(1-y_{v})\log(1-p_{v})\bigr].\end{split} (7) Generated labels and classifier labels are merged as \hat{Y}=Y_{\mathrm{gen}}\cup\{v\in V:p^{\mathrm{clf}}_{v}>\tau\}. (8) This optional head is useful when a mobile platform has curated logs or simulator-generated labels. Hierarchy-aware diagnostic. For analysis only, we compute a taxonomy score inspired by Wu and Palmer similarity ( Wu and Palmer, 1994 ) . For predicted node u and gold node v , \textsc{SIS}(u,v)=\frac{2\,\mathrm{depth}(\operatorname{LCA}(u,v))}{\mathrm{depth}(u)+\mathrm{depth}(v)}. (9) For multi-intent sets, we compute a