The Scenic Route to Deception: Dark Patterns and Explainability Pitfalls in Conversational Navigation Conference: IUI MIRAGE 2026 workshop held at 31st International Conference on Intelligent User Interfaces; March 23, 2026; Paphos, Cyprus IUI MIRAGE 2026 workshop held at 31st International Conference on Intelligent User Interfaces CCS: Applied computing CCS: Human-centered computing Human computer interaction (HCI) CCS: Human-centered computing Interaction design

Ilya Ilyankou, Stefano Cavazzi, James Haworth · 2026

Read The Scenic Route to Deception: Dark Patterns and Explainability Pitfalls in Conversational Navigation Conference: IUI MIRAGE 2026 workshop held at 31st International Conference on Intelligent User Interfaces; March 23, 2026; Paphos, Cyprus IUI MIRAGE 2026 workshop held at 31st International Conference on Intelligent User Interfaces CCS: Applied computing CCS: Human-centered computing Human computer interaction (HCI) CCS: Human-centered computing Interaction design by Ilya Ilyankou, Stefano Cavazzi, James Haworth (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-14586.txt.

Introduction

Ilyankou, Cavazzi and Haworth warn of deception risks in AI navigation chat. Walking directions are shifting from checked geometry to fluent dialogue. Smooth talk can hide manipulation and breed misplaced trust. The authors sort risks in a two-by-two frame by intent and origin. Willful tricks count as dark patterns. Accidental harms count as explainability pitfalls. Seamful design steps can cut both kinds of harm. A neuro-symbolic build, with checked pathfinding under the chat layer, anchors their fix.

Catalog record

CREATORIlya Ilyankou, Stefano Cavazzi, James Haworth
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24540
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.14586

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Scenic Route to Deception: Dark Patterns and Explainability Pitfalls in Conversational Navigation Conference: IUI MIRAGE 2026 workshop held at 31st International Conference on Intelligent User Interfaces; March 23, 2026; Paphos, Cyprus IUI MIRAGE 2026 workshop held at 31st International Conference on Intelligent User Interfaces CCS: Applied computing CCS: Human-centered computing Human computer interaction (HCI) CCS: Human-centered computing Interaction design Ilya Ilyankou, Stefano Cavazzi, James Haworth Abstract . As pedestrian navigation increasingly experiments with Generative AI, and in particular Large Language Models, the nature of routing risks transforming from a verifiable geometric task into an opaque, persuasive dialogue. While conversational interfaces promise personalisation, they introduce risks of manipulation and misplaced trust. We categorise these risks using a 2 × 2 2\times 2 framework based on intent and origin, distinguishing between intentional manipulations (dark patterns) and unintended harms (explainability pitfalls). We propose seamful design strategies to mitigate these harms. We suggest that one robust way to operationalise trustworthy conversational navigation is through neuro-symbolic architecture, where verifiable pathfinding algorithms ground GenAI’s persuasive capabilities, ensuring systems explain their limitations and incentives as clearly as they explain the route. † † cc-license: by 1. Introduction For decades, wayfinding has been dominated by a single, verifiable objective: efficiency. Whether driving or walking, the ‘best’ route is typically the fastest one, and the explanation provided by an interface is self-evident: ‘10 minutes’ is objectively better than ‘12 minutes’. Users trust these systems because the logic is transparent and the metric is mathematical. However, the integration of Generative AI (GenAI), in particular Large Language Models (LLMs), with geospatial data is transforming navigation 1 1 1 In this paper, we use the term navigation to refer to both initial route planning and subsequent turn-by-turn guidance along a chosen path, as we expect this distinction to blur as on-demand, dynamically updated assistance becomes the norm. from a geometric calculation and template-based instructions into conversational persuasion ( 21 ; 1 ; 36 ; 5 ; 35 ) . New systems experiment with ambient guidance ( 9 ) and promise to understand intent, mood, and context, allowing for complex semantic queries like ‘Find me a scenic route to the station’ . In this context, the system’s dialogue serves as the explanation interface ( 24 ) . When a navigation agent verbalises the rationale for a path, claiming it to be ‘safe’, ‘scenic’ or ‘lively’, it provides a natural language explanation ( 3 ) that is difficult to verify against ground truth. This shift creates a semantic gap where the system’s interpretation may decouple from user intent, ultimately producing a description that diverges from physical reality. We argue that this gap is the breeding ground for two distinct types of harm: • Dark patterns (DPs), where the system is intentionally designed to manipulate the user ( 2 ) . For example, an agent may exploit the subjective definition of ‘lively’ to steer a pedestrian through a commercial ‘partner zone’, effectively selling their footfall while disguising the motive as aesthetic advice. • Explainability pitfalls (EPs), where unanticipated negative effects emerge without deceptive intent ( 7 ) . For example, an agent may maintain a relaxing conversational persona while routing a user through an unlit park at night, creating a false sense of security and leading to unwarranted trust. In this position paper, we argue that without rigorous intervention, conversational navigation risks becoming the Wild West of commercial steering and potentially dangerous spatial hallucinations. This work is driven by the following research questions (RQs): (1) How can conversational navigation systems minimise manipulation and misrepresentation while maintaining usability and trust? And, more specifically, (2) How can we operationalise the distinction between intentional manipulation and unintentional error to build verifiable conversational navigation systems? We contribute a 2\times 2 framework classifying these risks by intent (deliberate vs accidental) and origin (routing vs interface), and propose a neuro-symbolic architecture ( 8 ) that enforces seamful design ( 4 ; 6 ; 13 ) interventions, specifically sponsorship disclosure ( 30 ) , progressive consent ( 18 ) , and trust calibration ( 16 ) via uncertainty-aware language ( 15 ; 28 ) to move towards ‘honest’ conversational navigation systems that clearly explain their own limitations. 2. Related work The risks introduced by LLM-enhanced systems have been catalogued extensively at a general level. Brignull’s foundational work on DPs ( 2 ) established the vocabulary of intentional interface manipulation, while Ehsan and Riedl ( 7 ) extended this to unintentional harms (EPs), coining the distinction that anchors our framework. Broad attempts to unify AI risk taxonomies, most notably the MIT AI Risk Repository ( 27 ) , which catalogues over 1,700 risks 2 2 2 https://airisk.mit.edu/ , representing them along high-level Entity, Intentionality, and Timing axes. Our proposed 2\times 2 framework maps directly onto two of these axes: our deliberate vs accidental distinction corresponds to Intentionality, and our routing vs interface dimension reflects the Entity axis’s implicit distinction between system-originated and human-designed failures. The risks we identify are not unique to navigation. Hidden incentives appear in recommender systems ( 23 ; 30 ) , overconfidence in AI-assisted clinical and legal decision-making ( 16 ) , and functionality gating (asking for extra permissions to enable certain features) across data-hungry consumer applications. What distinguishes navigation is the embodied, real-time consequence: a miscalibrated film recommendation carries no physical risk, whereas a pedestrian routed through a dangerous, unlit park at night on the basis of an overly reassuring conversational persona may face physical harm. This context-specificity motivates our proposed domain-targeted mitigation. On the technical side, neuro-symbolic approaches have been applied to improve factual reliability in LLM reasoning. Frameworks such as SymbCoT ( 33 ) and LINC ( 22 ) use LLMs as translators that offload inference to symbolic engines. Our architecture also uses this separation but for a different goal: we use the symbolic layer to generate structured metadata flags that deterministically trigger mandatory interface-level disclosures. The novelty is not the architecture per se, but its deployment as an honesty-enforcement mechanism to ensure that warnings about data quality and commercial intent are auditable and cannot be suppressed by the conversational layer. 3. Categorising Harms: A 2\times 2 Framework Origin Intent Routing (Hidden Logic/Back-end) Interface (Presentation/Tone/Front-end) Deliberate (DPs) Example: Hidden Incentives Steering users to sponsored locations under the guise of ‘atmosphere’ or ‘spatial capital’ ( 25 ) Ex: Functionality Gating Falsely claiming a basic feature requires invasive data, coercing user to share more than necessary Accidental (EPs) Ex: Overconfidence Routing logic relies on hallucinated or outdated safety data, but the system presents it matter-of-factly Ex: Contextual Mismatch The persona remains ‘calm/relaxing’ in a dangerous environment, lowering user vigilance Table 1. A taxonomy of conversational navigation risks. We identify four broad categories of harm, illustrated here by specific examples: Hidden Incentives (Routing, DP), Functionality Gating (Interface, DP), Overconfidence (Routing, EP), and Contextual Mismatch (Interface, EP) To categorise the risks in conversational navigation, we propose a 2\times 2 framework that categorises harms along two axes, as shown in Table 1 : • Intent : We distinguish deliberate DPs, where deceptive practices are intentionally designed to manipulate users, and accidental EPs, where negative effects emerge without the intention to deceive. • Origin : We also distinguish between deceptive practices

Read the complete text