Less or More: Towards Glanceable Explanations for LLM Recommendations Using Ultra-Small Devices

Xinru Wang, Mengjie Yu, Hannah Nguyen, Michael Iuzzolino, Tianyi Wang, Peiqi Tang, Natasha Lynova, Quoc Co Tran, Ting Zhang, Naveen Sendhilnathan, Hrvoje Benko, Haijun Xia, Tanya Jonker · 2025

Read Less or More: Towards Glanceable Explanations for LLM Recommendations Using Ultra-Small Devices by Xinru Wang, Mengjie Yu, Hannah Nguyen, Michael Iuzzolino, Tianyi Wang, Peiqi Tang, Natasha Lynova, Quoc Co Tran, Ting Zhang, Naveen Sendhilnathan, Hrvoje Benko, Haijun Xia, Tanya Jonker (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-19410.txt.

Introduction

Xinru Wang and eleven co-authors study how smart assistants should explain their advice on tiny watch screens in a paper from 2025. Large language models can suggest daily actions, but their wordy reasons are hard to read at a glance. The team tried two fixes: sorting each reason into clear parts, and showing reasons only when the model seems unsure.

In a user study, sorted reasons cut reading time and mental effort and sped up choices. Always-on sorted reasons also raised trust in the advice. Yet users liked them less, wanting more detail, and the timed version helped least. Lessons for watch design close the paper.

Catalog record

CREATORXinru Wang, Mengjie Yu, Hannah Nguyen, Michael Iuzzolino, Tianyi Wang, Peiqi Tang, Natasha Lynova, Quoc Co Tran, Ting Zhang, Naveen Sendhilnathan, Hrvoje Benko, Haijun Xia, Tanya Jonker
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-19410

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Less or More: Towards Glanceable Explanations for LLM Recommendations Using Ultra-Small Devices Xinru Wang, Mengjie Yu, Hannah Nguyen, Michael Iuzzolino, Tianyi Wang, Peiqi Tang, Natasha Lynova, Quoc Co Tran, Ting Zhang, Naveen Sendhilnathan, Hrvoje Benko, Haijun Xia, Tanya Jonker Abstract . Large Language Models (LLMs) have shown remarkable potential in recommending everyday actions as personal AI assistants, while Explainable AI (XAI) techniques are being increasingly utilized to help users understand why a recommendation is given. Personal AI assistants today are often located on ultra-small devices such as smartwatches, which have limited screen space. The verbosity of LLM-generated explanations, however, makes it challenging to deliver glanceable LLM explanations on such ultra-small devices. To address this, we explored 1) spatially structuring an LLM’s explanation text using defined contextual components during prompting and 2) presenting temporally adaptive explanations to users based on confidence levels. We conducted a user study to understand how these approaches impacted user experiences when interacting with LLM recommendations and explanations on ultra-small devices. The results showed that structured explanations reduced users’ time to action and cognitive load when reading an explanation. Always-on structured explanations increased users’ acceptance of AI recommendations. However, users were less satisfied with structured explanations compared to unstructured ones due to their lack of sufficient, readable details. Additionally, adaptively presenting structured explanations was less effective at improving user perceptions of the AI compared to the always-on structured explanations. Together with users’ interview feedback, the results led to design implications to be mindful of when personalizing the content and timing of LLM explanations that are displayed on ultra-small devices. Conference: 30th International Conference on Intelligent User Interfaces; March 24–27, 2025; Cagliari, Italy 30th International Conference on Intelligent User Interfaces (IUI ’25), March 24–27, 2025, Cagliari, Italy DOI: 10.1145/3708359.3712074 ISBN: 979-8-4007-1306-4/25/03 CCS: Human-centered computing Empirical studies in interaction design CCS: Computing methodologies Artificial intelligence † † cc-license: by 1. Introduction Artificial Intelligence (AI) advancements over the past decades have led to the development of AI-based personal assistants, which have become a popular way for human users to interact with digital devices and data. More recently, Large Language Models (LLMs) such as the GPT ( Achiam et al., 2023 ) and LLaMa ( Touvron et al., 2023 ) series have shown remarkable performance in generation tasks, which has led to their growing use as a method to make everyday contextual recommendations for AI-based personal assistants ( Li et al., 2024 ; Cosentino et al., 2024 ) . In addition, to ensure transparency and control during human-AI interaction, there has been a growing interest in Explainable AI (XAI) techniques that can help users understand and trust the AI assistance they receive ( Ribeiro et al., 2016 ; Zhang et al., 2020 ; Wang and Yin, 2021 ; Rebanal et al., 2021 ; Xu et al., 2023 ) . In the context of LLMs, those models based on transformer architectures are capable of generating explanations that rationalize their reasoning process using natural language ( Wei et al., 2022 ; Kojima et al., 2022 ) . An emerging manifestation of AI-based personal assistant has been on ultra-small devices, such as smartwatches, smartglasses ( Meta, 2024 ; Google, 2019 ) , and on-cloth gadgets ( Humane, 2024 ) , to offer low-friction assistance that is seamlessly integrated into the physical world. These devices rely on vast amount of user contextual data gathered from their sensors (e.g., egocentric video, gaze tracking, and audio) to predict the goal of the user’s next action and generate action recommendations ( Jonker et al., 2020 ) , such as launching an application, to help users efficiently complete daily tasks. Interacting with LLM recommendations and explanations on such ultra-small devices can, however, be challenging for several reasons. First, LLM self-explanations are often verbose and time-consuming to comprehend ( Jiang et al., 2023 ) , while the constrained screen space on ultra-small devices exacerbates the challenge of displaying verbose explanations. Real-world examples include smartwatches or Augmented Reality (AR) glasses, which have limited screen real estate that is available, and struggle to display long messages ( Duchnicky and Kolers, 1983 ) . Designers need to carefully condense the content of an explanation to ensure it remains relevant and informative while not overloading the limited screen space. Additionally, some tasks, such as providing route adjustment recommendations while driving, are inherently time-sensitive and consume a lot of the user’s cognitive resources. Thus, it is crucial to optimize the timing of explanations by presenting them only at moments when they would be most useful or when a user requests them to prevent unnecessary user interruptions ( Xu et al., 2023 ) . To overcome these challenges, this work aims to design glanceable explanations for a goal-oriented, contextual LLM action recommendation system for end-users using ultra-small devices. We focused on improving spatial and temporal glanceability via two research questions: • RQ1: To improve the spatial glanceability of LLM explanations on ultra-small devices, how should LLM explanation text be structured ? • RQ2: To take a step beyond and further improve the temporal glanceability of LLM explanations on ultra-small devices, how should LLM explanations be adaptively presented? To answer these questions, we designed a web-based interface that enabled us to simulate an LLM recommending and explaining actions to a user when they were using an AI-based personal assistant embedded in a smartwatch, and we recruited participants to interact with this interface. A subset of Ego4D ( Grauman et al., 2022 ) videos featuring digital interactions in people’s daily activities was selected for evaluation. We used a learning approach based on Socratic Models ( Zeng et al., 2022 ) with the dataset, where pre-trained vision-language models were used to generate a linguistic summarization (e.g., user physical actions and detected objects) of a video input for downstream processing with an LLM, which then made inferences and generated action recommendations. To improve spatial glanceability ( RQ1 ), we converted an LLM’s verbose explanation text into concise concepts and intuitive icons that users could grasp at a glance. We adopted a Chain-of-Thought prompt strategy ( Wei et al., 2022 ; Kojima et al., 2022 ) and broke down the inference process into steps. An LLM first summarized all possible contexts (i.e., the [activity] the user is doing, the [object] the user is interacting with, and the [location] the user is in) from the output of the vision-language models. Then, the LLM inferred the short-term [goal] that the user wanted to achieve and provided a digital action recommendation that the user could take as a next step. Instead of displaying lengthy text, the explanation only included the four structured components. To improve temporal glanceability ( RQ2 ), we focused on situations when the intelligent system became uncertain and needed user confirmation ( Xu et al., 2023 ) . We employed a hybrid method ( Xiong et al., 2024 ; Chen and Mueller, 2023 ) that combined the consistency among multiple responses and the textual confidence generated by the model to extract the confidence level for each recommendation. Explanations were automatically presented whenever the recommendation confidence was low, otherwise they were only displayed upon the user’s request. We then conducted a user study with 44 participants to understand users’ experiences when provided

Read the complete text