Explaining Why Things Go Where They Go: Interpretable Constructs of Human Organizational Preferences Conference: Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction; March 16–19, 2026; Edinburgh, Scotland UK Proceedings of the 21st ACM/IEEE International Conference o

Emmanuel Fashae, Michael Burke, Leimin Tian, Lingheng Meng, Pamela Carreno-Medrano · 2025

Read Explaining Why Things Go Where They Go: Interpretable Constructs of Human Organizational Preferences Conference: Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction; March 16–19, 2026; Edinburgh, Scotland UK Proceedings of the 21st ACM/IEEE International Conference o by Emmanuel Fashae, Michael Burke, Leimin Tian, Lingheng Meng, Pamela Carreno-Medrano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-24829.txt.

Introduction

Emmanuel Fashae, Michael Burke, and Leimin Tian ask why people put household objects where they do, in terms a robot could understand and explain. Rearrangement robots often learn hidden preference models from demonstrations, which predict well but reveal little. Four interpretable constructs are proposed instead: spatial practicality, habitual convenience, semantic coherence, and commonsense appropriateness.

Each construct names a recognizable reason, such as keeping often-used items within reach or grouping items used for the same task. Readers in human-robot interaction get a vocabulary for preferences that can be checked and debated. Explainable placement should make home robots easier to trust and correct.

Catalog record

CREATOREmmanuel Fashae, Michael Burke, Leimin Tian, Lingheng Meng, Pamela Carreno-Medrano
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-24829

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Explaining Why Things Go Where They Go: Interpretable Constructs of Human Organizational Preferences Conference: Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction; March 16–19, 2026; Edinburgh, Scotland UK Proceedings of the 21st ACM/IEEE International Conference on Human-Robot Interaction (HRI ’26), March 16–19, 2026, Edinburgh, Scotland UK DOI: 10.1145/3757279.3785617 ISBN: 979-8-4007-2128-1/2026/03 CCS: Computer systems organization Robotics CCS: Human-centered computing User models CCS: Human-centered computing User studies CCS: Applied computing Psychology CCS: Computing methodologies Robotic planning CCS: Human-centered computing Interactive systems and tools CCS: Human-centered computing User studies CCS: Computer systems organization Robotics Emmanuel Fashae, Michael Burke, Leimin Tian, Lingheng Meng, Pamela Carreno-Medrano Abstract . Robotic systems for household object rearrangement often rely on latent preference models inferred from human demonstrations. While effective at prediction, these models offer limited insight into the interpretable factors that guide human decisions. We introduce an explicit formulation of object arrangement preferences along four interpretable constructs: spatial practicality (putting items where they naturally fit best in the space), habitual convenience (making frequently used items easy to reach), semantic coherence (placing items together if they are used for the same task or are contextually related), and commonsense appropriateness (putting things where people would usually expect to find them). To capture these constructs, we designed and validated a self-report questionnaire through a 63-participant online study. Results confirm the psychological distinctiveness of these constructs and their explanatory power across two scenarios (kitchen and living room). We demonstrate the utility of these constructs by integrating them into a Monte Carlo Tree Search (MCTS) planner and show that when guided by participant-derived preferences, our planner can generate reasonable arrangements that closely align with those generated by participants. This work contributes a compact, interpretable formulation of object arrangement preferences and a demonstration of how it can be operationalized for robot planning. † † cc-license: by 1. Introduction Object rearrangement, the problem of organizing items within a space to achieve a desired configuration ( Batra et al. 2020 ) , is a central challenge for service robots operating in everyday environments. Here, a robot must be capable not only of manipulating objects, but also of deciding where each object should go in a way that aligns with a user’s organizational preferences. Human organizational preferences are diverse (e.g. one person may want mugs by the kettle, while another may prefer them in a cabinet) and one-size-fits-all ( Kapelyukh and Johns 2023 ; Newman et al. 2024 ) definitions of what an acceptable arrangement is might fail to account for these differences. For robots to be useful in this context, they must be equipped with object rearrangement models that capture the salient criteria behind these preferences and that can adapt to differences across users and scenes, especially in shared environments. Prior work on the personalization of object rearrangement has aimed to tailor placements to reflect an individual user’s subjective spatial preferences rather than a universal notion of tidiness ( Kapelyukh and Johns 2022 ) . Abdo et al. ( Abdo et al. 2016 ) predicted user-specific groupings via collaborative filtering, while ( Kapelyukh and Johns 2022 ) introduced a framework for learning latent embeddings of tidying style from demonstrations. More recent systems approximate user preferences with zero-shot visual prompting of vision–language models ( Newman et al. 2024 ) , infer them from prior and current scene context ( Ramachandruni and Chernova 2025 ; Ramachandruni et al. 2023 ) , or actively query users when demonstrations are ambiguous ( Wang et al. 2025 ) . While these methods move beyond a ’one-size-fits-all’ approach, they do so by implicitly using latent representations that capture an overall preference signal without revealing the underlying factors that shape it. This makes it difficult to both understand why objects are placed where they are or tune arrangements according to specific priorities (e.g., convenience over aesthetics) or different scenarios without intensive retraining. To address these limitations, we propose grounding personalized object rearrangement in interpretable constructs that reflect how people organize their environments, while remaining adaptable to variation across users and contexts. Specifically, we formulate a compact representation of human organizational preferences in terms of four constructs: spatial practicality, habitual convenience, semantic coherence, and commonsense appropriateness, and investigate whether these human-aligned constructs are sufficient to explain how people reason about object arrangements in common household spaces. Our work makes three contributions: • Interpretable formulation of arrangement preferences: We show that the four explicit arrangement constructs (spatial, habitual, semantic, commonsense) capture variation across individuals and scenarios (i.e. kitchen and living room). • A measurement tool for the proposed constructs: We design and validate a self-report questionnaire that quantifies how strongly each construct influences participants’ judgments and establish that the constructs form a reliable and psychologically meaningful basis. • Preferences-alinged arrangement generation: We formulate cost functions for the constructs and integrate these into a Monte Carlo Tree Search (MCTS) planner for arrangement. This approach produces arrangements that align with human preferences when using participant-derived weights. 2. Related Work Most robotic object rearrangement systems optimize for a single, universal definition of what constitutes a “good” organization. In the indoor household environments, e.g., kitchens and living rooms, organization is primarily defined at the object- and room-levels, which are often described in spatial cognition as figural and vista spaces ( Montello 1993 ; Götz et al. 2025 ) . These methods use visuo-semantic priors and commonsense reasoning to move objects to plausible locations ( Sarch et al. 2022 ; Kant et al. 2022 ) , minimize spatial flow fields ( Goyal et al. 2022 ) , learn arrangement cost functions ( Kapelyukh and Johns 2023 ) , or leverage 3D mapping and semantic search ( Trabucco et al. 2022 ) . While effective at achieving tidy configurations, these methods cannot account for diverse user-specific organizational styles. In contrast, our work formulates users’ object (re)arrangement preference as a combination of four interpretable constructs, which is flexible and capable of accommodating diverse user preferences. For personalized rearrangement, Abdo et al. ( Abdo et al. 2016 ) used collaborative filtering to model co-occurrence patterns of object groupings, but this assumes a fixed organizational schema is given a priori and thus captures statistical regularities without explaining the underlying rationale. Other approaches to personalized rearrangement extract latent “tidying styles" from user-arranged scenes ( Kapelyukh and Johns 2022 ) , use large language models to summarize examples into rules ( Wu et al. 2023 ) , infer preferred placements from partial arrangements ( Ramachandruni et al. 2023 ) , employ zero-shot vision–language models ( Newman et al. 2024 ) , or actively query users to resolve ambiguities ( Wang et al. 2025 ) . These advances enable personalization and achieve good predictive performance, but rely on implicit representations that hide the principles guiding the generated arrangements. This lack of interpretability limits practical adoption. Reviews in human–robot interaction (HRI) and explainable robotics ( Anjomshoae et al. 2019 ; Sakai and Nagai 2022 ) emphasize that users (especially in personal spaces) benefit from explanations that communicate a robot’s goals and reasoning in human terms, rather than abstract model outputs. People prefer robots whose actions are legible and explainable ( Dragan et al. 2013 ; Chakraborti et al. 2017 ) . Both robotics research ( Rodríguez-Lera

Read the complete text