“Who Should I Believe?”: User Interpretation and Decision-Making When a Family Healthcare Robot Contradicts Human Memory
Hong Wang, Natalia Calvo-Barajas, Katie Winkle, Ginevra Castellano · 2025
Read “Who Should I Believe?”: User Interpretation and Decision-Making When a Family Healthcare Robot Contradicts Human Memory by Hong Wang, Natalia Calvo-Barajas, Katie Winkle, Ginevra Castellano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-21322.txt.
Introduction
Home health robots are getting closer to daily use, but a robot can clash with what a user remembers, and that clash can shake trust. The four authors ran a 2 by 2 online study with 176 participants. They watched videos of a Furhat robot acting as a family health assistant. The robot told a fictional user to take medication at a time that differed from the remembered one. The team varied the robot's transparency and sociability.
Transparency changed how people read the mismatch. With a low transparency robot, most assumed the user had misremembered. With a high transparency robot, more blamed outside factors, such as a partner changing the robot's data. Many participants also overtrusted the robot, siding with it over the user's memory even when they suspected a fault. The authors flag access control for multi-user home robots as a pressing design issue.
Catalog record
| CREATOR | Hong Wang, Natalia Calvo-Barajas, Katie Winkle, Ginevra Castellano |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-21322
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
“Who Should I Believe?”: User Interpretation and Decision-Making When a Family Healthcare Robot Contradicts Human Memory Hong Wang, Natalia Calvo-Barajas, Katie Winkle, Ginevra Castellano Abstract Advancements in robotic capabilities for providing physical assistance, psychological support, and daily health management are making the deployment of intelligent healthcare robots in home environments increasingly feasible in the near future. However, challenges arise when the information provided by these robots contradicts users’ memory, raising concerns about user trust and decision-making. This paper presents a study that examines how varying a robot’s level of transparency and sociability influences user interpretation, decision-making and perceived trust when faced with conflicting information from a robot. In a 2 × 2 between-subjects online study, 176 participants watched videos of a Furhat robot acting as a family healthcare assistant and suggesting a fictional user to take medication at a different time from that remembered by the user. Results indicate that robot transparency influenced users’ interpretation of information discrepancies: with a low transparency robot, the most frequent assumption was that the user had not correctly remembered the time, while with the high transparency robot, participants were more likely to attribute the discrepancy to external factors, such as a partner or another household member modifying the robot’s information. Additionally, participants exhibited a tendency toward overtrust, often prioritizing the robot’s recommendations over the user’s memory, even when suspecting system malfunctions or third-party interference. These findings highlight the impact of transparency mechanisms in robotic systems, the complexity and importance associated with system access control for multi-user robots deployed in home environments, and the potential risks of users’ over-reliance on robots in sensitive domains such as healthcare. I INTRODUCTION With the global trends of population aging and a shortage of healthcare professionals, healthcare robots in households are being investigated as a possible solution. Recent breakthroughs in artificial intelligence and robotics have made it increasingly feasible for socially intelligent robots to provide physical assistance [ 1 ] , psychological support [ 2 ] , and daily health management [ 3 ] in real-world settings. However, integrating robots into home healthcare environments introduces new challenges. When robots become part of users’ daily lives in a home setting, interactions will involve significant information exchange with multiple individuals, including but not limited to all household members, family caregivers, and doctors. These stakeholders may all have access to the robot and the ability to modify its settings. Moreover, there is also the potential for the robotic system to be hacked, or for one of the users with authorized access to maliciously change the system’s information [ 4 ] , for example, in cases of domestic abuse [ 5 ] . In complex, real-life, round-the-clock scenarios, ensuring that all information is entirely accurate and precise can be difficult. Consequently, when a robot provides information that contradicts human memory, issues related to user perception, trust, and decision-making may arise. Understanding how users respond to such information discrepancies is crucial, as research shows that people can overtrust robots [ 6 ] and be persuaded by them [ 7 ] , and improper reliance on robotic guidance, whether excessive or insufficient, can lead to serious health-related consequences. Previous research has shown that transparency and sociability in human-robot interaction (HRI) are key factors influencing user trust and behavior [ 8 ] [ 9 ] . However, how these factors affect user interpretation and subsequent decision-making in scenarios involving conflicting information by a robot remains insufficiently explored. This paper presents a study that examines how varying a robot’s level of transparency and sociability influences user interpretation, decision-making and perceived trust when faced with conflicting information from a robot. In a 2 × 2 between-subjects online study, 176 participants watched videos of a Furhat robot acting as a family healthcare assistant and suggesting a fictional user to take medication at a different time from that remembered by the user. Fig. 1: The Furhat robot employed in the online study. Results provide key insights for the HRI community on transparency mechanisms in robotic systems, the complexity and importance associated with system access control for multi-user robots deployed in home environments, and the potential risks of users’ over-reliance on robots in sensitive domains such as healthcare. II RELATED WORK Previous research has extensively explored factors influencing user trust and reliance in human-robot interactions [ 10 ] [ 11 ] , highlighting transparency [ 12 ] [ 13 ] and sociability [ 14 ] as significant determinants of user perceptions. Transparency, defined as the degree to which a robot provides clear, understandable explanations of its actions and decisions [ 15 ] , has been identified as critical in fostering trust and effective human-robot collaboration. Studies indicate that increased transparency can enhance user acceptance and confidence, particularly in complex or uncertain situations where robotic guidance is essential [ 16 ] . Providing more transparent information about the robot’s capabilities could lead users to have better judgment about the robot’s performance, and detect when something goes wrong [ 17 ] . Sociability, or the robot’s ability to exhibit social and empathetic behaviors, also significantly influences user attitudes and interactions with robots [ 9 ] [ 18 ] . Research demonstrates that highly sociable robots, which utilize personalized interactions [ 19 ] , empathetic communication [ 20 ] , and human-like gestures [ 21 ] , tend to foster stronger emotional connections with users, enhancing overall trust and cooperation. Advanced and sophisticated robotic systems have greatly improved the ability to assist and support humans across various domains. However, these have also led to growing concerns about security. Previous research on cybersecurity in the healthcare field has revealed the risks and consequences associated with hacked medical automated systems and devices [ 22 ] [ 23 ] . Despite these insights, there is very little discussion regarding social robots as potential cybersecurity threats in home healthcare environments . Furthermore, existing research rarely explores situations where information provided by robots directly contradicts human memory in medical related scenarios . To address this gap, this paper investigates how participants interpret such information discrepancies and make decisions under different conditions. III RESEARCH QUESTIONS To study how usersperceive and evaluate conflicting information when faced with discrepancies between robot-provided recommendations and human memory, as well as how they make decisions in such scenarios, we pose the following research questions: RQ1: How do (1a) different levels of transparency and (1b) different levels of sociability in a robot influence participants’ decision-making when a family healthcare robot provides information that contradicts the user’s memory? RQ2: How do (2a) different levels of robot transparency and (2b) different levels of robot sociability affect participants assess and interpret the discrepancy between human memory and the information provided by the robot? RQ3: What is the relationship between user interpretation of the unexpected behavior of a healthcare robot and their decision-making? RQ4: How is participants’ trust in a family healthcare robot influenced by (4a) different levels of robot transparency and (4b) different levels of robot sociability? And how does the trust level subsequently affect their decision-making? IV METHODOLOGY To investigate these research questions, we conducted a 2 (transparency level: low or high) × 2 (sociability level: low or high) between-subjects online study with the Prolific 1 1 1