Families’ Vision of Generative AI Agents for Household Safety Against Digital and Physical Threats Journal: PACMHCI Volume: 9 7 CSCW417 11 DOI: 10.1145/3757598 CCS: Social and professional topics Adolescents CCS: Security and privacy Human and societal aspects of security and privacy CCS: Human-cent

Zikai Wen, Lanjing Liu, Yaxing Yao · 2025

Read Families’ Vision of Generative AI Agents for Household Safety Against Digital and Physical Threats Journal: PACMHCI Volume: 9 7 CSCW417 11 DOI: 10.1145/3757598 CCS: Social and professional topics Adolescents CCS: Security and privacy Human and societal aspects of security and privacy CCS: Human-cent by Zikai Wen, Lanjing Liu, Yaxing Yao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-11030.txt.

Introduction

Zikai Wen, Lanjing Liu, and Yaxing Yao wrote this 2025 arXiv paper on how families picture AI helpers for home safety. Threats now reach the home through screens as well as doors, from online fraud to bullying. The team interviewed thirteen parent-child pairs, first apart and then together, about what they would want from AI agents in daily life.

Families did not want one all-purpose guard. They spread the work across agents cast in familiar roles. A household manager would handle routines and fraud risks. A tutor would give learning help and safety lessons. A therapist-like agent would cover touchy issues such as bullying. Parents and children differed in how much they trusted such agents. Families also asked for firm privacy walls between agents. The authors turn these wishes into four design rules on memory, consent, and sharing.

Catalog record

CREATORZikai Wen, Lanjing Liu, Yaxing Yao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-11030

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Families’ Vision of Generative AI Agents for Household Safety Against Digital and Physical Threats Journal: PACMHCI Volume: 9 7 CSCW417 11 DOI: 10.1145/3757598 CCS: Social and professional topics Adolescents CCS: Security and privacy Human and societal aspects of security and privacy CCS: Human-centered computing Empirical studies in HCI Zikai Wen, Lanjing Liu, Yaxing Yao Abstract . As families face increasingly complex safety challenges in digital and physical environments, generative AI (GenAI) presents new opportunities to support household safety through multiple specialized AI agents. Through a two-phase qualitative study consisting of individual interviews and collaborative sessions with 13 parent-child dyads, we explored families’ conceptualizations of GenAI and their envisioned use of AI agents in daily family life. Our findings reveal that families preferred to distribute safety-related support across multiple AI agents, each embodying a familiar caregiving role: a household manager coordinating routine tasks and mitigating risks such as digital fraud and home accidents; a private tutor providing personalized educational support, including safety education; and a family therapist offering emotional support to address sensitive safety issues such as cyberbullying and digital harassment. Families emphasized the need for agent-specific privacy boundaries, recognized generational differences in trust toward AI agents, and stressed the importance of maintaining open family communication alongside the assistance of AI agents. Based on these findings, we propose a multi-agent system design featuring four privacy-preserving principles: memory segregation, conversational consent, selective data sharing, and progressive memory management to help balance safety, privacy, and autonomy within family contexts. † † cc-license: by 1. Introduction Families face increasingly complex safety concerns across digital and physical environments ( Anderson et al. 2023 ) . Digital safety threats include online harassment, cyberbullying, sexual violence, financial fraud, digital addiction, misinformation, and unsafe and illegal behaviors ( Freed et al. 2023 ) . Physical safety involves concerns such as traffic safety ( Niebuhr et al. 2016 ) , home security ( R et al. 2023 ) , and health emergencies ( Papachristou et al. 2022 ) . These safety issues often evolve rapidly and remain hidden from parental supervision ( Wang et al. 2021 ; Corcoran et al. 2022 ) , particularly in digital spaces where children may be reluctant to share their worries with parents ( Wisniewski et al. 2017b ; Hernandez and Ebersole 2022 ) . This gap between parents and children highlights challenges in current safety management methods. Current family safety management approaches, such as traditional monitoring tools and parental controls, can create power imbalances, leading to children’s resistance and evasive behaviors ( Wisniewski et al. 2017a ; Ghosh et al. 2018 ) . Children may hide critical information from parents due to fear of judgment or consequences ( Petronio 2010 ; Hernandez and Ebersole 2022 ) , while parents often struggle with effectively communicating safety concerns or providing timely guidance when needed ( Modecki et al. 2022 ; Park et al. 2024 ) . While families do not yet perceive generative AI (GenAI) as an explicit solution for managing household safety, there are conceptual reasons why GenAI models could become an important part of the family safety management toolkit. Recent research has shown that GenAI technologies, with their natural language interactions and adaptive capabilities beyond traditional digital solutions, can provide children with more engaging educational support ( Zhang et al. 2024 ; Newman et al. 2024 ) and companionship ( Constantinescu et al. 2022 ; Abbasi et al. 2025 ) . For instance, Abbasi et al. ( Abbasi et al. 2025 ) found that some children, particularly girls, rated the AI-powered social robot highly as a confidante, suggesting they may feel comfortable sharing sensitive personal matters and feelings with the robot. Although previous studies have not explicitly used GenAI models to address safety issues, the evidence of children’s increasing engagement with such technologies highlights significant potential for integrating them into household safety practices. To avoid confusion, we clarify two core concepts used throughout this paper: “GenAI” denotes technologies like ChatGPT that generate content based on user inputs, while “AI agent” refers to GenAI models capable of autonomously memorizing contexts and making decisions ( Feuerriegel et al. 2024 ) . We explored how families envision interacting with AI agents to support household safety. We conducted a two-phase study with 13 parent-child dyads to investigate the following questions: RQ1 How do parents and children conceptualize the roles of AI agents within the family context? RQ2 What are families’ preferences for AI agents’ involvement in managing household safety? RQ3 What underlying needs and concerns shape families’ attitudes toward AI agent-assisted safety management? Phase 1 consisted of individual interviews that explored families’ baseline perceptions and current experiences with GenAI. Families described these GenAI models (e.g., ChatGPT) as primarily reactive with limited autonomy, though they often anthropomorphized GenAI’s interactions in their descriptions. Participants also expressed a desire for GenAI to adopt a more proactive and autonomous role in family safety protection. Phase 2 built on these insights through co-design sessions, where parent-child dyads collaboratively envisioned how AI agents could integrate safety functionalities into everyday family routines. We found that families imagined future AI agents adopting familiar caregiving roles, such as household management, tutoring, and emotional support. Families did not seek a standalone safety AI agent, but rather anticipated that safety considerations would be naturally woven into these caregiver-like roles. The household manager’s routine tasks, such as handling emails and organizing schedules, provide natural opportunities for detecting digital scams and monitoring physical safety. The private tutor’s educational role easily extends to teaching driving and digital safety skills. Similarly, the family therapist’s emotional support and conflict resolution responsibilities position it to address cyberbullying and sensitive issues, especially for teenagers who might want to discuss concerns with an AI agent. In addition, our analysis uncovered important considerations regarding agent boundaries and privacy preferences. Families emphasized the need for clear boundaries between different AI agents, particularly regarding the handling of sensitive information, even though the agents are managed by the same system. We found generational differences in privacy preferences, with younger users generally showing greater openness to AI agent integration while parents expressed more privacy concerns. Both groups emphasized the importance of maintaining direct family communication alongside AI agent support, with children preferring autonomy in how safety-related information is shared with parents. Based on these findings, we propose a multi-agent system for families in which distinct AI agents are embedded in everyday caregiving roles to support safety while maintaining agent-specific privacy boundaries. These agents operate through separate pathways to address family routines and safety needs in a way that supports direct parent-child communication. To manage information flow across these AI agents, we introduce four privacy principles: memory segregation, conversational consent, selective sharing, and progressive memory. These principles enable collaborative family data practices that protect teen autonomy and support long-term safety in everyday life. In summary, our paper presents three key contributions: (1) We show that families prefer multiple caregiving AI agents over a single safety-focused agent; (2) We design a multi-agent system for families that balances parental oversight, teen autonomy, and private data sharing; (3) We propose design guidelines for managing privacy across different AI agents. 2. Related Work Our research builds upon several interconnected areas of prior work. We first examine

Read the complete text