I, Robot? Socio-Technical Implications of Ultra-Personalized AI-Powered AAC; an Autoethnographic Account CCS: Human-centered computing Accessibility systems and tools
Tobias Weinberg, Ricardo E. Gonzalez Penuela, Stephanie Valencia, Thijs Roumen · 2025
Read I, Robot? Socio-Technical Implications of Ultra-Personalized AI-Powered AAC; an Autoethnographic Account CCS: Human-centered computing Accessibility systems and tools by Tobias Weinberg, Ricardo E. Gonzalez Penuela, Stephanie Valencia, Thijs Roumen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-13671.txt.
Introduction
Tobias M. Weinberg, Ricardo E. Gonzalez Penuela, Stephanie Valencia, and Thijs Roumen report an autoethnographic study in a 2025 paper on ultra-personalized AI for augmentative and alternative communication. People who cannot speak rely on such devices to compose messages, and generic autocomplete often misses their personal voice, forcing heavy editing.
Over seven months the lead author logged all of his communication device data, fine-tuned a model on it, then used its suggestions daily for three months. Logging itself reshaped his sense of agency, training amplified some parts of his identity and muted others, and suggestions sometimes resurfaced private details in new contexts. The authors draw design lessons for keeping personalized communication tools expressive and authentic.
Catalog record
| CREATOR | Tobias Weinberg, Ricardo E. Gonzalez Penuela, Stephanie Valencia, Thijs Roumen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-13671
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
I, Robot? Socio-Technical Implications of Ultra-Personalized AI-Powered AAC; an Autoethnographic Account CCS: Human-centered computing Accessibility systems and tools Tobias Weinberg, Ricardo E. Gonzalez Penuela, Stephanie Valencia, Thijs Roumen Abstract . Generic AI auto-complete for message composition often fails to capture the nuance of personal identity, requiring significant editing. While harmless in low-stakes settings, for users of Augmentative and Alternative Communication (AAC) devices, who rely on such systems for everyday communication, this editing burden is particularly acute. Intuitively, the need for edits would be lower if language models were personalized to the communication of the specific user. While technically feasible, such personalization raises socio-technical questions: what are the implications of logging one’s own conversations, and how does personalization affect privacy, authorship, and control? We explore these questions through an autoethnographic study in three phases: (1) seven months of collecting all the lead author’s AAC communication data, (2) fine-tuning a model on this dataset, and (3) three months of daily use of personalized AI suggestions. We reflect on these phases through continuous diary entries and interaction logs. Our findings highlight the value of personalization as well as implications on privacy, authorship, and blurring the boundaries of self-expression. Figure 1. We explored the socio-technical implications of ultra-personalization in AAC across three phases. Three-panel study overview. Phase 1: app screen showing the text 'collecting the author’s AAC speech for 7 months'. Phase 2: database and neural-network icons with arrows indicate training an LLM on the collected data. Phase 3: app screen showing the text 'using the resulting' and the trained completed in in-line ghost text 'ultra-personalized AAC for 3 months'. 1. Introduction For people with speech impairments who type to speak, composing messages with just a few clicks is not a luxury but a necessity ( Waller [n. d.] ; Seale et al. 2020 ) . Yet, generic auto-complete systems for composing messages often fall short: they rarely capture the nuance of personal identity, forcing users to spend significant effort editing suggestions ( Valencia et al. [n. d.] ; Valencia et al. 2024 ) . For users of Augmentative and Alternative Communication (AAC) devices, who rely on such systems for their everyday speech, this becomes a heavy burden ( Kane et al. 2017 ; Waller et al. 2025 ) . Intuitively, the need for text editing would be significantly lower if the model was trained on the specific user’s communication as opposed to a generic model. While personalization has been shown to be technically feasible ( Salemi et al. 2024 ; Chen et al. 2024 ; Cai et al. 2023 ) , we set out to explore the socio-technical implications of such “fix” for AAC users: does it indeed support better communication, what is the impact of logging your own communication, how does one train such models, and what are implications of using AAC tools which auto-complete to support your communication in daily live? Given the potentially large social and ethical implications, it is crucially important to study this before deploying such technology in the wild ( Dash et al. 2025 ; Shneiderman 2020 ; Reisman et al. 2018 ) . In this paper, we approach these questions through an autoethnographic lens in three phases: (1) the lead author (who has a speech impairment and is a full-time AAC user) collected 7 months of all his personal speech data, while reflecting on this experience, (2) we filtered the data, and trained a language model to build a simple AAC app implementing the trained model (3) finally, the lead author used that app as his main AAC device for 3 months, again reflecting on this experience through diary logs and app usage data. Within the field of AAC research, several AI-based techniques have been proposed to predict or expand on users’ typed messages ( Valencia et al. 2024 ; Valencia et al. [n. d.] ) . Kwickchat ( Shen et al. [n. d.] ) is a sentence-based text entry system that allows AAC users to generate replies with minimal input by predicting sentences based on keyword entry. Cai et al. [n. d.] demonstrated the potential of LLMs to abbreviate input for eye-gaze, and further showed that incorporating conversational context significantly improved the efficiency ( Cai et al. 2022 ) . Weinberg et al. 2025a found that in time-pressured scenarios, AAC users were willing to trade a degree of authorship to the LLM for speed gain, while others expressed concerns about authenticity and the risk of AI altering their self-perception ( Valencia et al. [n. d.] ) . However, the integration of AI into AAC is not without controversy. A recent community consultation highlighted concerns about bias, ownership of output, and data protection, with calls for a code of practice to guide responsible adoption ( Griffiths et al. 2024 ) . Kane et al. 2017 emphasizes that AAC users often go to great lengths to preserve self-expression, using humor, timing, and personalization to construct a sense of identity. Recent AAC ethics work cautions that LLM-enabled aids risk muddying authorship and reducing opportunities for co-construction if adopted uncritically ( Griffiths et al. 2025 ) . More personalized LLMs for AAC users thus seem to hold promise. Outside of AAC, personalization has been shown to enhance relevance and fluency, but also raises concerns around authorship, tone, and control ( Peng et al. 2024 ; Liu et al. 2024 ; Salemi et al. 2024 ; Yeh et al. 2024 ; Li et al. 2023 ) . These systems increasingly treat personalization as a sociotechnical question, less about optimizing output, and more about who is being represented, when, and with what degree of user agency. Our reflections reveal dynamics around personalization, usability, and control. When the ultra-personalized AI-powered app performed well, it adapted closely to the user’s style, producing contextually accurate and personally aligned suggestions that enhanced fluency and expressivity. In this work, we discuss the integrity implications of both data collection and usage by drawing on the notion of Contextual Integrity ( Nissenbaum 2004 ) , considering appropriateness of information flow relative to the value it provides. Ultra-personalization risks breaching the tacit social contracts that guide how we express ourselves across contexts. Furthermore, in our case, building an ultra-personalized model was not just a technical endeavor, but an ongoing negotiation of effort, authorship, and control. Collecting training data meant re-purposing intimate conversations, drawing boundaries between what should and shouldn’t be included. The autoethnographic lens we use in this work provides an extra layer of insight regarding perceived privacy implications, such as self-censoring speech due to the acute awareness of knowing that all the data would be later used to train a model. Our findings highlight both the potential and the risks of ultra-personalized AI in AAC: it requires careful attention to how such systems respond in real-time to evolving conversations (responsiveness), whether their suggestions align with the norms and expectations of a given interaction (social context), and how much control users retain over what is said and how it is said (user agency). Without this alignment, even highly personalized outputs may feel intrusive, inauthentic, or misrepresentative, undermining the very identity they aim to support. 2. Contributions, Benefits, and Limitations This paper makes the following contributions: • Empirical insight into