One Does Not Simply ‘Mm-hmm’: Exploring Backchanneling in the AAC Micro-Culture ISBN: 978-1-4503-XXXX-X/18/06
Tobias Weinberg, Claire O’Connor, Ricardo E. Gonzalez Penuela, Stephanie Valencia, Thijs Roumen · 2025
Read One Does Not Simply ‘Mm-hmm’: Exploring Backchanneling in the AAC Micro-Culture ISBN: 978-1-4503-XXXX-X/18/06 by Tobias Weinberg, Claire O’Connor, Ricardo E. Gonzalez Penuela, Stephanie Valencia, Thijs Roumen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-17890.txt.
Introduction
Tobias Weinberg, Claire O'Connor, Ricardo Gonzalez Penuela, Stephanie Valencia, and Thijs Roumen study how users of communication aids give small signals during talk. Their paper from twenty twenty-five covers backchanneling: the nods, hums, and short sounds that keep a chat flowing. These signals show listening and shape turn-taking. For people with speech and motor limits, channels for such signals shrink.
A workshop with aid users probed how they signal while talking. Pairs of aid users were compared with mixed pairs. Speech-language pathologists added depth in interviews. Users build their own channels and norms, a micro-culture of signaling. Attention demands of the gear make partner cues hard to catch. The authors rethink body and mediation in this setting. They close with design advice for timely, multi-channel backchannel tools.
Catalog record
| CREATOR | Tobias Weinberg, Claire O’Connor, Ricardo E. Gonzalez Penuela, Stephanie Valencia, Thijs Roumen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-17890
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
One Does Not Simply ‘Mm-hmm’: Exploring Backchanneling in the AAC Micro-Culture ISBN: 978-1-4503-XXXX-X/18/06 Tobias Weinberg, Claire O’Connor, Ricardo E. Gonzalez Penuela, Stephanie Valencia, Thijs Roumen Abstract . Backchanneling (e.g., "uh-huh", "hmm", a simple nod) encompasses a big part of everyday communication; it is how we negotiate the turn to speak, it signals our engagement, and shapes the flow of our conversations. For people with speech and motor impairments, backchanneling is limited to a reduced set of modalities, and their Augmentative and Alternative Communication (AAC) technology requires visual attention, making it harder to observe non-verbal cues of conversation partners. We explore how users of AAC technology approach backchanneling and create their own unique channels and communication culture. We conducted a workshop with 4 AAC users to understand the unique characteristics of backchanneling in AAC. We explored how backchanneling changes when pairs of AAC users communicate vs when an AAC user communicates with a non-AAC user. We contextualize these findings through four in-depth interviews with speech-language pathologists (SLPs). We conclude with a discussion about backchanneling as a micro - cultural practice, rethinking embodiment and mediation in AAC technology, and providing design recommendations for timely multi-modal backchanneling while respecting different communication cultures. Figure 1. A conversation between two AAC users. We find that backchanneling (active-listening) plays a crucial role in communication. However, here to enter text, both users engage with their devices, missing out on non-verbal cues from their interlocutor. We identify a need for better support of backchanneling for AAC, while respecting their established micro-culture. Two AAC users are seated across from one another during a workshop activity. Both are looking down at their devices, engaged in composing messages. Despite sitting face to face, their visual attention is directed at their respective screens, not at each other. On the leftmost participant, there is an arrow on top indicating a nod gesture, and on the right participant, a legend that says: "huh?" because she missed the nod. 1. Introduction Everyday conversations are filled with subtle signals that show we care and are listening. A simple nod, a soft “mm-hmm,” or a quick smile can speak volumes without taking the floor ( Ward 2006 ; Gardner 1997 ; Bavelas et al. 2000 ) . These brief responses—known as backchanneling—are the glue that holds conversations together, reassuring speakers that they are understood and encouraging them to continue. In this paper, in line with Yngve’s definition ( Yngve 1970 ) , we refer to the term ‘backchanneling’ as the verbal (hmm, yeah, uhu) and non-verbal (nods, hand gestures, body posture) cues that help us negotiate the turn to speak, they serve a meta-conversational purpose, such as signaling listener’s attention, understanding, sympathy, or agreement, rather than conveying significant information. Jurafsky et al. 1997 showed that in spoken dialogue, backchanneling composes 19% of communication. Users of Augmentative and Alternative Communication (AAC) technology cannot always rely on instant interjections or effortless gestures to engage in backchanneling. These difficulties arise because (1) there is no clear way to type short backchanneling utterances like “mm-hmm” or express nuance of these using AAC interfaces, (2) AAC users often focus their visual attention on the device itself, making it hard to observe or respond to their conversation partner’s cues, and (3) the backchanneling cue may come too late after the topic has already shifted disrupting the flow of conversation. Producing a backchanneling utterance can also interrupt their own message construction, requiring them to pause typing or shift eye focus to tap out a brief response, which can disrupt their communication flow. These constraints limit or render traditional backchanneling modalities limited or out of sync for AAC users, creating barriers to staying actively engaged in conversations. Despite these challenges, AAC users are far from passive listeners—they have developed creative strategies to stay expressive and involved. In practice, many AAC users become adept multi-modal communicators, combining whatever channels they have available to co-create meaningful messaging ( Ibrahim et al. 2018 ) . We therefore adopt a perspective in which communication is seen as a dynamic, shared endeavor—shaped by common context, embodied signals, and reciprocal engagement—rather than a simple, one-way transfer of unambiguous information when designing AAC technology ( Barnlund 1970 ; Waller 2006 ) . We contribute to the broader discourse around expressive and multi-modal communication for AAC technology ( Kane et al. 2017 ; Valencia et al. [n. d.] ) . Tools such as COMPA ( Valencia et al. 2024 ) and interfaces developed in Why So Serious? ( Weinberg et al. 2024 ) explored ways to address challenges of timing and conversation flow in the context of ongoing conversations involving non-AAC users. Others have explored the role of physical objects to augment non-verbal communication and personal expression for AAC users ( Valencia et al. 2021b ; Curtis et al. 2024 ) . In the field of Conversation Analysis, researchers have studied turn-taking in AAC communication; they point out the significance of backchanneling in this exchange ( Buzolich and Wiemann 1988 ; Farrier et al. 1985 ) . However, we still lack a clear understanding of how AAC users navigate backchanneling: how they decide which modality to use, how effective these signals are, and how conversation partners perceive them. Without this understanding, AAC technologies and communication norms risk overlooking a crucial component of expressive communication for people who use AAC. In this paper, we explore this gap, asking one overarching question: How can AAC users engage in expressive backchanneling during ongoing conversations using different modalities? We investigate this through a co-design workshop with AAC users ( Beneteau et al. 2024 ) , focusing on their lived communication experiences. We contextualize these findings through four in-depth interviews with Speech-Language Pathologists (SLPs). We focus on two research questions: (1) What modalities do AAC users currently use for backchanneling, and what are the limitations and opportunities of these methods? (2) How do AAC users navigate the dynamics of back-and-forth conversation when backchanneling? In particular, does their approach to backchanneling change based on who they are talking to—e.g., conversing with another AAC user versus with a non-AAC (speaking) partner? We found that (1) AAC users develop their own specific micro-culture of communication when it comes to backchanneling, using a wealth of multi-modal cues. When augmenting such communication, it is important to respect that existing micro-culture instead of imposing generic cultural norms. (2) The multi-modal nature of backchanneling reveals a need for embodied interaction with AAC technology. Rather than solely relying on users typing or tapping buttons, they communicate using other modalities, which could empower backchanneling. (3) Our SLPs all indicate the importance of backchanneling, yet realize they are not educated to teach backchanneling, and thus their clients miss out on this important form of communication. There is a need for a more holistic and expressive curriculum. And finally, (4) we derive recommendations for the design of future AAC technology. By understanding how AAC users express attentive listening, we can design inclusive communication interfaces to support natural conversation flow for people of all abilities. Treating AAC users as multi-modal communicators helps “level the playing field” in conversation design, ensuring that features for feedback and turn-taking accommodate a slower pace or alternative signals. Different cultures have unique backchanneling norms (