Fifteen Years of Child-Centered Long-Form Recordings: Promises, Resources, and Remaining Challenges to Validity
Loann, Marvin, Tarek, Manel, Lucas, Emmanuel, Alejandrina · 2025
Read Fifteen Years of Child-Centered Long-Form Recordings: Promises, Resources, and Remaining Challenges to Validity by Loann, Marvin, Tarek, Manel, Lucas, Emmanuel, Alejandrina (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-11075.txt.
Introduction
Loann Peurey and co-authors review fifteen years of child-worn audio recording in this 2025 paper. The catalog record lists the authors by first names only; the head byline gives full names. Small recorders worn all day capture the words children hear and say. Such data promise a true picture of early language life.
Software must sift the huge recordings automatically. Errors in that sorting can distort the measures researchers trust. The authors catalog known error sources and the resource base built so far. They propose quality checks that labs can run on their own data. Full automation of quality control is out of reach, so careful habits remain essential.
Catalog record
| CREATOR | Loann, Marvin, Tarek, Manel, Lucas, Emmanuel, Alejandrina |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-11075
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fifteen Years of Child-Centered Long-Form Recordings: Promises, Resources, and Remaining Challenges to Validity Loann, Marvin, Tarek, Manel, Lucas, Emmanuel, Alejandrina Abstract Audio-recordings collected with a child-worn device are a fundamental tool in child language research. Long-form recordings collected over whole days promise to capture children’s input and production with minimal observer bias, and therefore high validity. The sheer volume of resulting data necessitates automated analysis to extract relevant metrics for researchers and clinicians. This paper summarizes collective knowledge on this technique, providing entry points to existing resources. We also highlight various sources of error that threaten the accuracy of automated annotations and the interpretation of resulting metrics. To address this, we propose potential troubleshooting metrics to help users assess data quality. While a fully automated quality control system is not feasible, we outline practical strategies for researchers to improve data collection and contextualize their analyses. Peurey Lavechin Kunze Khentout Gautheron* Dupoux Cristia* DEC, ENS, EHESS, CNRS, PSL UniversityFrance University of East LondonUK University of WuppertalGermany keywords wearables, in-the-wild audio, child speech, speech-to-noise ratio, speech clarity, recording conditions † † email: *[email protected], *[email protected] 1 Introduction Audio-recordings collected with a child-worn device are a fundamental tool in research on child language [ 1 ] . The last decade has seen increasing use of long-form recordings, collected as children wear a device typically over a whole day, to capture what children hear and what they say [ 2 , 3 , 4 , 5 , 6 , to cite just a few] . In the context of the Special Session “Challenges in Speech Data Collection, Curation, and Annotation”, this paper seeks to provide an entry point to this burgeoning literature (Sections 2-4), as well as make one novel contribution by clarifying extant challenges to the quality of automated annotations as well as the interpretation of resulting metrics (Section 5). 2 Definition and Key Uses of Long-Form Recording Data Compared to short-form recordings, which often take place during a specific activity, long-form recordings aim to capture speech behavior “in the wild”: Families are asked to go about their normal day as much as possible. The hope is that the participation burden is lowered for families in this way, and that observer effects (whereby the behavior of those recorded is affected by the feeling of being “watched”) are minimized. Some research shows that families do behave differently in long-form recordings as opposed to shorter ones [ 4 ] , although of course there is no way to ensure that there is absolutely zero effect of being observed. Each child’s speech input and output is thus recorded in sessions that are often 8-16 hours long. The resulting volume of audio data necessitates automated processing, often with specialized algorithms, since the data are too challenging for off-the-shelf solutions. Due to space limitations, we focus here on information that results from one type of such algorithm called voice-type classifiers, whereby the audio is automatically parsed into silence as opposed to four voice types: the key child wearing the device (CHI), male and female adult (MAL and FEM), and other children around the key child (OCH). This results in estimates of the number of vocalizations in children’s input and output (Figure 1 ). Figure 1 : Long-form recordings, gathered with a small wearable, are submitted to a voice type classifier to extract potentially metrics like the number of vocalizations by different talker types: the child wearing the device (CHI), other children (OCH), and adult females (FEM) and males (MAL). The technique of long-form recordings is poised to revolutionize multiple fields. In psycholinguistics, one study leveraged its big-data potential by using over 40k hours of audio from 1,001 children to assess possible predictors of children’s spontaneous vocalizations [ 5 ] , for instance finding a significant association between how much children vocalized and the amount of adult speech, but not the child’s gender. Another study explored whether self-supervised learning models develop phonological attunement [ 7 ] , concluding that to become specialized in the ambient phonology represented in long-form data, model learners may need biases like distinguishing speech from non-speech. Long-form recordings also show great promise in applied research. For instance, they may be useful in geographic areas where speech-language pathologists are scarce and automated tracking could save their valuable time [ 8 , 9 ] . Public health specialists and economists increasingly use long-form recordings to assess childhood interventions. One study found that families exposed to a 3-minute video on the importance of talking to children showed increased adult speech, measured by automated analysis of 9 hours of audio from 449 families [ 3 ] . 3 Extant Resources for Facilitating Data Collection, Human Annotation and Sharing A range of resources exist to help researchers navigate the collection, annotation, and sharing of long-form recordings. In addition to introductory papers [ 10 , 11 ] , there exist also some video tutorials 1 and structured documentation 2 . A summer school with spin-offs in several countries is planned for 2025. 3 Among the most useful resources, the ACLEW annotation scheme provides a framework for human coding child-centered recordings that combines flexibility with consistency across studies, facilitating cross-laboratory comparisons [ 12 ] . Resources exist helping researchers navigate the complex ethical issues involved in such recordings [ 13 ] . Given that long-form recordings capture children’s everyday lives in an unfiltered manner, they cannot be made publicly available (without thorough vetting). A handful of full-length audios have undergone vetting and have been rendered fully public through HomeBank 4 (the TalkBank section dedicated to long-form recordings, [ 14 ] ). However, most datasets are private, including BabyTrain, which was used for developing what is currently the only open-source and well-documented voice type classifier (called VTC) [ 15 ] . The community of long-form recordings using child wearables is open and helpful. The network DARCLE.org has a mailing list and a monthly seminar, providing a unique space for knowledge exchange and discussion. Early Career Researchers benefit from a supportive monthly peer group meeting, to which leading scholars are sometimes invited, allowing students and post-docs to strengthen their networks and get crucial feedback on their projects. 4 Accuracy of Automated Voice Type Classifiers for Long-Form Recordings In many cases, researchers using this technique must rely on automated metrics rather than human annotations. The LENA software system [ 16 , 17 , 18 ] , a widely used proprietary tool for long-form recordings, has been the focus of extensive accuracy evaluations. A 2020 review of 33 benchmarking studies raised three major concerns [ 19 ] : (1) few studies assessed all four key voice types (key child, other children, female adults, male adults), (2) average reported precision (59%) and recall (64%) were subpar, and (3) performance varied widely across studies, with recall ranging from 11% to 80%, limiting generalizability even when using the LENA hardware-software suite. An open-source alternative, the above-mentioned VTC [ 15 ] , has been less studied but shows similar variability. In an unpublished analysis, Bergelson et al. compared human-automated correlations across seven datasets. Median correlations were .75 for VTC (.77 for LENA), but variability was high: .4–.81 for VTC and .51–.89 for LENA, reinforcing concerns about reliability across datasets. A similar