IHearYou: Linking Acoustic Features to DSM-5 Depressive Behavior Indicators

Jonas Länzlinger 1 , Katharina O.E. Müller 2 , Burkhard Stiller 2 , Bruno Rodrigues 1 · 2025

Read IHearYou: Linking Acoustic Features to DSM-5 Depressive Behavior Indicators by Jonas Länzlinger 1 , Katharina O.E. Müller 2 , Burkhard Stiller 2 , Bruno Rodrigues 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14801.txt.

Introduction

Jonas Länzlinger, Katharina Müller, and two co-authors present IHearYou, a system that links the sound of a person's voice to clinical signs of depression. Diagnosis today leans on self-reports and interviews, which can miss how someone actually behaves at home. IHearYou listens passively in household settings and extracts acoustic features from everyday speech.

Those features are tied, through a structured linkage framework, to the indicators listed in the DSM-5 manual for major depressive disorder. The system runs locally to protect privacy and shows live results on an ordinary laptop dashboard. Careful testing rules, with corrections for false discoveries, are built in so other teams can reproduce the findings.

Catalog record

CREATORJonas Länzlinger 1 , Katharina O.E. Müller 2 , Burkhard Stiller 2 , Bruno Rodrigues 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-14801

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

IHearYou: Linking Acoustic Features to DSM-5 Depressive Behavior Indicators Jonas Länzlinger 1 , Katharina O.E. Müller 2 , Burkhard Stiller 2 , Bruno Rodrigues 1 Abstract Depression affects over millions people worldwide, yet diagnosis still relies on subjective self-reports and interviews that may not capture authentic behavior. We present IHearYou , an approach to automated depression detection focused on speech acoustics. Using passive sensing in household environments, IHearYou extracts voice features and links them to DSM-5 (Diagnostic and Statistical Manual of Mental Disorders) indicators through a structured Linkage Framework instantiated for Major Depressive Disorder. The system runs locally to preserve privacy and includes a persistence schema and dashboard, presenting real-time throughput on a commodity laptop. To ensure reproducibility, we define a configuration-driven protocol with False Discovery Rate (FDR) correction and gender-stratified testing. Applied to the DAIC-WOZ dataset, this protocol reveals directionally consistent feature–indicator associations, while a TESS-based audio streaming experiment validates end-to-end feasibility. Our results show how passive voice sensing can be turned into explainable DSM-5 indicator scores, bridging the gap between black-box detection and clinically interpretable, on-device analysis. E-mail:[email protected]¦[stiller,mueller]@ifi.uzh.ch¦[email protected] I Introduction Depression is one of the most prevalent mental health disorders, with rates continuing to rise across all age groups [ 32 , 31 ] . The consequences are especially severe for children and adolescents, where early symptoms are often overlooked or untreated [ 2 ] . Often, depression is diagnosed together with one or more comorbidities such as substance use, panic disorder, and anxiety disorder [ 31 ] . In clinical practice, diagnosis is typically based on structured criteria such as the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders) and self-report questionnaires like the Patient Health Questionnaire (PHQ) [ 3 , 16 ] and, while these methods are effective in many contexts, they are susceptible to recall errors, social desirability bias, and subjectivity [ 35 ] . As access to mental health support remains largely limited to privileged groups and the strain on health care systems continuously grows [ 32 ] , the critical question has to be asked: "How do we find innovative methods to detect depression more effectively during this ’epidemic of depression’?" . Research provides evidence (overview in Section II ) that recognizing problems in the early stages enables the early application of an effective and suitable treatment. Although combining speech, text, physiology, and behavior is expected to yield the most reliable assessments [ 46 , 36 ] , integrating heterogeneous signals on constrained, household devices is still impractical. Cloud offloading would raise major privacy risks, while local multimodal models typically exceed the resources available in household environments. Therefore, our approach concentrates on acoustic data from speech, a modality that carries clinically validated cues of depression and can be processed transparently and efficiently at the edge ( i . e ., at a household environment). Table I: Selected representative state-of-the-art. Work Text Speech Vision Mobile/Home Net Fusion Setting Privacy Repro. Sharma et al. (2020) [ 1 ] ✓ – – – – – Online AN PR Cacheda et al. (2019) [ 8 ] ✓ – – – – L Online (early det.) – PR Low et al. (2020) [ 6 ] – ✓ – – – – Lab/clinic – – Di et al. (2024) [ 44 ] – ✓ – – – – Field/phone – – Donaghy et al. (2024) [ 33 ] – ✓ – – – – Field – – Cohn et al. (2009) [ 14 ] – – ✓ – – – Lab – – Min et al. (2023) [ 19 ] – – ✓ – – H In-the-wild video – – Lin et al. (2020) [ 5 ] – – – ✓ – – Field (mobile) – – Shen et al. (2017) [ 11 ] – – – ✓ – – Field (mobile) – – Govindasamy et al. (2021) [ 15 ] – – – ✓ – – Field (wearable) – – Sadeghi et al. (2024) [ 25 ] ✓ ✓ – – – H Lab/online – – Atmaja et al. (2022) [ 4 ] – ✓ ✓ – – E Lab – – DAIC-WOZ [ 9 ] (2024) – ✓ ✓ – – – Lab – DA IHearYou – ✓ – ✓ – H Home (edge) ED DA+PR ‘Text”=social/self-report text; Speech”=paralinguistics; Vision”=facial/gaze/body cues; Mobile/Home”=passive signals from phone, wearables, and ambient/home devices; Net”=network-derived digital traces. Fusion: E=early, L=late, H=hybrid. Privacy: ED=edge/on-device, AN=anonymization, FL=federated. Repro.: DA=data access, CO=code, PR=protocols. For speech in particular, prior work shows that acoustic cues ( e . g ., reduced pitch variability, slower speech, and longer pauses) are related to depressive states, yet most studies report aggregate accuracy without exposing which feature supports which DSM - 5 indicator or how context modifies that link [ 40 , 6 ] . Without such a precise mapping between audio features and symptoms, outputs are hard to interpret and use in clinical workflows. We investigate this challenge assessing whether low - level acoustic features extracted from raw speech can be mapped to specific DSM - 5 depressive - behavior indicators in a transparent and resource - aware way. Concretely, we test the following hypotheses: (H1) reduced pitch variability and (H2) longer pauses are each positively associated with the DSM - 5 indicators psychomotor retardation and diminished ability to think or concentrate , after adjusting for channel, language, age, and sex; (H3) lower energy dynamics and (H4) slower speech rate show the same direction of association. The null hypothesis for each is that no association remains after adjustment and correction for multiple testing. However, building this mapping is not a trivial task. Acoustic cues ( e . g ., reduced pitch variability and longer pauses within a speech) can be present in multiple processes at once and are sensitive to various factors, such as channel conditions, language, age, and sex. For instance, such cues are consistent with the DSM-5 indicators psychomotor retardation and diminished ability to think/concentrate [ 28 , 6 , 44 , 33 , 26 ] . Simplifying these many-to-many relations requires a structured mapping that controls for confounders such as age, sex, and channel conditions, remains efficient enough for edge execution, and produces interpretable rationales at the case level, making its conclusions explainable to DSM-5 indicators. IHearYou links measurable acoustic features to DSM - 5 [ 3 ] depression indicators through a transparent, verifiable specification that runs locally at a home network, preserving privacy while enabling near - real - time analysis under tight memory, latency, and energy budgets [ 23 , 7 ] . The design is modular: when available, additional behavioral signals from mobile, wearable, or ambient sensors can be fused to strengthen the evidence without changing the on - device privacy model. The main contributions of this paper are summarized as follows: • Indicator-level mapping : we introduce a DSM-5–aligned Linkage Framework that connects concrete acoustic features to depressive-behavior indicators through explicit, testable mappings and scoring rules. • Edge design : we implement a local, privacy-preserving pipeline with a persistence schema and dashboard, and demonstrate sustained real-time throughput on a commodity laptop under continuous audio load. • Reproducible empirical evidence : we provide a configuration-driven protocol with False Discovery Rate (FDR) correction and gender-stratified

Read the complete text