DepFlow: Disentangled Speech Generation to Mitigate Semantic Bias in Depression Detection
Yuxin Li, Xiangyu Zhang, Yifei Li, Zhiwei Guo, Haoyang Zhang, Eng Siong Chng, Cuntai Guan · 2026
Read DepFlow: Disentangled Speech Generation to Mitigate Semantic Bias in Depression Detection by Yuxin Li, Xiangyu Zhang, Yifei Li, Zhiwei Guo, Haoyang Zhang, Eng Siong Chng, Cuntai Guan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00303.txt.
Introduction
Yuxin Li leads six coauthors in building fake speech that sounds depressed while saying cheerful words. Speech can flag depression early in a cheap, gentle way. Popular datasets, though, tie sad content to sad labels. Models then learn a shortcut from word sentiment. Hidden depression breaks that shortcut in real life. People may sound flat while speaking bright lines.
Their three stage system first learns a depression voice mark. Adversarial training strips out speaker and content from it. A speech synthesizer then injects that mark at will. Severity slides smoothly along a prototype scale. The team builds an augmentation set from the mismatch. Depressed sound pairs with positive or neutral text. Three detector designs all gain in F1 score. Gains beat standard augmentation across the board. The tool also aids simulation where clinical data are scarce.
Catalog record
| CREATOR | Yuxin Li, Xiangyu Zhang, Yifei Li, Zhiwei Guo, Haoyang Zhang, Eng Siong Chng, Cuntai Guan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-00303
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DepFlow: Disentangled Speech Generation to Mitigate Semantic Bias in Depression Detection Yuxin Li, Xiangyu Zhang, Yifei Li, Zhiwei Guo, Haoyang Zhang, Eng Siong Chng, Cuntai Guan Abstract Speech is a scalable and non-invasive biomarker for early mental health screening. However, widely used depression datasets like DAIC-WOZ exhibit strong coupling between linguistic sentiment and diagnostic labels, encouraging models to learn semantic shortcuts. As a result, model robustness may be compromised in real-world scenarios, such as Camouflaged Depression, where individuals maintain socially positive or neutral language despite underlying depressive states. To mitigate this semantic bias, we propose DepFlow, a three-stage depression-conditioned text-to-speech framework. First, a Depression Acoustic Encoder learns speaker- and content-invariant depression embeddings through adversarial training, achieving effective disentanglement while preserving depression discriminability (ROC-AUC: 0.693). Second, a flow-matching TTS model with FiLM modulation injects these embeddings into synthesis, enabling control over depressive severity while preserving content and speaker identity. Third, a prototype-based severity mapping mechanism provides smooth and interpretable manipulation across the depression continuum. Using DepFlow, we construct a Camouflage Depression-oriented Augmentation (CDoA) dataset that pairs depressed acoustic patterns with positive/neutral content from a sentiment-stratified text bank, creating acoustic-semantic mismatches underrepresented in natural data. Evaluated across three depression detection architectures, CDoA improves macro-F1 by 9%, 12%, and 5%, respectively, consistently outperforming conventional augmentation strategies in depression Detection. Beyond enhancing robustness, DepFlow provides a controllable synthesis platform for conversational systems and simulation-based evaluation, where real clinical data remains limited by ethical and coverage constraints. Keywords Speech Depression Detection \cdot Speech Synthesis \cdot Camouflaged Depression \cdot Mask Depression \cdot Semantic Bias 1 Introduction Depression alters speech production in systematic ways, including reduced vocal energy and imprecise articulation 11 ; 38 . These changes are associated with autonomic dysregulation and reflect core clinical symptoms such as psychomotor retardation and reduced affective expressiveness 5 ; 40 ; 1 . Importantly, such acoustic markers often emerge before individuals consciously recognize or report their own depressive symptoms 42 ; 6 . As a result, speech constitutes a scalable, non-invasive, and relatively difficult to intentionally manipulate biomarker for early and passive mental health screening, particularly in real-world monitoring settings where robustness across expression styles is essential. Speech conveys information through multiple interacting layers, including acoustic cues, linguistic content, and speaker identity 55 . While all three contribute to affective expression, our analysis identifies linguistic sentiment as a critical confounder in the widely used DAIC-WOZ dataset. Concretely, by examining nearly ten thousand utterances in DAIC-WOZ, we find that negative sentiment is substantially more frequent in depressed than in healthy speech. This dataset-induced coupling indicates that linguistic sentiment is not independent of depression status, meaning that models trained on such data are naturally encouraged to rely on sentiment cues rather than depression-related acoustic markers 18 ; 46 ; 56 . This risk is particularly pronounced when linguistic content and acoustic expression diverge, for example when individuals with depression maintain socially positive or neutral language while still exhibiting depressive vocal patterns. This aligns with the clinical notion of Camouflaged Depression 25 ; 6 ; 57 , where individuals consciously or unconsciously mask symptoms to conform to social expectations. In these cases, acoustic-semantic mismatches are not anomalies but can occur systematically in certain populations. Models that treat linguistic sentiment as a proxy for depression are therefore prone to failure whenever semantic content no longer reflects internal affective state, leading to degraded robustness in deployment. To mitigate semantic bias and reduce shortcut learning, we propose to explicitly expose models to controlled conflicts between acoustic and semantic information during training. To this end, we introduce DepFlow, a waveform-level, depression-conditioned speech generation framework capable of synthesizing the Camouflage Depression-oriented Augmentation (CDoA) dataset, where depression-related acoustic expressiveness and linguistic content can be manipulated independently while preserving speaker identity. Rather than generating arbitrary synthetic data, we specifically construct datasets that simulate Camouflaged Depression scenarios: for depressed speakers, DepFlow produces additional speech in which their original depressive acoustic patterns are retained but paired with externally provided positive linguistic content, a combination that is severely underrepresented in real datasets; for healthy speakers, additional speech with predominantly positive content is generated as well. By providing such systematically constructed, high-fidelity speech in which depressive acoustics are intentionally placed in conflict with positive semantics, DepFlow encourages downstream models to rely less on semantic polarity and instead shift decision boundaries toward invariant acoustic biomarkers. DepFlow achieves this through three core components. First, a Depression Acoustic Encoder (DAE) learns a continuous manifold of depression-related acoustic patterns while suppressing speaker identity and linguistic information via adversarial objectives. Second, a conditional flow-matching text-to-speech model synthesizes waveform-level speech conditioned on these depression embeddings, enabling precise control over depressive acoustic expressiveness while preserving linguistic content and speaker traits. Finally, a prototype-based severity control mechanism provides smooth and interpretable manipulation of depressive expressiveness at inference time, allowing DepFlow to systematically generate Camouflage-oriented training samples that break the sentiment–diagnosis correlation present in existing datasets. We evaluate DepFlow by augmenting the training data of three representative deep learning–based depression detection architectures. Across all models, incorporating DepFlow-generated disentangled speech consistently improves macro-F1 scores, indicating more stable and robust decision boundaries. Moreover, DepFlow consistently outperforms existing data augmentation strategies, highlighting the benefit of targeted acoustic–semantic decoupling over generic perturbation-based approaches. These results demonstrate that exposing models to depressive acoustics paired with non-depressive linguistic content effectively reduces semantic shortcut learning and shifts model reliance toward invariant acoustic biomarkers. Beyond improving robustness in depression detection, DepFlow also serves as a depression-oriented speech data generation tool that supports emerging research paradigms in mental health modeling. In particular, dialogue-based and interactive studies of depression require large-scale, diverse, and controllable speech data 69 ; 26 , which are difficult to obtain from real-world clinical recordings due to ethical constraints, privacy concerns, and limited coverage of expressive variability 11 ; 33 . This data-generation capability paves the way for future research on depression-aware conversational systems, interaction modeling, and simulation-based evaluation frameworks, where relying solely on real data is insufficient to support training and analysis. The remainder of this paper is organized as follows. Section II reviews related work on depression detection and data augmentation. Section III describes the proposed DepFlow framework and provides detailed descriptions of its component modules. Section IV outlines the experimental setup, including datasets, preprocessing, implementation details, construction of CDoA datasets, downstream depression detection architectures, and evaluation metrics. Section V presents the experimental results and discusses the key findings. Section VI concludes the paper. 2 Related Work 2.1 Speech-based Depression Detection using Deep Learning Much of the progress in this field has been driven by the AVEC challenge series 62 ; 52 , which established standard benchmarks for multimodal depression assessment. Early systems relied on handcrafted acoustic features such as prosodic cues (pitch, energy, speech rate), spectral descriptors (MFCCs, formants), and voice quality measures (jitter, shimmer, HNR) 33 . These approaches captured clinically relevant correlates of psychomotor retardation but required manual design and lacked robustness. End-to-end models addressed these limitations by learning directly from raw audio or mel-spectrograms. CNN-based architectures extract local spectral patterns 10 ; 15 ; 53 ; 44 ; 63 ; 64 , while RNNs model temporal dynamics and Transformers capture long-range dependencies 54 ; 74 ; 43 . More recently, self-supervised learning