Fine-tuning Pre-trained Audio Models for COVID-19 Detection: A Technical Report

Daniel Oliveira de Brito, Letícia Gabriella de Souza, Marcelo Matheus Gauy, Marcelo Finger, Arnaldo Candido Junior · 2025

Read Fine-tuning Pre-trained Audio Models for COVID-19 Detection: A Technical Report by Daniel Oliveira de Brito, Letícia Gabriella de Souza, Marcelo Matheus Gauy, Marcelo Finger, Arnaldo Candido Junior (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-14939.txt.

Introduction

Daniel Oliveira de Brito, Letícia Gabriella de Souza, and three co-authors test whether pretrained audio models can spot COVID-19 from coughs and speech. The team fine-tunes an audio masked-autoencoder model and three sizes of a popular audio network family on two public benchmark collections. Careful splits by age and gender block the models from cheating on demographic clues.

Within one collection, results are moderate, with the autoencoder model clearly ahead on the stronger set. Across collections, though, every model fails badly, sometimes scoring near chance. That collapse is the real finding: cough-based screening tools trained on one data set do not yet travel safely to another, a warning for health deployment.

Catalog record

CREATORDaniel Oliveira de Brito, Letícia Gabriella de Souza, Marcelo Matheus Gauy, Marcelo Finger, Arnaldo Candido Junior
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-14939

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fine-tuning Pre-trained Audio Models for COVID-19 Detection: A Technical Report Daniel Oliveira de Brito, Letícia Gabriella de Souza, Marcelo Matheus Gauy, Marcelo Finger, Arnaldo Candido Junior Abstract This technical report investigates the performance of pre-trained audio models on COVID-19 detection tasks using established benchmark datasets. We fine-tuned Audio-MAE and three PANN architectures (CNN6, CNN10, CNN14) on the Coswara and COUGHVID datasets, evaluating both intra-dataset and cross-dataset generalization. We implemented a strict demographic stratification by age and gender to prevent models from exploiting spurious correlations between demographic characteristics and COVID-19 status. Intra-dataset results showed moderate performance, with Audio-MAE achieving the strongest result on Coswara (0.82 AUC, 0.76 F1-score), while all models demonstrated limited performance on Coughvid (AUC 0.58-0.63). Cross-dataset evaluation revealed severe generalization failure across all models (AUC 0.43-0.68), with Audio-MAE showing strong performance degradation (F1-score 0.00-0.08). Our experiments demonstrate that demographic balancing, while reducing apparent model performance, provides more realistic assessment of COVID-19 detection capabilities by eliminating demographic leakage - a confounding factor that inflate performance metrics. Additionally, the limited dataset sizes after balancing (1,219-2,160 samples) proved insufficient for deep learning models that typically require substantially larger training sets. These findings highlight fundamental challenges in developing generalizable audio-based COVID-19 detection systems and underscore the importance of rigorous demographic controls for clinically robust model evaluation. 1 Introduction Audio-based detection of respiratory conditions using deep learning has emerged as a promising diagnostic approach, with numerous studies reporting high accuracy for COVID-19 detection from cough, voice, and speech recordings [ 8 ] . While these advances have demonstrated the potential of acoustic biomarkers for respiratory assessment, important questions remain about the relationship between different respiratory diagnostic tasks—particularly whether models trained for COVID-19 detection can inform broader respiratory conditions such as respiratory insufficiency (RI) or blood oxygen saturation (SpO2) estimation. Our recent work [ 8 ] explored this question by applying pre-trained audio models to both respiratory insufficiency detection and SpO2 estimation tasks. We found that while models achieved near-perfect accuracy (99.9%) for RI detection, the same architectures struggled significantly with SpO2 estimation, achieving less than 70% accuracy. This performance disparity suggests that the acoustic features indicative of respiratory insufficiency may be fundamentally different from those needed to estimate blood oxygenation levels, raising important questions about the specificity and generalizability of audio-based respiratory diagnostics. This technical report investigates how the same pre-trained models—Audio-MAE [ 14 ] and PANNs (CNN6, CNN10, CNN14) [ 21 ] —perform on established COVID-19 detection benchmarks. We evaluate these models on two widely-used datasets: Coswara [ 38 ] and Coughvid [ 30 ] , conducting both intra-dataset and cross-dataset experiments. Our experiments examine whether models can generalize across different COVID-19 datasets and how demographic factors affect reported performance. These findings contribute to understanding the capabilities and limitations of audio-based respiratory assessment, which is essential for developing reliable clinical applications. 2 Related Work Islam et al. [ 16 ] conducted a comprehensive study using five datasets, including Coswara and Coughvid. Their approach employed an extensive range of techniques: threshold moving for optimal threshold selection based on ROC-AUC, feature dimension reduction using RFECV with Extra-Trees classifier, Bayesian Optimization for hyperparameter tuning, and SMOTE for handling class imbalance. For the Coswara dataset, samples were preprocessed and labeled based on healthy (COVID-19 negative) and heavy cough variations (COVID-19 positive). For the Coughvid dataset, the authors preprocessed and labeled samples into two groups: those from healthy individuals (COVID-19 negative) and those from individuals with notable cough variations (COVID-19 positive). Notably, no mention was found regarding demographic balancing (age, gender) in their train/test splits. Table 1: Intra-dataset performance on Coswara dataset from literature Study AUC Precision Recall Zhang et al. [ 43 ] 0.86 – 0.60 Sobahi et al. [ 39 ] – 0.90 0.88 Chowdhury et al. [ 5 ] 0.66 0.76 0.47 Islam et al. (DNDT) [ 16 ] 0.84 0.52 0.80 Islam et al. (DNDF) [ 16 ] 0.92 0.72 0.93 Table 2: Intra-dataset performance on Coughvid dataset from literature Study AUC Precision Recall Orlandic et al. [ 33 ] 0.88 – – Sunitha et al. [ 41 ] – 0.76 0.77 Hamdi et al. [ 12 ] 0.91 0.91 0.90 Hamdi et al. [ 11 ] 0.91 0.95 0.86 Aytekin et al. [ 2 ] 0.83 0.77 1.00 Pavel and Ciocoiu [ 35 ] 0.76 0.69 0.68 Islam et al. (DNDT) [ 16 ] 0.81 0.83 0.79 Islam et al. (DNDF) [ 16 ] 0.93 0.93 0.94 Table 3: Cross-dataset performance from Islam et al. [ 16 ] Training \rightarrow Test AUC Precision Recall F1-Score Coswara \rightarrow Coughvid 0.53 0.57 0.24 0.33 Coughvid \rightarrow Coswara 0.57 0.17 0.85 0.28 Islam et al. achieved 0.92 of ROC-AUC on Coswara (Table 1 ) and 0.93 on Coughvid (Table 2 ). The models trained on Coswara and tested on Coughvid had a AUC of to 0.53 with an F1-Score of 0.33 (Table 3 ). Similarly, models trained on Coughvid and tested on Coswara achieved an AUC of 0.57 with an F1-Score of 0.28, despite maintaining high recall (0.85) at the cost of precision (0.17). This substantial performance drop in cross-dataset scenarios highlights the limited generalization capability of current COVID-19 detection models across different audio datasets. 3 Methodology 3.1 Datasets 3.1.1 Coswara Dataset The Coswara dataset [ 38 ] is a publicly available COVID-19 audio dataset developed by the Indian Institute of Science. We utilized version 1.0.0 of this dataset, focusing specifically on cough-heavy audio recordings for COVID-19 detection. Preprocessing The original dataset contained 2,746 unique participant IDs with cough-heavy audio recordings. Our preprocessing pipeline involved the following steps: 1. Audio Quality Filtering : We removed 43 recordings with zero duration, ensuring only valid audio samples were retained. 2. Label Mapping : To create a binary classification task, we consolidated the COVID status labels as follows: • COVID-positive class: combined positive moderate , positive mild , and positive asymptomatic categories • COVID-negative class: healthy participants only • Excluded categories: no respiratory illness exposed , recovered full , respiratory illness not identified , and under validation 3. Metadata Completeness : We excluded participants with missing demographic information (age or gender), ensuring robust stratification capabilities. After preprocessing, the dataset comprised 2,083 participants with confirmed COVID-positive or COVID-negative status. Table 4 presents the demographic distribution of the filtered dataset before balancing. The dataset exhibited significant class imbalance, with COVID-negative samples substantially outnumbering COVID-positive samples across most demographic groups. Table 4: Dataset Balancing: Original vs. Stratified Undersampled Counts for Coswara COVID-19 Healthy Healthy Age Group Gender (Template) (Unbalanced) (Balanced) 0–17 Female 7 7 7 Male 10 20 10 18–29 Female 90 182 90 Male 135 470 135 30–39 Female 54 78 54 Male 97 297 97 40–49 Female 30 47 30 Male 61 131 61 50–59 Female 43 30 30 Male 56 102 56 60+ Female 43 12 12 Male 51 28 28 Other 1 1 1 Total Samples 648 1,435 571 To address the class imbalance and ensure fair model training, we implemented a stratified undersampling approach. The balancing strategy preserved the demographic distribution of the minority class (COVID-positive) while undersampling the majority class (COVID-negative) to achieve equal representation across age and gender strata. Balancing Methodology For each demographic stratum (age group \times gender combination), we: 1. Retained all

Read the complete text