Adaptive Test-Time Scaling for Zero-Shot Respiratory Audio Classification
Tsai-Ning Wang, Herman Teun den Dekker, Lin-Lin Chen, Neil Zeghidour, Aaqib Saeed · 2026
Read Adaptive Test-Time Scaling for Zero-Shot Respiratory Audio Classification by Tsai-Ning Wang, Herman Teun den Dekker, Lin-Lin Chen, Neil Zeghidour, Aaqib Saeed (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12647.txt.
Introduction
Tsai-Ning Wang and four colleagues route respiratory audio by difficulty at test time. Scarce labels limit screening. Zero-shot inference avoids task training but spends equal compute everywhere. Their TRIAGE framework routes samples through tiers of rising richness. Three tiers rise in richness, from fast scoring to descriptor matching to language model reasoning. A confidence router ends easy cases early, spending more on ambiguous ones. Nearly half of samples exit at the cheapest tier. Mean AUROC reaches 0.744 across nine tasks, beating prior zero-shot methods.
Catalog record
| CREATOR | Tsai-Ning Wang, Herman Teun den Dekker, Lin-Lin Chen, Neil Zeghidour, Aaqib Saeed |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47296 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.12647
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptive Test-Time Scaling for Zero-Shot Respiratory Audio Classification Tsai-Ning Wang, Herman Teun den Dekker, Lin-Lin Chen, Neil Zeghidour, Aaqib Saeed Abstract Automated respiratory audio analysis promises scalable, non-invasive disease screening, yet progress is limited by scarce labeled data and costly expert annotation. Zero-shot inference eliminates task-specific supervision, but existing methods apply uniform computation to every input regardless of difficulty. We introduce TRIAGE, a tiered zero-shot framework that adaptively scales test-time compute by routing each audio sample through progressively richer reasoning stages: fast label-cosine scoring in a joint audio-text embedding space (Tier-L), structured matching with clinician-style descriptors (Tier-M), and retrieval-augmented large language model reasoning (Tier-H). A confidence-based router finalizes easy predictions early while allocating additional computation to ambiguous inputs, enabling nearly half of all samples to exit at the cheapest tier. Across nine respiratory classification tasks without task-specific training, TRIAGE achieves a mean AUROC of 0.744, outperforming prior zero-shot methods and matching or exceeding supervised baselines on multiple tasks. Our analysis show that test-time scaling concentrates gains where they matter: uncertain cases see up to 19% relative improvement while confident predictions remain unchanged at minimal cost. † † year: 2026 † † volume: 297 † † workshop: Conference on Health, Inference, and Learning (CHIL) 2026 Figure 1 : Tiered test-time inference improves zero-shot respiratory audio classification. Points show mean AUROC (%) averaged over 9 tasks versus budget tier. CLAP and AcuLa are zero-shot baselines (horizontal lines). TRIAGE (Fixed) evaluates three compute budgets by forcing all samples to run up to Tier-L/Tier-M/Tier-H (Low/Mid/High), while TRIAGE (Adaptive) reports the single operating point produced by confidence-based routing across tiers. Data and Code Availability We use only publicly available datasets; the dataset descriptions and corresponding citations are provided in the Experiments section. Our source code is provided as anonymized supplemental material during review and will be made publicly available on GitHub upon acceptance. Institutional Review Board (IRB) This research does not require IRB approval. 1 Introduction Figure 2 : Overview of TRIAGE. A frozen audio–text encoder embeds recordings and medical text. Tier-L performs label cosine scoring with margin-based early exit; Tier-M matches clinical descriptors with rule voting; Tier-H retrieves nearest-neighbor reports and queries an off-the-shelf LLM, e.g., Gemini or GPT. Automated analysis of heart and lung sounds increasingly relies on audio–text embedding models that project recordings into a shared latent space, where classification reduces to similarity scoring against label prompts or lightweight classifiers ( 25 ; 26 ) . Yet current pipelines treat inference as a fixed-cost operation: a clean textbook wheeze and a faint crackle buried in motion artifact receive identical computation—one forward pass, one decision rule. This uniformity is mismatched to clinical reality. Auscultation recordings vary widely in signal quality, device characteristics, and diagnostic subtlety; some can be resolved from gross spectral features, while others require careful attention to timing within the respiratory cycle, the coexistence of multiple abnormalities, or acoustic cues that lie near the noise floor. When the same shallow inference is applied indiscriminately, difficult cases are under-served and overall robustness suffers. Adapting models to each clinical environment through fine-tuning offers one remedy, but this path is often blocked: regulatory approval takes months, labeled data from the target site may be scarce or inaccessible, and computational resources are constrained. A more agile alternative is to improve inference itself—extracting more from a frozen model by spending additional computation selectively on recordings that need it. This idea has gained traction in language and vision under the banner of test-time scaling : sampling multiple candidate outputs, applying self-verification, or routing inputs through progressively richer reasoning stages based on difficulty ( 20 ; 3 ; 19 ) . These strategies complement the familiar benefits of scaling models and data at training time ( 11 ; 12 ) , yet they have been studied almost exclusively for autoregressive generators on open-domain benchmarks. For embedding-based systems—particularly in safety-critical medical applications—test-time compute remains underexplored as a resource that can be allocated differentially across inputs without any task-specific supervision. We address this gap with TRIAGE ( T iered R etrieval and I nference for A udio with G ated E scalation), a three-tier inference framework for zero-shot respiratory audio classification. TRIAGE leaves the underlying audio–text encoder frozen and instead modulates computation per recording through gated escalation. In the first tier, each recording is scored against natural-language label prompts via cosine similarity; cases with a confident margin are finalized immediately. Recordings that fall below this confidence threshold advance to a second tier, where the audio is matched against clinician-approved descriptor templates—structured queries probing sound timing, quality, and anatomical location. A rule-based aggregator distills these matches into an interpretable attribute profile. The most ambiguous cases proceed to a third tier: nearest-neighbor retrieval over an external corpus of audio–report pairs supplies supporting evidence, and a large language model synthesizes a final prediction grounded in retrieved context. This architecture exposes an explicit compute–accuracy tradeoff. By tuning the confidence thresholds that govern tier transitions, practitioners can shift the operating point: resolve more cases cheaply when efficiency is paramount, or escalate aggressively when reliability matters most. Empirically, we evaluate TRIAGE on nine tasks spanning five public respiratory datasets. In a fully zero-shot setting—no fine-tuning, no labeled examples from the target data—TRIAGE improves over direct embedding similarity by a substantial margin on the majority of tasks, with the largest gains concentrated on recordings that require escalation. These results suggest that adaptive inference-time computation is a practical way for improving robustness in medical audio, independent of model or data scaling. We make the following contributions: • Adaptive test-time scaling for medical audio embeddings. We show that selectively increasing inference computation on uncertain recordings—without task-specific training—can substantially improve zero-shot classification, offering an alternative pathway to robustness when model adaptation is infeasible. • A compute-aware formulation of auscultation inference. We cast respiratory audio classification as a staged decision process in which test-time computation is an explicit, tunable resource, enabling principled study of efficiency–accuracy tradeoffs across heterogeneous recording conditions. • An interpretable, clinically grounded inference pipeline. TRIAGE decomposes classification into label scoring, descriptor-based attribute extraction, and retrieval-augmented reasoning. Each stage yields human-readable outputs—confidence scores, attribute profiles, retrieved evidence—providing transparency into why a recording was escalated and how the final decision was reached. 2 Related Work Our work draws on three lines of research: domain-specific audio encoders for auscultation, audio–language models that enable zero-shot classification, and recent methods that treat inference-time computation as a tunable resource. We review each in turn, highlighting how TRIAGE builds on and departs from prior approaches. 2.1 Domain-Specific Audio Encoders for Auscultation Early AI-aided auscultation used hand-crafted features or shallow CNNs trained on small, single-task datasets (e.g., murmur or wheeze detection, normal–abnormal screening). Such models were tightly coupled to their training distribution, and adapting to new devices, populations, or label spaces typically required retraining. Recent foundation-style encoders pretrained on large, heterogeneous respiratory audio improve transfer: OPERA aggregates multi-source cough and breath corpora and shows strong transfer to held-out tasks ( 25 ) , while AcuLa aligns respiratory audio with a medical language model to inject clinical semantics and achieve state-of-the-art results across broad benchmarks ( 23 ) . In contrast, TRIAGE treats pretrained representations as fixed and improves performance through test-time inference, targeting recordings where a