Patient-Level Multimodal Question Answering from Multi-Site Auscultation Recordings

Fan Wu, Tsai-Ning Wang, Nicolas Zumarraga, Ning Wang, Markus Kreft, Kevin O’Sullivan, Elgar Fleisch, Oliver Aalami, Paul Schmiedmayer, Robert Jakob, Patrick Langer · 2026

Read Patient-Level Multimodal Question Answering from Multi-Site Auscultation Recordings by Fan Wu, Tsai-Ning Wang, Nicolas Zumarraga, Ning Wang, Markus Kreft, Kevin O’Sullivan, Elgar Fleisch, Oliver Aalami, Paul Schmiedmayer, Robert Jakob, Patrick Langer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13362.txt.

Description

Fan Wu and co-authors build a patient-level question answering model from auscultation recordings. Listening to body sounds is a key diagnostic tool, but readings can be subjective. General audio-language models struggle with the fine traits of physiological signals, the team notes. Their framework aligns multi-site recordings with a frozen LLM embedding space via gated cross-attention. Lightweight domain encoders rivaled large audio-language models on the CaReSound benchmark. Pooling sites gave spatial redundancy that eased the harm of truncated recordings.

Catalog record

CREATORFan Wu, Tsai-Ning Wang, Nicolas Zumarraga, Ning Wang, Markus Kreft, Kevin O’Sullivan, Elgar Fleisch, Oliver Aalami, Paul Schmiedmayer, Robert Jakob, Patrick Langer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20681
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.13362

Browse the full library · About the Tower of Babel