Patient-Level Multimodal Question Answering from Multi-Site Auscultation Recordings
Fan Wu, Tsai-Ning Wang, Nicolas Zumarraga, Ning Wang, Markus Kreft, Kevin O’Sullivan, Elgar Fleisch, Oliver Aalami, Paul Schmiedmayer, Robert Jakob, Patrick Langer · 2026
Read Patient-Level Multimodal Question Answering from Multi-Site Auscultation Recordings by Fan Wu, Tsai-Ning Wang, Nicolas Zumarraga, Ning Wang, Markus Kreft, Kevin O’Sullivan, Elgar Fleisch, Oliver Aalami, Paul Schmiedmayer, Robert Jakob, Patrick Langer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-13362.txt.
Description
Fan Wu and co-authors build a patient-level question answering model from auscultation recordings. Listening to body sounds is a key diagnostic tool, but readings can be subjective. General audio-language models struggle with the fine traits of physiological signals, the team notes. Their framework aligns multi-site recordings with a frozen LLM embedding space via gated cross-attention. Lightweight domain encoders rivaled large audio-language models on the CaReSound benchmark. Pooling sites gave spatial redundancy that eased the harm of truncated recordings.
Catalog record
| CREATOR | Fan Wu, Tsai-Ning Wang, Nicolas Zumarraga, Ning Wang, Markus Kreft, Kevin O’Sullivan, Elgar Fleisch, Oliver Aalami, Paul Schmiedmayer, Robert Jakob, Patrick Langer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 20681 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.13362