Human-in-the-Loop Multi-Agent Ventilator Decision Support with Contextual Bandit Preference Learning

Sijia Li, Xiaoyu Tan, Qixing Wang, Weiyi Zhao, Chen Zhan, Teqi Hao, Xuemin Wang, Lei Gu, Roland Eils, Xihe Qiu , ✉ · 2026

Read Human-in-the-Loop Multi-Agent Ventilator Decision Support with Contextual Bandit Preference Learning by Sijia Li, Xiaoyu Tan, Qixing Wang, Weiyi Zhao, Chen Zhan, Teqi Hao, Xuemin Wang, Lei Gu, Roland Eils, Xihe Qiu , ✉ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23320.txt.

Introduction

Li and nine coauthors propose the Ventilator Decision Support System (VDSS). It is a human-in-the-loop multi-agent setup joining modular choice parts through contract-driven set links, giving tracked proof for review. VDSS performs online taste tuning with a local bandit, tuning doctor tastes from the final picked choice at each tuning cycle to guide later tips. Past ICU path replay with expert review shows higher tip yes rate and fewer talk rounds to reach a good plan.

Catalog record

CREATORSijia Li, Xiaoyu Tan, Qixing Wang, Weiyi Zhao, Chen Zhan, Teqi Hao, Xuemin Wang, Lei Gu, Roland Eils, Xihe Qiu , ✉
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20625
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23320

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Human-in-the-Loop Multi-Agent Ventilator Decision Support with Contextual Bandit Preference Learning Sijia Li, Xiaoyu Tan, Qixing Wang, Weiyi Zhao, Chen Zhan, Teqi Hao, Xuemin Wang, Lei Gu, Roland Eils, Xihe Qiu , ✉ Abstract Ventilator decision support requires sequential decisions that track evolving physiology and disease trajectories while respecting safety boundaries and clinician specific tuning styles. Rule based approaches rarely generalize personalization, and end to end reinforcement learning or single large language model systems remain difficult to control and audit. We propose the V entilator D ecision S upport S ystem ( VDSS ), a human in the loop multi agent framework that coordinates modular decision components through contract driven structured interfaces and produces traceable evidence for review. VDSS performs online preference adaptation with a contextual bandit, updating clinician specific preferences from the final accepted decision at each adjustment cycle and using them to guide subsequent recommendations. Structured rejection feedback triggers targeted replanning to reduce unproductive iterations and improve interaction stability. Retrospective ICU trajectory replay with expert review indicates higher recommendation acceptability and fewer interaction rounds to reach an acceptable plan, supporting clinically deployable human AI collaboration. † † footnotetext: * Equal contribution. ✉ Corresponding author. 1 Introduction Mechanical ventilation is a central life sustaining therapy in the intensive care unit. Its clinical value extends beyond maintaining oxygenation and ventilation, as effective care requires continuous and fine grained adjustment of settings to match a patient’s evolving physiology [ 24 , 4 ] . Ventilator management is inherently dynamic. Bedside teams must repeatedly revise decisions as lung mechanics, gas exchange, hemodynamics, and sedation levels change, while balancing multiple clinical objectives in real time [ 16 ] . At the same time, high quality titration depends on frequent assessment and rapid response by respiratory therapists and experienced clinicians [ 10 ] . This specialized workforce is persistently scarce in many health systems, and sustained workload together with shift handoffs makes it difficult to deliver consistently individualized management even within the same institution [ 6 ] . As patient volume rises and workflow pressure increases, a practical motivation for ventilator decision support is to embed expert practice in a scalable and reusable form that reduces cognitive burden and improves consistency [ 15 ] . Current practice is guided by protocols and accumulated experience, yet real ICU care presents persistent challenges for decision support [ 5 ] . Patient heterogeneity and nonstationary trajectories cause strategy benefits to vary across individuals and over time, limiting fixed rule reliability [ 9 , 19 ] . Bedside titration often requires rapid setting changes based on multiple imperfect signals, and limited time to check and document the rationale can make adjustments inconsistent across cycles [ 21 , 7 ] . Clinical teams further differ in risk tolerance, tuning style, and local conventions, and without explicit modeling and adaptation, decision support is unlikely to achieve sustained trust or uptake [ 8 , 26 ] . Beyond a recommended setting, clinicians need a transparent link between the recommendation, the patient state, prevailing practice, and team preferences to support efficient repeated use [ 14 ] . These factors motivate ventilator decision support that is workflow aligned, coherent, and interpretable, while able to adapt as clinical preferences evolve [ 20 , 1 ] . Motivated by these needs, we argue that in high risk clinical settings, pointwise model performance is necessary but not sufficient [ 22 , 13 ] . Successful deployment instead hinges on decision support whose behavior can be inspected at the bedside and refined over time without breaking clinical workflow. We therefore propose the Ventilator Decision Support System, a human in the loop multi agent framework that decomposes ventilator decision making into modular agents and regulates inter agent communication through contract driven structured interfaces, enabling coherent multi round collaboration with a clear, auditable reasoning trace [ 27 , 3 ] . The system uses layered short term and long term memory to manage trajectory level information and within round context, improving recommendation consistency and interaction stability [ 17 ] . It further incorporates a contextual bandit for online preference adaptation, treating the clinician’s final decision at the end of each adjustment cycle as feedback to update an individualized preference representation and guide subsequent recommendations. We validate this framework through retrospective ICU trajectory replay and expert review, showing improved recommendation acceptability and fewer interaction rounds to reach an acceptable recommendation [ 2 ] . 1. VDSS is introduced as a human in the loop multi agent ventilator decision support framework that enables verifiable and maintainable collaboration through modular decomposition and contract driven interfaces. 2. Layered short term and long term memory is integrated with an auditable evidence trail so that multi round recommendations remain coherent and are accompanied by traceable state summaries and rationale for structured review. 3. An online preference adaptation mechanism is developed based on a contextual bandit that uses cycle level clinician decisions as feedback to adapt to different tuning styles, improving acceptability and reducing interaction rounds. Figure 1: Overview of VDSS. Panel A shows the patient and clinical data hub with a context window and long term memory. Panel B depicts the VDSS multi agent reasoning engine from detection and phase goal inference to hold adjust gating, planning, safety checking, and feedback driven revision. Panel C summarizes the human in the loop interface and online clinician preference optimization with a contextual bandit. 2 Ventilator Decision Support System 2.1 VDSS Architecture: Multi-Agent Framework VDSS organizes bedside ventilator titration as a contract governed multi-agent workflow rather than a single model that directly maps clinical inputs to ventilator recommendations. Here, agents refer to LLM or VLM reasoning modules with defined clinical roles, role specific inputs, and schema constrained outputs, while graph routing, mode compatibility validation, and safety checking are implemented as deterministic control components. At each adjustment cycle t , VDSS forms the decision input x_{t} from the current bedside state, current ventilator settings, short term context, and long term memory. Physiological and ventilatory measurements are treated as state variables, whereas clinician adjustable ventilator settings, including ventilation mode, PEEP, oxygen concentration, pressure support, inspiratory pressure, and respiratory rate, are treated as action variables. This design maintains a traceable path from evidence extraction to decision reasoning and clinician facing communication. When waveform data are available, the Waveform Analyzer first converts rendered pressure and flow traces into structured bedside cues, including waveform quality, asynchrony patterns, suspicious events, observed patient state, and uncertainty, thereby complementing tabular signals with dynamic ventilatory evidence [ 23 ] . The Detection Agent integrates these waveform-derived cues with physiological and ventilatory measurements to identify abnormalities and generate a structured state summary. This summary is then interpreted by the Phase Goal Manager , which infers the current treatment phase and specifies primary and secondary goals. Conditioned on the detected abnormalities and phase-consistent objectives, the Hold/Adjust Gate selects a branch decision b_{t}\in\{\mathrm{hold},\mathrm{adjust}\} . This gate enables VDSS to avoid unnecessary titration when the current configuration is acceptable or when the available evidence is insufficient for safe adjustment. The overall workflow is illustrated in Fig. 1 . If b_{t}=\mathrm{hold} , VDSS proceeds directly to cycle closure by generating a clinician-facing summary and structured record. If b_{t}=\mathrm{adjust} , VDSS enters the active

Read the complete text