Skill-Aligned Fairness in Multi-Agent Learning for Collaboration in Healthcare
Promise Osaine Ekpo, Brian La, Thomas Wiener, Saesha Agarwal, Lekan P. Molu · 2025
Read Skill-Aligned Fairness in Multi-Agent Learning for Collaboration in Healthcare by Promise Osaine Ekpo, Brian La, Thomas Wiener, Saesha Agarwal, Lekan P. Molu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-18708.txt.
Introduction
Promise Osaine Ekpo and co-authors argue that fair teamwork in health care must match tasks to skill, not just split counts evenly, in work from twenty twenty-five. Fairness in team learning is often framed as balance of workload alone. That frame can hand hard tasks to the wrong worker. In health care, misfits raise burnout and overuse of top staff. Skill fit matters as much as equal counts for safe care.
The team offers a frame called FairSkillMARL with fairness as a dual goal. One goal keeps workload even across the team. The other goal aligns each task with the skill of its worker. They also build MARLHospital, a test world for team mix and energy limits. Tests pit the frame against standard team methods and fairness scores. Even splits alone lead to skill misfits in the results. The work gives tools for fairer teams where skill varies.
Catalog record
| CREATOR | Promise Osaine Ekpo, Brian La, Thomas Wiener, Saesha Agarwal, Lekan P. Molu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-18708
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Skill-Aligned Fairness in Multi-Agent Learning for Collaboration in Healthcare Thanks: Citation : Promise Osaine Ekpo, Brian La, Thomas Wiener, Saesha Agarwal, Arshia Agrawal, Gonzalo Gonzalez-Pumariega, Lekan P. Molu, Angelique Taylor. Skill-Aligned Fairness in Multi-Agent Learning for Collaboration in Healthcare. Pages…. DOI:000000/11111. Promise Osaine Ekpo, Brian La, Thomas Wiener, Saesha Agarwal, Lekan P. Molu Abstract Fairness in multi-agent reinforcement learning (MARL) is often framed as a workload balance problem, overlooking agent expertise and the structured coordination required in real-world domains. In healthcare, equitable task allocation requires workload balance or expertise alignment to prevent burnout and overuse of highly skilled agents. Workload balance refers to distributing an approximately equal number of subtasks or equalised effort across healthcare workers, regardless of their expertise. We make two contributions to address this problem. First, we propose FairSkillMARL, a framework that defines fairness as the dual objective of workload balance and skill-task alignment. Second, we introduce MARLHospital, a customizable healthcare-inspired environment for modeling team compositions and energy-constrained scheduling impacts on fairness, as no existing simulators are well-suited for this problem. We conducted experiments to compare FairSkillMARL in conjunction with four standard MARL methods, and against two state-of-the-art fairness metrics. Our results suggest that fairness based solely on equal workload might lead to task-skill mismatches and highlight the need for more robust metrics that capture skill-task misalignment. Our work provides tools and a foundation for studying fairness in heterogeneous multi-agent systems where aligning effort with expertise is critical. K eywords Multiagent reinforcement learning \cdot Fairness \cdot Healthcare simulator 1 Introduction In multi-agent systems, agents must learn to cooperate while leveraging resources in their environment to achieve individual and collective objectives [ 1 ] . In this paper, we are interested in effective modeling methods in safety-critical healthcare workers (HCW) environments, such as emergency departments (ED). A distinguishing feature of these environments that necessitates new tools to model behaviour is the need for workers (henceforth referred to as agents) to perform overlapping tasks, and occasionally relieve other workers based on availability, energy levels, and skills. Common medical procedures in the ED are composed of subtasks that must be carried out sequentially to achieve a goal. This includes individual tasks such as the use of automated external defibrillator and administering medication, and shared tasks such as Cardiopulmonary resuscitation (CPR); CPR requires multiple agents to perform task-switching once they become fatigued from performing chest compressions. In real-world environments, many HCWs are overworked (i.e., burnout) when assigned tasks that do not align with their expertise (i.e., skill-task misalignment). When this happens, HCWs spend more time accomplishing tasks compared to a skilled HCW with relevant expertise who can perform the task more efficiently [ 2 , 3 , 4 ] . To prevent burnouts and to ensure fairness in EDs, in this work, we propose a framework for fairness in a multi-agent reinforcement learning (MARL) setting. Figure 1: MARLHospital : Breakdown of the Planning Domain Definition Language (PDDL) environment wrapped by the MARL environment with 3 HCWs and a patient. Prior work has quantified fairness as reward equality in social dilemmas [ 5 ] , worst-case performance guarantees in traffic scheduling [ 6 ] , balanced throughput in network control [ 7 , 8 ] , equitable effort distribution in cooperative navigation tasks [ 9 ] , cumulative reward parity in hierarchical learning (such as Fair-Efficient Networks, [ 10 ] and demographic parity in resource allocation [ 11 ] . However, these definitions do not jointly account for the skill-task alignment and overutilization of agents who are repeatedly tasked with the most demanding actions. Furthermore, existing simulators lack realistic healthcare-themed environments that model agent energy levels, skill-task alignment, and workload in structured team configurations. More broadly, the intersection of MARL, healthcare, and fairness is understudied. As a step towards a fairness framework for MARL for varying-skilled heterogeneous agents, such as in the ED, we require a multi-agent simulation environment that captures the challenges faced by HCWs during medical procedures. Specifically, various classes of MARL algorithms, including Independent learning (IL) [ 12 , 13 ] and Centralized Training with Decentralized Execution (CTDE) algorithms [ 14 , 15 ] , have been benchmarked on cooperative applications where multiple agents must work together to achieve a goal. Other approaches, including ROles to DEcompose (RODE) [ 16 ] , Role-oriented multi-agent reinforcement learning framework (ROMA) [ 17 ] , learn dynamic subtask assignment LDSA [ 18 ] , and role-transfer CTDE [ 19 ] , explore role-switching. Simulators provide a controlled environment for modeling and analyzing cooperative tasks among multiple agents, thereby facilitating detailed optimization and evaluation of team dynamics and coordination [ 20 , 21 , 22 , 23 ] . However, existing simulators lack realistic healthcare-themed environments that model agent energy levels, skill-task alignment, and workload. To address these research gaps, we introduce MARLHospital, a simulation environment that captures HCWs’ interactions during medical procedures. MARLHospital is beneficial because it models structured teams with varying expertise, in tasks inspired by real-world medical procedures, and uniquely includes the execution of order-dependent and shared-task mode where agents alternate actions due to energy constraints, modelling agent fatigue across long time horizons, unlike prior work [ 20 , 21 , 22 , 23 ] . Furthermore, we introduce FairSkillMARL, a framework that formulates fairness as a balance of workload and skill-task alignment during collaborative tasks, whilst factoring in the progressively dissipative energy levels of agents. This framing has the potential to improve the efficiency of healthcare teams by leveraging task-switching and agent expertise. Our contributions are threefold: 1) We introduce a customizable hospital-themed game environment inspired by real-world settings. 2) We share insights about the performance of four standard MARL algorithms, including on-policy and off-policy methods, across varying team compositions, task difficulties, and energy levels in three healthcare benchmark tasks. 3) We introduce a FairSkillMARL framework, which redefines fairness as a composite disparity of agent skill-task alignment and workload, and our results demonstrate that FairSkillMARL shows competitive performance alongside state-of-the-art fairness metrics, particularly for simulated tasks and the need for more robust metrics to capture skill misalignment. 2 Related Work In healthcare, fairness extends beyond efficiency to patient safety, requiring mechanisms that prevent HCWs fatigue from unfair workload and treatment delays caused by assigning tasks to workers outside their specialties. In social dilemmas, inequity aversion reduces envy and guilt by penalizing outcome disparities, promoting cooperation [ 5 ] . Prior work has quantified fairness across multi-agent domains. In networked systems, fairness is often framed through worst-case guarantees, namely, maximizing the 5%-tile user data rate [ 6 ] . In traffic signal control, fairness is integrated into value functions to ensure low-traffic lanes are scheduled equally [ 7 , 8 ] . These approaches focus on reward parity or throughput smoothing but assume homogeneous agents. Structural fairness has been explored in cooperative control by penalizing travel deviations to balance workload [ 9 ] and propose switching between fair and efficient subpolicies [ 10 ] . Social fairness constraints have also been encoded, such as demographic parity in Proximal Policy Optimization (PPO) [ 11 ] . While addressing various fairness goals, these works often overlook skill-agent compatibility and task-agent mismatch. In contrast, we define fairness for role differentiated, safety-critical domains along