COHORT: Hybrid RL for Collaborative Large DNN Inference on Multi-Robot Systems Under Real-Time Constraints
M. S. Anwar, A. Ravi, I. Ghosh, G. Shinde, C. Busart, N. Roy University of Maryland Baltimore County DEVCOM Army Research Laboratory {saeid.anwar, anuradha, gshinde1, indrajeetghosh, nroy}@umbc.edu [email protected] · 2026
Read COHORT: Hybrid RL for Collaborative Large DNN Inference on Multi-Robot Systems Under Real-Time Constraints by M. S. Anwar, A. Ravi, I. Ghosh, G. Shinde, C. Busart, N. Roy University of Maryland Baltimore County DEVCOM Army Research Laboratory {saeid.anwar, anuradha, gshinde1, indrajeetghosh, nroy}@umbc.edu [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-10436.txt.
Introduction
M S Anwar and co-authors present COHORT, a framework that lets robot teams share large neural network inference under tight real-time limits. Field robots have little compute, bandwidth, and battery, and may have no server to lean on. COHORT learns an offline scheduling policy from auction-based allocation data, then adapts it online with multi-agent reinforcement learning. On vision-language tasks it cut battery use, raised GPU use, and met frame-rate and deadline constraints far more often than baselines.
Catalog record
| CREATOR | M. S. Anwar, A. Ravi, I. Ghosh, G. Shinde, C. Busart, N. Roy University of Maryland Baltimore County DEVCOM Army Research Laboratory {saeid.anwar, anuradha, gshinde1, indrajeetghosh, nroy}@umbc.edu [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57700 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.10436
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
COHORT: Hybrid RL for Collaborative Large DNN Inference on Multi-Robot Systems Under Real-Time Constraints M. S. Anwar, A. Ravi, I. Ghosh, G. Shinde, C. Busart, N. Roy University of Maryland Baltimore County DEVCOM Army Research Laboratory {saeid.anwar, anuradha, gshinde1, indrajeetghosh, nroy}@umbc.edu [email protected] Abstract Large deep neural networks (DNNs), especially transformer-based and multimodal architectures, are computationally demanding and challenging to deploy on resource-constrained edge platforms like field robots. These challenges intensify in mission-critical scenarios (e.g., disaster response), where robots must collaborate under tight constraints on bandwidth, latency, and battery life, often without infrastructure or server support. To address these limitations, we present COHORT, a collaborative DNN inference and task-execution framework for multi-robot systems built on the Robotic Operating System (ROS). COHORT employs a hybrid offline–online reinforcement learning (RL) strategy to dynamically schedule and distribute DNN module execution across robots. Our key contributions are threefold: (a) Offline RL policy learning combined with Advantage-Weighted Regression (AWR), trained on auction-based task allocation data from heterogeneous DNN workloads across distributed robots, (b) Online policy adaptation via Multi-Agent PPO (MAPPO), initialized from the offline policy and fine-tuned in real time, and (c) comprehensive evaluation of COHORT on vision-language model (VLM) inference tasks such as CLIP and SAM, analyzing scalability with increasing robot/workload and robustness under . We benchmark COHORT against genetic algorithms and multiple RL baselines. Experimental results demonstrate that COHORT reduces battery consumption by 15.4%, and increases GPU utilization by 51.67%, while satisfying frame-rate and deadline constraints 2.55 × 2.55\times of the time. I Introduction Modern search-and-rescue (SAR) operations increasingly employ autonomous robotic agents to support human responders in locating survivors and assessing hazardous environments [ 1 ] . These robotic agents are required to interpret complex scenes, detect and track objects of interest, and respond to natural-language queries issued by human operators in real time. While individual agents are capable of navigating diverse terrains autonomously, collaborative operation among robots is essential [ 2 ] to improve perception quality, navigation robustness, and system resilience—particularly in scenarios where one or more robots may fail during deployment. Collaboration further enables more effective utilization of limited onboard resources, which is critical because robotic agents are severely resource constrained and often operate for extended durations without access to recharging infrastructure. Energy efficiency is a fundamental concern in SAR missions. Although each robotic agent is equipped with its own battery, uncoordinated task execution can rapidly deplete critical energy reserves, thereby reducing overall mission duration. For example, a Jackal unmanned ground vehicle (UGV) can operate on battery power for approximately 2–8 hours [ 3 ] , depending on the workload, with perception and navigation pipelines consuming the majority of available energy. While prior research has focused extensively on optimizing navigation efficiency, our work targets the optimization of perception workloads to extend mission lifetime. Perception awareness is a cornerstone of SAR operations, enabling robots to identify humans in cluttered scenes, navigate debris-filled environments, and coordinate medical assistance with first responders. Recent advances in Vision–Language Models (VLMs) have significantly improved perception accuracy and generalization across diverse environments. While convolutional neural networks (CNNs) such as YOLOv8 have achieved notable success in object detection, they require extensive supervised training and domain-specific tuning. In contrast, VLMs generalize effectively across heterogeneous scenes, support open-ended reasoning, and respond directly to human queries—capabilities that are particularly valuable in SAR scenarios [ 4 ] . However, these advantages come at a substantial computational cost: VLMs are resource-intensive [ 5 ] , demanding significant compute, memory, and energy resources to execute efficiently. To mitigate these challenges, existing approaches often rely on the edge–cloud continuum to offload computation and reduce latency [ 6 ] . In disaster-response scenarios, however, reliable network connectivity to cloud or server infrastructure is often unavailable, rendering such approaches impractical. Consequently, robotic agents must operate in a fully decentralized manner, collaboratively sharing workloads and leveraging peers with surplus resources. A practical solution is to distribute computational workloads among robots and utilize agents with greater available resources to execute demanding tasks [ 7 ] . Several state-of-the-art studies [ 8 , 9 ] have proposed optimization-based methods to partition and distribute DNN workloads across edge devices and cloud servers. Hongcai et al. [ 10 ] further propose a deep reinforcement learning framework to allocate computational tasks across multiple edge devices. However, these solutions are typically evaluated in simulation or controlled environments, do not account for real-world robotic deployments, and often overlook critical challenges related to scalability and resilience—particularly in cases where devices may dynamically join or leave the system. Achieving effective collaborative inference in real-world robotic systems introduces several intertwined challenges. Heterogeneity is inherent: UGVs differ substantially in compute throughput, memory capacity, sensing modalities, and battery chemistry, rendering fixed or one-time model partitioning ineffective as operating conditions evolve. Resource volatility further complicates execution, as robot mobility and temperature variations cause available compute and energy budgets to fluctuate over time. Energy must also be treated as a first-class constraint: naïve scheduling decisions can prematurely drain critical robots, reducing mission coverage or forcing early withdrawal from operational zones. To address these challenges, we propose COHORT’s , a distributed large DNN inference framework that dynamically balances workloads across heterogeneous robotic agents based on real-time resource availability. Unlike prior work [ 11 ] that assumes homogeneous workloads or resources, COHORT’s explicitly accounts for dynamic workloads and device heterogeneity. Moreover, existing frameworks such as auction-based scheduling [ 12 ] require frequent information exchange between agents to share resource states and bids—an impractical assumption in bandwidth-constrained SAR environments. In contrast, COHORT’s emphasizes one-shot decision making and minimizes inter-agent communication. Deep reinforcement learning frameworks such as Multi-Agent Proximal Policy Optimization (MAPPO) [ 13 ] provide a powerful foundation for cooperative decision making in multi-agent systems. However, MAPPO typically requires a large number of online interactions to converge to stable policies. To mitigate this limitation, we introduce a hybrid reinforcement learning (HybridRL) strategy that combines offline and online learning. Specifically, COHORT’s first collects offline execution traces using auction-based heuristic policies while executing heterogeneous DNN modules across multiple robots. These traces are used to train resource-specific agent policies and a centralized critic that captures inter-agent interactions. The resulting policies are then deployed on individual robots and fine-tuned online to adapt to changing workloads, varying team sizes, and dynamic environmental conditions. When new devices join the system, COHORT’s initializes their policies by selecting pretrained agents with similar resource profiles—for example, deploying a Husky-trained agent on a laptop with comparable computational resources. In addition to efficient task allocation, COHORT’s explicitly enforces real-time execution constraints, including application-specific frame-rate (FPS) requirements and execution deadlines. These constraints are integrated into the learning objective to ensure that collaborative inference remains both timely and energy-efficient. We summarize our contributions as follows: 1) Resource-Aware Distributed Large DNN Execution Framework: COHORT introduces a two-stage reinforcement learning pipeline for distributed execution of large DNN workloads across heterogeneous robotic agents. The framework continuously monitors local and peer resource states and makes scheduling decisions with minimal inter-agent communication. By eliminating reliance on centralized servers, COHORT enables autonomous workload balancing under dynamic compute, network, and mobility conditions, improving robustness in real-world deployments. 2) Fault-Tolerant Workload Reallocation Strategy: We design a fault-tolerant mechanism that dynamically reallocates tasks in response to resource failures,