Reason-to-Transmit: Deliberative Adaptive Communication for Cooperative Perception

Aayam Bansal, Ishaan Gangwani · 2026

Read Reason-to-Transmit: Deliberative Adaptive Communication for Cooperative Perception by Aayam Bansal, Ishaan Gangwani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20308.txt.

Introduction

Bansal and Gangwani present Reason-to-Transmit, a framework for cooperative perception among vehicles. Agents must share sensor data over tight vehicle-to-everything bandwidth. Older methods use fixed rules to choose what to send. Their module weighs scene context, neighbor information gaps, and budget for each region. Any communication beat no communication by about 58% average precision. Their method gained most under heavy occlusion, nearing oracle scores. It also held up under packet drops of up to 50%.

Catalog record

CREATORAayam Bansal, Ishaan Gangwani
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34402
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.20308

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reason-to-Transmit: Deliberative Adaptive Communication for Cooperative Perception Aayam Bansal, Ishaan Gangwani Abstract Cooperative perception among autonomous agents promises to overcome the fundamental limitations of single-agent sensing, yet bandwidth constraints in vehicle-to-everything (V2X) networks demand intelligent communication policies. Existing approaches rely on reactive mechanisms—spatial confidence maps, learned gating, or sparse masks—to decide what to transmit, without reasoning about why a particular message would benefit the receiver. We introduce Reason-to-Transmit (R2T) , a framework that equips each agent with a lightweight transformer-based reasoning module that deliberates over local scene context, estimated neighbor information gaps, and the current bandwidth budget before making per-region transmit decisions. Inspired by the deliberative reasoning paradigm in agentic AI, R2T treats the communication decision as a structured inference problem rather than a reactive filter. Trained end-to-end with a bandwidth-aware objective, R2T is evaluated against nine baselines—including Where2Comm-style confidence maps, IC3Net-style gating, and learned sparse masks—in a controlled multi-agent bird’s-eye-view (BEV) perception environment with five random seeds. Any form of selective communication yields a dramatic ∼ 58 % {\sim}58\% AP improvement over no communication, confirming that the gated fusion module effectively leverages received features. Among selective policies at low bandwidth (10%, 2.4 KB), all methods perform competitively within a narrow ∼ 0.5 % {\sim}0.5\% AP band. R2T’s distinctive advantage emerges under high occlusion, where information asymmetry between agents is greatest: R2T leads all non-oracle methods (0.205 AP), closest to the oracle upper bound (0.205), outperforming Where2Comm (0.203) and IC3Net (0.202). All methods degrade gracefully under packet drops up to 50%, confirming the inherent robustness of gated cooperative fusion. 1 Introduction Autonomous agents operating in complex environments face inherent perceptual limitations: occluded regions, limited sensor range, and noisy observations all degrade the reliability of local sensing. Cooperative perception, in which multiple agents share complementary sensory information over a communication channel, has emerged as a powerful strategy to overcome these limitations 26 ; 18 ; 25 . By fusing features from neighboring agents, each agent can construct a richer, more complete representation of its surroundings, detecting objects that would otherwise be invisible due to occlusion or range limitations. This capability is especially critical for safety-critical applications such as autonomous driving, where a single missed detection can have severe consequences. However, real-world V2X communication channels are bandwidth-constrained. The DSRC and C-V2X standards impose strict throughput limits, and transmitting the full intermediate feature representation from every agent to every neighbor is infeasible, particularly in dense traffic scenarios. This fundamental tension between perception quality and communication cost has motivated a growing body of work on communication-efficient cooperative perception. Where2comm 6 achieves dramatic bandwidth savings through learned spatial confidence maps. Who2com 11 and When2com 10 learn to select communication partners and timing. IC3Net 14 introduces learned gating to decide when inter-agent messages are beneficial. DiscoNet 8 uses knowledge distillation to optimize a collaboration graph. Recent work continues to push the boundary: V2X-PC 9 introduces point clusters as sparse message units, V2X-INCOP 12 addresses communication interruption, V2X-ReaLO 22 demonstrates real-world online cooperative perception, HeatV2X 30 handles heterogeneous agent alignment, and V2X-DG 7 tackles domain generalization across datasets. Despite their effectiveness, these methods share a common limitation: their transmission policies are reactive rather than deliberative . A confidence-based policy transmits regions where the sender is most certain, without considering whether the receiver already observes those regions. A gating mechanism learns a binary open-or-close decision without structured reasoning about the downstream utility of the message. An uncertainty-based policy conflates sender uncertainty with receiver information need. None of these approaches explicitly model the complementarity between what the sender observes and what the receiver lacks. In contrast, the success of reasoning-based agents in embodied settings 1 ; 29 ; 28 ; 21 has demonstrated that structured deliberation—inspired by chain-of-thought 20 and ReAct 27 —can yield superior decision-making by explicitly considering context, goals, and the state of other agents. This raises a natural question: Can deliberative reasoning improve communication decisions in cooperative perception? We answer this question affirmatively with Reason-to-Transmit (R2T) , a framework that introduces a lightweight transformer-based reasoning module into the communication pipeline of cooperative perception systems. Rather than relying on simple per-region statistics, R2T reasons jointly over (i) local detection features, (ii) estimated information gaps of neighboring agents (based on known relative positions), (iii) scene-level context including occlusion patterns, and (iv) the remaining bandwidth budget. This deliberative process produces per-region transmit decisions that prioritize messages with the highest expected downstream utility for the receiver. Clarification on “reasoning.” R2T does not use a large language model at inference time. Instead, it distills the deliberative reasoning paradigm —jointly considering multiple context signals through self-attention before deciding—into a small ( \sim 0.26M parameter) transformer. We view this as analogous to how knowledge distillation transfers capabilities from a large teacher to a small student: the architectural pattern of structured deliberation is preserved, even though the model itself is compact and real-time. The term “reasoning-based” refers to this structured, context-aware decision process, in contrast to the reactive, per-region statistics used by existing methods. We evaluate R2T in a controlled synthetic multi-agent BEV perception environment with four agents, configurable occlusion, and noisy observations. We deliberately adopt a synthetic setting following the tradition of using simplified environments to isolate algorithmic contributions 15 ; 4 ; 14 . All experiments use five random seeds with reported mean and standard deviation. We compare against both reactive heuristics and three strong learned baselines: a Where2Comm-style spatial confidence policy, an IC3Net-style learned gating policy, and a learned sparse mask with L1 penalty. We also include an oracle upper bound that selects regions based on ground-truth object content. Our contributions are: 1. We propose Reason-to-Transmit (R2T) , the first framework to apply deliberative, context-aware reasoning to the communication decision in cooperative perception, bridging agentic AI and multi-agent sensing. 2. We design a lightweight reasoning module based on a small transformer that jointly considers local features, neighbor state estimates, and bandwidth constraints to make per-region transmit decisions. 3. We demonstrate through controlled experiments with five seeds, nine baselines (including three learned), and an oracle upper bound that R2T achieves the strongest performance at low bandwidth and under high occlusion, while all methods degrade gracefully under packet drops. 2 Related Work Cooperative Perception. Multi-agent cooperative perception has become a central research topic in autonomous driving. Early approaches explored three fusion paradigms: early fusion (raw data sharing), late fusion (output-level aggregation), and intermediate fusion (feature-level sharing) 26 . Intermediate fusion has emerged as the dominant paradigm, achieving near-early-fusion accuracy at significantly lower bandwidth 18 ; 25 ; 8 . V2VNet 18 introduced a graph neural network for spatially-aware feature aggregation. V2X-ViT 25 applies vision transformers to handle heterogeneous agents and temporal asynchrony. CoBEVT 24 uses sparse transformers for cooperative BEV segmentation. DiscoNet 8 employs knowledge distillation from a holistic-view teacher to learn collaboration graphs. Where2comm 6 achieves over 10^{5}\times bandwidth reduction through spatial confidence maps. Several works specifically address communication selection: Who2com 11 learns a three-stage handshake to select communication partners; When2com 10 groups agents for efficient communication; and IC3Net 14 introduces a learned gating mechanism. More recently, V2X-PC 9 proposes point clusters as an alternative to dense feature maps for more efficient communication, V2X-INCOP 12 addresses the practical challenge of communication interruption

Read the complete text