Incentive-Aligned Vehicle-to-Vehicle Energy Trading via Nash-Integrated Multi-Agent Reinforcement Learning
Yujin Lin 1 , Yue Yang 1 , Hao Wang 1,2* · 2026
Read Incentive-Aligned Vehicle-to-Vehicle Energy Trading via Nash-Integrated Multi-Agent Reinforcement Learning by Yujin Lin 1 , Yue Yang 1 , Hao Wang 1,2* (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22363.txt.
Introduction
Lin, Yang and Wang integrate Nash bargaining into multi-agent reinforcement learning for vehicle-to-vehicle energy trading. Electric vehicles trade surplus energy peer to peer, but self-interested agents with varied charging needs are hard to coordinate. Nash bargaining sets efficient bilateral prices, while price-proximity rewards steer learning toward bargaining-optimal strategies. Over 30 days of continuous operation, social welfare rose 61.6 percent and trading volume 62.9 percent over a double auction. Fairness also improved, and tests with 6 to 100 agents confirm scalability.
Catalog record
| CREATOR | Yujin Lin 1 , Yue Yang 1 , Hao Wang 1,2* |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29956 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22363
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Incentive-Aligned Vehicle-to-Vehicle Energy Trading via Nash-Integrated Multi-Agent Reinforcement Learning *Corresponding author: Hao Wang ([email protected]). This work was supported in part by the Australian Research Council (ARC) Discovery Early Career Researcher Award (DECRA) under Grant DE230100046. Yujin Lin 1 , Yue Yang 1 , Hao Wang 1,2* Abstract Vehicle-to-vehicle (V2V) energy trading enables decentralized peer-to-peer energy exchange among electric vehicles (EVs), reducing grid dependency while monetizing surplus capacity. However, coordinating self-interested EV agents with diverse charging needs and uncertain arrival-departure schedules remains challenging. Existing approaches either require centralized optimization with computational limitations or lack fairness guarantees. This paper integrates Nash Bargaining Solution into Multi-Agent Deep Deterministic Policy Gradient, namely Nash-MADDPG, for incentive-aligned V2V energy trading. Nash bargaining determines efficient bilateral pricing, while Nash-guided price proximity rewards align agent learning toward bargaining-optimal strategies. Evaluation over 30-day continuous operation demonstrates an improvement of 61.6% in social welfare and 62.9% improvement in trading volume over Double Auction, while achieving superior fairness, such as 40.1% improvement in Jain’s index. Testing across 6-100 agents over a 30-day horizon with continuous vehicle turnover confirms scalability across population size and empirically stable pricing near the Nash Bargaining benchmark. I Introduction Electric vehicle (EV) adoption challenges power grids during peak charging, causing congestion and voltage instability. Traditional approaches such as centralized charging coordination [ 18 ] , time-of-use pricing, and vehicle-to-grid (V2G) services rely on centralized infrastructure and focus on EV-grid interactions, leaving direct EV-to-EV energy exchange underutilized. Vehicle-to-vehicle (V2V) energy trading offers a decentralized alternative where EVs with surplus capacity sell energy directly to EVs needing charge, reducing grid dependency [ 20 ] . However, realizing efficient V2V markets requires solving three intertwined challenges: (i) fair bilateral pricing between self-interested agents with private valuations, (ii) adaptation to dynamic participation as vehicles continuously arrive and depart, and (iii) efficient, individually rational outcomes that encourage voluntary participation. Existing V2V approaches partially address these challenges. In [ 10 ] , V2V interaction was formulated as a centralized fairness-aware optimization, jointly allocating energy and prices for equitable outcomes, but computational cost grows rapidly with agent count. In [ 9 ] , routing and scheduling of mobile EV chargers was optimized, though without addressing strategic bidding among stationary EVs. Blockchain-based frameworks address trust: [ 18 ] developed a blockchain-consensus V2V protocol with Stackelberg pricing where sellers set prices and buyers respond optimally; [ 11 ] proposed wireless V2V sharing with blockchain verification against double-spending. However, these game-theoretic pricing models assume complete information or static conditions that break down when vehicles arrive unpredictably with private valuations. A systematic review of V2V studies [ 20 ] identifies four open challenges (dynamic matching, real-time pricing, incentive alignment, scalability) and concludes that hybrid learning-mechanism approaches are needed. Nash Bargaining Solution (NBS) [ 14 ] provides axiomatic Pareto efficiency and individual rationality guarantees attractive for energy markets. NBS was first applied to energy trading in [ 17 ] , pricing bilateral microgrid exchanges at the bargaining point so both parties benefit relative to standalone operation. Subsequent work applied NBS to regional energy systems under wholesale price uncertainty [ 19 ] , multi-carrier peer-to-peer trading with stochastic programming under renewable uncertainty [ 1 ] , and asymmetric settings where agents receive bargaining power proportional to their contribution to shared energy storage [ 2 ] . However, these approaches are model-based, requiring complete knowledge of agent valuations. In dynamic V2V environments with private preferences and unpredictable departures, accurate valuation models are impractical, and the optimization must be re-solved from scratch as conditions change. Multi-agent reinforcement learning (MARL) addresses model-based limitations by enabling agents to learn adaptive strategies through interaction [ 16 , 15 ] . The centralized training with decentralized execution (CTDE) paradigm [ 12 ] is well-suited: critics access joint information during training to handle non-stationarity, while actors use only local observations during deployment. MARL has been applied to EV charging recommendation [ 21 ] , auction-based EV charging coordination [ 22 ] , EV virtual power plant operation [ 7 ] , and microgrid trading with Shapley-value credit assignment [ 6 ] , where it outperformed limitations of single-agent methods. For V2V specifically, MARL with CTDE was applied for decentralized energy exchange in [ 3 ] , demonstrating that multi-agent approaches can coordinate V2V markets. However, the framework lacked game-theoretic incentive structures: agents optimized individual utility without fairness guarantees, and the market clearing had no formal Pareto efficiency or individual rationality properties, resulting in potentially arbitrary and unpredictable equilibria that may discourage participation. The preceding review reveals a fundamental complementarity: NBS guarantees fairness but requires complete information unavailable in dynamic V2V settings, while MARL provides adaptive learning but converges to arbitrary equilibria without fairness assurance. We address this gap by using NBS simultaneously as market clearing rule and reward shaping signal. At the upper level, NBS-based bilateral pricing ensures Pareto-efficient clearing; at the lower level, NBS-derived price proximity rewards guide agents toward bargaining-optimal strategies during training. Unlike generic reward shaping, this mechanism inherits Pareto efficiency and individual rationality by construction, resolving the absence of fairness properties in prior V2V policies [ 3 , 6 ] . This paper proposes Nash-MADDPG for incentive-aligned V2V energy trading, formulated as bi-level optimization. We define incentive alignment as: (i) individual rationality , where no agent receives negative utility, (ii) Pareto efficiency , where no alternative allocation improves one agent without harming another. Both properties are guaranteed by NBS [ 14 , 17 ] . The price proximity reward in Section IV penalizes deviations from Nash Bargaining prices during training, structurally biasing agents toward submitting prices closer to their value-consistent prices at convergence. The main contributions are twofold: (i) We develop a V2V coordination framework for charging stations with continuous EV turnover, where the core engineering challenge is that vehicles arrive and depart unpredictably with private valuations, making static optimization infeasible. We address this by combining Nash Bargaining market clearing with adaptive MARL that remains effective under continuous agent turnover across varying EV population scales. (ii) We integrate NBS with MADDPG through dual mechanisms that address distinct failure modes that arise in V2V markets with self-interested EVs: bilateral pricing prevents arbitrary equilibrium when agents hold private valuations under continuous turnover, while price proximity rewards resolve the absence of fairness guarantees when agents learn independently with coordination, together empirically improving social welfare, fairness, and training stability over auction-based baselines. The remainder of this paper is organized as follows. Section II presents the V2V problem formulation. Section III details Nash-MADDPG. Section IV presents evaluation. Section V concludes this paper. II System Model and Problem Formulation II-A V2V Trading System and EV Model We consider a V2V energy trading system in a parking facility with dynamic EV population \mathcal{V}=\{1,\ldots,N(t)\} operating over discrete timesteps t\in\{0,1,\ldots,T_{\text{max}}\} with 30-minute intervals (i.e., \Delta t=0.5 ). The system is structured as bi-level optimization: at the lower level, EV agents learn bidding policies \{\pi_{1},\ldots,\pi_{N}\} mapping local observations to price-quantity offers; at the upper level, market mechanism \mathcal{M} clears trades to maximize Pareto efficiency under continuous agent turnover. Fig. 1 illustrates the architecture. Fig. 1: Nash-MADDPG system architecture showing a bi-level structure. Left: Multi-agent system with Nash Bargaining market clearing. Right: Centralized training and decentralized execution (CTDE) framework. Each EV i maintains battery