Dynamic Pricing in High-Speed Railways Using Multi-Agent Reinforcement Learning
Enrique Adrian Villarrubia-Martin, Luis Rodriguez-Benitez, David Muñoz-Valero, Giovanni Montana, Luis Jimenez-Linares · 2025
Read Dynamic Pricing in High-Speed Railways Using Multi-Agent Reinforcement Learning by Enrique Adrian Villarrubia-Martin, Luis Rodriguez-Benitez, David Muñoz-Valero, Giovanni Montana, Luis Jimenez-Linares (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-08234.txt.
Introduction
Enrique Adrian Villarrubia-Martin and co-authors study how rival high-speed rail operators should set ticket prices that change over time. Their 2025 paper notes that dynamic pricing is well studied in airlines and energy, but barely touched for railways. Operators both compete for passengers and cooperate, since connecting services must line up for trips to work.
The team builds a multi-agent learning framework, plus a flexible simulator called RailPricing-RL that models networks, demand, and passenger choices in detail. Tests show how passenger preferences shape the agents' pricing, and how prices feed back into choices and welfare. The work lays groundwork for smarter rail pricing. The simulator is designed to be reconfigured for other networks.
Catalog record
| CREATOR | Enrique Adrian Villarrubia-Martin, Luis Rodriguez-Benitez, David Muñoz-Valero, Giovanni Montana, Luis Jimenez-Linares |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-08234
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Dynamic Pricing in High-Speed Railways Using Multi-Agent Reinforcement Learning Enrique Adrian Villarrubia-Martin, Luis Rodriguez-Benitez, David Muñoz-Valero, Giovanni Montana, Luis Jimenez-Linares Abstract This paper addresses a critical challenge in the high-speed passenger railway industry: designing effective dynamic pricing strategies in the context of competing and cooperating operators. To address this, a multi-agent reinforcement learning (MARL) framework based on a non-zero-sum Markov game is proposed, incorporating random utility models to capture passenger decision making. Unlike prior studies in areas such as energy, airlines, and mobile networks, dynamic pricing for railway systems using deep reinforcement learning has received limited attention. A key contribution of this paper is a parametrisable and versatile reinforcement learning simulator designed to model a variety of railway network configurations and demand patterns while enabling realistic, microscopic modelling of user behaviour, called RailPricing-RL. This environment supports the proposed MARL framework, which models heterogeneous agents competing to maximise individual profits while fostering cooperative behaviour to synchronise connecting services. Experimental results validate the framework, demonstrating how user preferences affect MARL performance and how pricing policies influence passenger choices, utility, and overall system dynamics. This study provides a foundation for advancing dynamic pricing strategies in railway systems, aligning profitability with system-wide efficiency, and supporting future research on optimising pricing policies. Journal: Engineering Applications of Artificial Intelligence 1 Introduction Dynamic pricing is a pivotal strategy for revenue optimisation and demand management across industries. By adjusting prices in real time, based on supply and demand, companies can enhance profitability and better align services with consumer needs. However, there are important challenges involved in implementing effective dynamic pricing strategies, particularly in environments with complex interactions among multiple stakeholders. These challenges include modelling market dynamics, predicting consumer behaviour, and optimising pricing decisions, under constraints such as competition, cooperation, and limited resources. Machine learning (ML) has shown great promise in addressing these challenges, offering data-driven approaches to learning and adapting pricing strategies over time. Reinforcement learning (RL), in particular, has emerged as a powerful tool for developing dynamic pricing strategies. RL enables agents to learn optimal policies through interactions with the environment, which means it is well suited to applications requiring real-time decision making. RL-based dynamic pricing has been successfully applied in sectors such as electricity markets [ 1 , 2 , 3 ] , airlines [ 4 ] , and mobile networks [ 5 ] . These studies primarily focus on single-agent and multi-agent RL settings, where agents aim to maximise profits through individual or collaborative actions. Despite this progress, dynamic pricing for high-speed rail systems remains under-researched, even though the industry poses unique challenges and opportunities compared to other domains. High-speed railways are characterised by an intricate interplay of competition and cooperation between operators. Figure 1 illustrates a simplified railway network, where stations are nodes and connections are edges representing services provided by different companies. Operators may cooperate to offer connecting journeys (e.g., A-C via A-B and B-C) or compete directly on shared routes (e.g., A-D). These interactions require sophisticated pricing strategies, as decisions in one market can ripple through others. Moreover, as networks grow larger and more interconnected, operators must balance profitability with seamless service integration, further complicating the optimisation of pricing strategies. Figure 1: Illustration of a railway network model, where stations are represented as nodes and connections as edges. Edges are colour-coded to indicate the companies operating services between stations. The A-B and B-C markets are operated by separate companies, but through cooperation, they can offer connecting services in the A-C market, which otherwise would have a direct service from only one company. Additionally, the blue and red companies compete directly in the A-D market. Best viewed in colour. In order to apply RL effectively in this context, it is crucial to model passenger decision making accurately, as this directly affects the environment in which agents learn. Discrete Choice Modelling (DCM) is a widely used tool to model and predict travel choices. These models, grounded in the principles of classic Random Utility Models (RUMs), provide a framework for understanding how travellers make decisions from among a finite set of alternatives. DCM assigns utility values to travel options, assuming individuals choose the option with the highest utility. While DCM has been effectively applied to urban railway systems [ 6 ] , these applications typically focus on short-distance, high-frequency travel. In contrast, intercity railways require models capable of handling a range of passenger behaviours, multi-operator networks, and longer travel distances. Despite their utility, existing simulators such as ROBIN [ 7 ] are limited in their ability to model dynamic pricing and connecting services, and they lack compatibility with RL frameworks like OpenAI Gymnasium [ 8 ] . These limitations lead to gaps in the ability to develop and evaluate advanced RL-based dynamic pricing strategies for high-speed railways. To address these gaps, this paper introduces a multi-agent reinforcement learning (MARL) framework for dynamic pricing in high-speed railway networks. Central to this framework is a novel RL simulator called RailPricing-RL that extends ROBIN by enabling dynamic pricing, modelling multi-operator journeys, and supporting MARL algorithms. The simulator creates a mixed cooperative-competitive environment where heterogeneous agents dynamically adjust ticket prices in response to demand fluctuations. This framework allows for the study of pricing strategies to balance competition and cooperation, capturing the unique dynamics of the high-speed railway domain. Through extensive experiments, the proposed framework is evaluated by testing advanced MARL algorithms, such as Multi-Actor Attention Critic (MAAC) [ 9 ] and Multi-Agent Deep Deterministic Policy Gradient (MADDPG) [ 10 ] , in the context of dynamic pricing for high-speed rail networks. These experiments explore how agents adapt to mixed cooperative-competitive dynamics and study the effects of user preferences on agent performance, equity, and system-wide outcomes under varying demand scenarios. The results highlight the algorithms’ ability to balance trade-offs between cooperation and competition, optimise pricing strategies, and align individual profitability with broader system efficiency. Furthermore, the findings of the study reveal the challenges posed by heterogeneous agent interactions and the significant role of user preferences in shaping overall system behaviour, offering key insights for the design of robust MARL-based solutions for real-world applications. The remainder of this paper is organised as follows: Section 2 reviews related work, including dynamic pricing, Deep Reinforcement Learning (DRL) applications in railways, social dilemmas in MARL, and related RL environments. Section 3 formalises the mixed multi-agent task as a stochastic game. Section 4 details the proposed methodology, and Section 5 presents experimental results. Finally, Section 6 concludes the paper and discusses future lines of research. 2 Related work To contextualise the contributions, this section reviews prior research in four key areas. First, dynamic pricing strategies (Section 2.1 ) are explored, as they provide the foundation for optimising prices in high-speed railway systems. Second, the use of DRL in railway systems (Section 2.2 ) is examined, highlighting its role in addressing operational challenges. Third, social dilemmas in multi-agent systems (Section 2.3 ) are discussed, as they capture the interplay between cooperative and competitive behaviours, central to the proposed framework. Finally, a review of related RL environments (Section 2.4 ) positions the contributions within the broader context of MARL research and simulation platforms. 2.1 Dynamic pricing Dynamic pricing involves adjusting prices in real-time based on supply and