An effective control of large systems of active particles: An application to evacuation problem Journal: CNSNS
Albina Klepach, Egor E. Nuzhin, Alexey A. Tsukanov, Nikolay V. Brilliantov · 2025
Read An effective control of large systems of active particles: An application to evacuation problem Journal: CNSNS by Albina Klepach, Egor E. Nuzhin, Alexey A. Tsukanov, Nikolay V. Brilliantov (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-19972.txt.
Introduction
Evacuating a crowd with a single rescuer robot sounds hopeless, yet swarms follow leaders by instinct in many models. Albina Klepach and three co-authors build a control strategy for that leader. A generalized Vicsek model, where agents align with neighbors, describes the crowd's motion. Reinforcement learning trains the leader, helped by artificial forces that shape the system.
The method targets large groups leaving hazardous zones. Steering every person is impossible; steering one followed leader is feasible. Scalability and robustness are the selling points over per-agent control. The same mathematics touches robotic swarms and material transport. Crowd disasters still kill, and rehearsed robot guidance is one hedge worth testing in simulation first.
Catalog record
| CREATOR | Albina Klepach, Egor E. Nuzhin, Alexey A. Tsukanov, Nikolay V. Brilliantov |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-19972
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
An effective control of large systems of active particles: An application to evacuation problem Journal: CNSNS Albina Klepach, Egor E. Nuzhin, Alexey A. Tsukanov, Nikolay V. Brilliantov Abstract Manipulation of large systems of active particles is a serious challenge across diverse domains, including crowd management, control of robotic swarms, and coordinated material transport. The development of advanced control strategies for complex scenarios is hindered, however, by the lack of scalability and robustness of the existing methods, in particular, due to the need of an individual control for each agent. One possible solution involves controlling a system through a leader or a group of leaders, which other agents tend to follow. Using such an approach we develop an effective control strategy for a leader, combining reinforcement learning (RL) with artificial forces acting on the system. To describe the guidance of active particles by a leader we introduce the generalized Vicsek model. This novel method is then applied to the problem of the effective evacuation by a robot-rescuer (leader) of large groups of people from hazardous places. We demonstrate, that while a straightforward application of RL yields suboptimal results, even for advanced architectures, our approach provides a robust and efficient evacuation strategy. The source code supporting this study is publicly available at: https://github.com/cinemere/evacuation . 1 Introduction The manipulation of large systems of active particles, especially controlling their collective behavior, has become a fundamental problem in recent decades, initiated by emerging new areas of application. The examples, across diverse domains, include crowd management [ 1 , 2 ] , controlling of robotic swarms [ 3 ] , coordinated material transport [ 4 ] , etc. The concept of active matter [ 5 ] offers an appropriate framework for modeling such ensembles, comprised of agents that consume energy to move, interact with their environment, and adjust their direction of motion subject to external signals [ 6 , 7 , 8 , 9 ] . Synthetic microswimmers, swarming robots, colonies of bacteria, fish schools, flocks of birds, groups of humans [ 10 , 9 ] – all these systems of living and non-living agents represent an active matter. The primary goals of controlling active particle systems include navigating them in complex environments and supporting synchronized collective behavior [ 11 , 12 , 13 ] . This can be addressed by classical optimal control theory, which requires a complete knowledge of the environment and dynamics (similar to Zermelo’s navigation problem [ 14 ] ), or by reinforcement learning (RL), where an agent learns strategies through trial-and-error [ 15 , 16 ] . The latter is particularly applicable when an agent has only partial, local information or when the impact of noise is significant. A key limitation of such control problems is that their solution relies on the individual manipulation of each participating particle. For ensembles comprising hundreds of agents a straightforward application of RL, with individual-level control, becomes computationally intractable. To overcome this limitation, a common strategy involves guiding a group through a leader or multiple leaders, when active particles just follow the leader(s) [ 17 , 18 , 19 , 20 ] . This leader-follower paradigm significantly simplifies the control problem by focusing strategies solely on the leader(s). Nevertheless, complexities persist, particularly when managing multiple groups of different size and location, or when groups cannot be manipulated simultaneously or possess non-coinciding goals [ 21 , 22 ] . Among important examples of such challenging problems is an effective guidance of large groups of people, especially – their evacuation from hazardous places. Here a leader (rescuer) has the goal to evacuate all people guiding them to the exit(s) in shortest time. Given the inherent randomness and non-negligible noise within these systems, reinforcement learning (RL) seems to be the most suitable approach. However, a straightforward application of standard RL is neither computationally efficient nor effective in achieving the ultimate goal. To this end, we propose an application of auxiliary (artificial) “pseudo-gravitational” forces acting on the system, as a part of the environment; this helps the leader to find the most effective guidance strategy. Such a combination of RL with artificial forces [ 23 ] results in a very effective method to control large ensembles of active particles. To implement our new method for the evacuation problem, we utilize the generalized Vicsek model. This model takes into account not only interactions between active particles (as in the conventional Vicsek model [ 5 ] ), but also between particles and the leader. The rest of the paper is organized as follows. In the next Sec. II we formulate the problem of an effective evacuation from a hazardous place by an informed rescuer-leader. In Sec. III we describe the methods for training optimal evacuation policy and propose an approach based on “pseudo-gravitational” forces, viz the new method of RL with artificial fields. In Sec. IV we report the results of our numerical experiments. Finally, in Sec. V, we summarize our findings. 2 Effective evacuation problem 2.1 General statement of the evacuation problem The problem of effective evacuation, especially in the case of panicking crowd is extremely important. Poor building planning or lack of awareness of escape routes in hazardous events (natural disasters, terrorist attacks, etc.) can lead to fatalities for many reasons, including stampedes [ 24 , 25 , 26 , 27 ] . In planning a safe evacuation strategy, the following problems are to be addressed: What is the fastest way to evacuate people from the buildings that have already been built? How can we erect safe evacuation structures that allow quick escapes in emergency? Furthermore, it is important to have a representative quantity to assess an evacuation strategy. Generally, evacuation studies employ several main methods [ 28 ] : indoor experiments with real people [ 29 ] , numerical simulations (often incorporating machine learning for optimization) [ 24 , 30 , 31 , 32 ] , and hybrid approaches combining both [ 33 , 34 , 35 ] . The goal of such an analysis is to reveal some rules of crowd behavior, translate them into mathematical models, and reconstruct the crowd dynamics in numerical experiments. Machine learning can be used to optimize the realism or efficiency of evacuation. Among the first studies of evacuation was Helbing’s work [ 1 ] , where the social force model (SFM) has been pioneered. Based on visual patterns of people’s behavior, subject to a combination of physical interactions and the action of the social norm of keeping apart from unknown persons, the authors proposed an appropriate mathematical model. SFM was then successfully applied to describe panicking crowds [ 32 ] . This model is very general, and may be easily adopted, by respective modifications, to various special cases. SFM-like models are able to reproduce various self-organizing phenomena, such as lane formation, clogging at exits [ 36 , 37 , 38 ] customer dynamics [ 39 ] , etc. The main limitation of such models is the computational complexity, associated with the complete implementation of the SFM for a large system of agents. Therefore the lattice-automata approach, was widely used, with the set of discrete actions and states. Here the pedestrians are individual "particles", with an appropriate speed and size; their movement