Towards Autonomous Micromobility through Scalable Urban Simulation
Wayne Wu, Honglin He, Chaoyuan Zhang, Jack He, Seth Z. Zhao, Ran Gong, Quanyi Li, Bolei Zhou · 2025
Read Towards Autonomous Micromobility through Scalable Urban Simulation by Wayne Wu, Honglin He, Chaoyuan Zhang, Jack He, Seth Z. Zhao, Ran Gong, Quanyi Li, Bolei Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00690.txt.
Introduction
Wayne Wu and co-authors build a vast town sim to teach small street bots to drive them selves, in a study from 2025. Small bots, pack carts and scoots, promise a light path past cars. Hand drive, in flesh or by wire, caps their scale and safety in crowds.
Their sim, URBAN-SIM, grows towns layer by layer, seeds live acts, and draws scenes out of step to speed the learn. Mate to it, URBAN-BENCH grades bots on eight tasks in three skill clans. The aim is reps: a bot can fail a thousand crosswalks in sim ere it meets a true one. Scale plus grades, the team argues, is how small bots earn the street.
Catalog record
| CREATOR | Wayne Wu, Honglin He, Chaoyuan Zhang, Jack He, Seth Z. Zhao, Ran Gong, Quanyi Li, Bolei Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 91 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-00690
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Autonomous Micromobility through Scalable Urban Simulation Wayne Wu, Honglin He, Chaoyuan Zhang, Jack He, Seth Z. Zhao, Ran Gong, Quanyi Li, Bolei Zhou Abstract In the appendix, we present more details of this work. In Section A , we illustrate samples of scenes for Urban Locomotion, Navigation, and Traverse tasks. In Section B , we introduce the design details of URBAN-SIM platform. In Section C , we construct extensive performance benchmarks of URBAN-SIM . In Section D , we give details and discuss the properties of the human-AI shared autonomous approach. In Section E , we elaborate on implementation details in the experiments of URBAN-BENCH and evaluate the necessity of foundational tasks. In Section F , we provide the datasheet of URBAN-SIM . In Section G , we discuss the impacts, sim-to-real generalization, limitations, and future directions of this work. Figure 1 : Autonomous micromobility. In public urban spaces, various mobile machines (circular images) are essential for short-distance travel. However, urban environments are complex and contain varied terrain and challenging situations (rectangular images). To bridge this gap, we present a scalable urban simulation solution to advance autonomous micromobility. Images are from our Urban-Tra-City data. * * footnotetext: Co-first authors. 1 Introduction Micromobility becomes a promising urban transport way for short-distance travel [ 55 , 6 ] . It includes a range of lightweight machines that have a mass of no more than 350 kg and operate at speeds not exceeding 45 kph [ 47 ] in public spaces. These machines encompass mobile robots with different forms, such as wheeled, quadruped, wheeled-legged, and humanoid robots, and assistive mobility devices for elderly and disabled people, such as electric wheelchairs and mobility scooters. They can accommodate various users’ needs in individual travel and parcel delivery. The appeal of micromobility lies in its provision of a flexible, sustainable, cost-effective, and on-demand transport alternative, which enhances urban accessibility [ 65 , 50 ] and reduces reliance on vehicles for short-distance trips [ 15 , 72 ] . Current road designs predominantly cater to full-sized vehicles [ 25 ] . Micromobility machines thus have to move through intricate urban public spaces, such as sidewalks, alleys, and plazas, which contain unpredictable terrains, various obstacles, and dense pedestrian traffic. Traditional micromobility machines rely on either onboard control (like wheelchairs) or teleoperation by humans (like food delivery bots [ 4 ] ) to navigate complex urban spaces. However, humans and their driven mobile machines face critical safety concerns from human fatigue and limited situational awareness. As reported by FARS [ 76 ] , over 6,000 vulnerable road users died on U.S. streets in 2018, a 14% increase over 2015 and a 27% increase over 2014. Humans are prone to distractions that can lead to collisions with road hazards. On the other hand, human-driven machines have low operation efficiency , as they require high labor costs and have limited agility. For instance, in teleoperated systems for parcel delivery [ 4 , 5 ] , robots require continuous human monitoring, which limits the number of robots that can be operated simultaneously. Also, given the complexity of the urban environment, human teleoperators may find it challenging to move swiftly through a hustling street. Autonomous micromobility harnesses embodied AI agents for decision-making and maneuvering, providing a viable way to improve safety and efficiency. Existing AI solutions are mainly targeted at specific abilities of robots, such as obstacle avoidance [ 70 ] and parkour [ 13 ] . However, micromobility tasks require agents to have versatile capabilities facing various complex and challenging terrains and situations (bottom row in Figure 1 ), i.e . , traversing varied terrains (stairs, slopes, and rough surfaces), moving on traversable paths in open spaces, and avoiding both static and dynamic obstacles. Current AI solutions, focused on isolated tasks, are thus incapable of conducting complex micromobility tasks. Apart from that, existing robot learning and simulation platforms are insufficient for agent training on micromobility. They either have simple training scenes with no contextual environments [ 44 , 51 ] or have low training performances without environment parallelization on GPUs [ 21 , 38 , 83 ] . For example, IsaacGym [ 44 ] has superior performance but simple environments, while CARLA [ 21 ] provides rich town scenes but has low end-to-end training efficiency. However, for micromobility tasks, on the one hand, robots should learn situational awareness by interacting with large-scale scene contexts, such as urban facilities and pedestrians; on the other hand, robots need a high-performance training platform to sample diverse scenes to obtain strong generalizability. Yet, “large-scale training” with abundant diverse scenes and “high-performance training” are contradictory in the existing robot learning platforms. Current platforms can not balance these two demands and thus lack sufficient support for autonomous micromobility tasks. In this work, we present a scalable urban simulation solution to advance autonomous micromobility. This solution consists of two critical components: a robot learning platform URBAN-SIM , and a suite of tasks and benchmarks URBAN-BENCH . It forges a path to autonomous micromobility by enabling large-scale training and evaluation of varied embodied AI agents in complex urban environments. First, we propose URBAN-SIM – a high-performance robot learning platform for autonomous micromobility. It can automatically construct infinite diverse and realistic interactive urban scenes for large-scale robot learning while providing more than 1,800 fps high training performance with large-scale parallelization in a single Nvidia L40S GPU. URBAN-SIM has three key designs: 1) The Hierarchical Urban Generation pipeline, which can construct an infinite number of static urban scenes, from street block to ground division to building and infrastructure placements to terrain generation. This pipeline remarkably enhances the diversity of training environments. 2) The Interactive Dynamics Generation strategy, which can provide rich dynamics of pedestrians and cyclists that are responsive to robots in real-time during training. This strategy highly improves the realism of dynamic agents while maintaining the performance in our large-scale, distributed robot learning workflows. 3) The Asynchronous Scene Sampling scheme, which can train robots on thousands of various urban scenes on GPUs in parallel. This scheme significantly enhances the training performance , especially for large-scale scenes, achieving more than 26.3 \% relative improvement compared to synchronous approaches with the same training steps. URBAN-SIM is built on top of Nvidia’s Omniverse [ 53 ] and PhysX 5 [ 54 ] to provide realistic scene rendering and physics simulation. Though the goal of autonomous micromobility is to move from point A to B in an urban environment, it requires the multifaceted capabilities of the agent. Thus, we construct URBAN-BENCH – a suite of essential tasks and benchmarks to train and evaluate different capabilities of an agent. We first construct a set of tasks for the agent to acquire two orthogonal skills in micromobility: Urban Locomotion and Urban Navigation . For urban locomotion, an agent must learn various movement skills to tackle different ground conditions, i.e . , flat surfaces, slopes, stairs, and rough terrain. We define four tasks for urban locomotion based on these ground conditions. For urban navigation, an agent needs to develop different operational skills to manage various scenarios, i.e . , unobstructed ground, static obstacles, and dynamic obstacles. We define three tasks for urban navigation based on these scene