Multi-Platform Teach-and-Repeat Navigation by Visual Place Recognition Based on Deep-Learned Local Features*
Václav Truhlařík, Tomáš Pivoňka, Michal Kasarda, Libor Přeučil · 2025
Read Multi-Platform Teach-and-Repeat Navigation by Visual Place Recognition Based on Deep-Learned Local Features* by Václav Truhlařík, Tomáš Pivoňka, Michal Kasarda, Libor Přeučil (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-13090.txt.
Introduction
Václav Truhlařík, Tomáš Pivoňka, Michal Kasarda, and Libor Přeučil present a teach-and-repeat navigation system that lets different robots retrace a taught route by sight, in this 2025 arXiv paper. The robot learns a route once, then follows it again by recognizing places in camera images, without building a full map. Changing light and seasons make that recognition hard.
Their system rests on a new place-recognition method built from deep-learned image features, plus a new way to compute sideways drift from the matched images. The design runs across several robot types. The team also released a public dataset for testing such systems. In real-world trials, indoors and out, day and night, their system beat leading rivals in several settings.
Catalog record
| CREATOR | Václav Truhlařík, Tomáš Pivoňka, Michal Kasarda, Libor Přeučil |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-13090
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-Platform Teach-and-Repeat Navigation by Visual Place Recognition Based on Deep-Learned Local Features* Václav Truhlařík, Tomáš Pivoňka, Michal Kasarda, Libor Přeučil Abstract Uniform and variable environments still remain a challenge for stable visual localization and mapping in mobile robot navigation. One of the possible approaches suitable for such environments is appearance-based teach-and-repeat navigation, relying on simplified localization and reactive robot motion control - all without a need for standard mapping. This work brings an innovative solution to such a system based on visual place recognition techniques. Here, the major contributions stand in the employment of a new visual place recognition technique, a novel horizontal shift computation approach, and a multi-platform system design for applications across various types of mobile robots. Secondly, a new public dataset for experimental testing of appearance-based navigation methods is introduced. Moreover, the work also provides real-world experimental testing and performance comparison of the introduced navigation system against other state-of-the-art methods. The results confirm that the new system outperforms existing methods in several testing scenarios, is capable of operation indoors and outdoors, and exhibits robustness to day and night scene variations. I Introduction Teach-and-repeat (T&R) systems serve for the autonomous navigation of a mobile robot along a previously taught trajectory. During the teaching phase, the robot is manually (or by another system) guided along the desired trajectory while processing sensor data and recording the results. In the subsequent navigation phase, the T&R system is able to follow the taught trajectory autonomously using the previously recorded information. There are two core approaches to visual T&R navigation: • Position-based systems estimate the real robot position within the environment, and control commands are computed based on the difference between stored and measured positions. Therefore, these systems usually create a map of the environment used for precise robot localization. • An alternative appearance-based approach takes advantage of fixing the trajectory, so only 1D localization along a path or position tracking are sufficient for navigation. Instead of mapping, these systems store information from individual images during the teaching traversal. The control strategy is reactive, with heading corrections computed directly from shifts detected between stored and current images. In many cases, the navigation is primarily based on wheel odometry, with a vision part only correcting the accumulated error. This article focuses on the latter type of T&R systems and introduces an innovative version of the monocular appearance-based system using visual place recognition (VPR) techniques [ 1 ] . The new system keeps the original structure; however, it replaces both essential components of the method (VPR and computation of displacement between images) by novel approaches. The system adopts a new VPR system [ 2 ] based on standard deep-learned local visual features that are further used for shift computation. Similarly to the original T&R system, the new one inherits high robustness to various changes in the environment from the VPR method, which is a key characteristic for long-term autonomy. The system was tested indoors and outdoors and directly compared to other state-of-the-art appearance-based methods. Besides, an inseparable part of this work is design and gathering of a new public dataset made specifically for testing appearance-based techniques. The key contributions of the new system are: • Localization along the previously taught trajectory using the new visual place recognition method SSM-hist [ 2 ] • Horizontal shift computation based on D2-Net local visual features [ 3 ] and histogram of shifts approach used in the VPR system • Targeted system design for multi-platform applications with various types of vehicles, including unmanned aerial vehicles (UAVs) that mainly do not provide precise odometry information Despite the constraints of the T&R scenario, these systems have several potential applications. They are suitable for various industrial tasks requiring the transportation of products or materials between several pre-defined positions. Another typical task is periodic patrolling. In addition, these systems can be used in multi-robot systems, where the robots can follow the same path, sharing the common taught trajectory. The rest of the article is structured as follows. Sect. II introduces the related T&R systems. The new T&R system and its individual components are described in Sect. III . Sect. IV presents a new dataset for testing appearance-based methods. The results of an experimental evaluation on the dataset and real robot are presented in Sect. V . Finally, the achieved results are summarized in Sect. VI . Fig. 1: Husky A200 mobile robot and DJI Ryze Tello drone used for experimentation II Related Work II-A SSM-Nav The T&R system [ 1 ] , referred to as SSM-Nav, was the first appearance-based solution using advanced VPR based on deep-learning methods for localization along the taught trajectory. Namely, the Semantic and Spatial Matching VPR (SSM-VPR) [ 4 ] is used. This T&R system was also one of the first systems using deep-learned local visual features. Local visual features are directly extracted at fixed grid positions as subtensors of the inner layers of the convolutional neural network (CNN). Their size is further reduced by applying a pre-trained principal component analysis model. As the two-stage VPR is used, the features for both stages are extracted from different layers, providing features with different amounts of semantic and spatial information. Local features for the second re-ranking stage also serve to compute the shift for the reactive control. Visual localization based on VPR was complemented by a particle filter, merging it with a driven distance measured by wheel odometry. Besides, several techniques were introduced to improve the navigation performance: • Varying distance between reference images for straight and curved trajectory segments (sampling density modulation by trajectory curvature) during teaching • Adjusting forward speed for straight and curved segments during navigation • Skipping the first stage of VPR, if the robot is localized with high certainty • Recovery mode after localization certainty drop This T&R system was deployed on a four-wheel mobile robot with a forward-looking camera and tested both indoors and outdoors. It benefited from the robustness of the VPR and excelled under challenging lighting conditions. Besides, its precision was sufficient for precise indoor navigation, including passing doors. SSM-VPR was also directly used for localization in an experimental T&R system for a small UAV presented in [ 5 ] . II-B Other Appearance-Based Systems The first appearance-based systems were introduced in the 1990s [ 6 ] , followed by methods based on local visual features in the next decade [ 7 ] , [ 8 ] . These two systems were designed only for polygonal trajectories. A more advanced solution based on local features and working with general trajectories is the BearNav system [ 9 ] . A novel CNN approach to compute the horizontal shift between images was introduced in [ 10 ] . Both images are processed by the same CNN (Siamese network), returning 3D tensors. One of the tensors is extended by padding in the direction corresponding to the horizontal shift, followed by the convolution of these tensors. The output is a vector with the likelihoods of possible displacements, and the displacement with the highest likelihood is the final shift. This architecture was further used in [ 11 ] to support local feature matching in the BearNav system, and applied in the system with multi-dimensional particle filter [