Training Trajectory Predictors Without Ground-Truth Data

Mikolaj Kliniewski *, Jesse Morris, Ian R. Manchester, and Viorela Ila · 2025

Read Training Trajectory Predictors Without Ground-Truth Data by Mikolaj Kliniewski *, Jesse Morris, Ian R. Manchester, and Viorela Ila (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08957.txt.

Introduction

Mikolaj Kliniewski and co-authors train path predictors sans ground truth in a 2025 paper. Cars and bots need calls on where peers will go. Stock training eats vast hand-true logs, a dear need. Their frame first builds a smooth read of post, head, and speed from raw sense data. That read then feeds a known predictor as its world view. Poor reads spawn noisy calls, their tests warn.

With clean reads, the predictor trains true on thin data. Calls held firm across place kinds. The team pitch the read-first path for real rigs where truth logs run scarce.

Catalog record

CREATORMikolaj Kliniewski *, Jesse Morris, Ian R. Manchester, and Viorela Ila
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-08957

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Training Trajectory Predictors Without Ground-Truth Data Mikolaj Kliniewski *, Jesse Morris, Ian R. Manchester, and Viorela Ila Abstract This paper presents a framework capable of accurately and smoothly estimating position, heading, and velocity. Using this high-quality input, we propose a system based on Trajectron++ [ 1 ] , able to consistently generate precise trajectory predictions. Unlike conventional models that require ground-truth data for training, our approach eliminates this dependency. Our analysis demonstrates that poor quality input leads to noisy and unreliable predictions, which can be detrimental to navigation modules. We evaluate both input data quality and model output to illustrate the impact of input noise. Furthermore, we show that our estimation system enables effective training of trajectory prediction models even with limited data, producing robust predictions across different environments. Accurate estimations are crucial for deploying trajectory prediction models in real-world scenarios, and our system ensures meaningful and reliable results across various application contexts. I Introduction Intelligent vehicles are becoming an integral part of everyday life, making safety a critical concern. One key module that enhances an autonomous vehicle’s ability to react in its environment is trajectory prediction: the task of anticipating future poses of dynamic objects. By incorporating anticipated movements of dynamic objects into path planning and control algorithms, autonomous systems can navigate more effectively in dynamic environments [ 2 ] . At its core, trajectory prediction models rely on historical positional data of observed objects to predict their future paths. This information forms the necessary part of the input. The quality of this input data is vital. Current state-of-the-art models are trained and evaluated using estimation data provided by publicly available autonomous driving datasets [ 3 , 4 , 5 ] . However, these datasets introduce significant limitations: estimation data is often derived using varying sensor modalities and post-processing methods [ 6 ] . This variability leads to inconsistencies across datasets, as similarly formatted data may have subtle but impactful differences in underlying attributes. Consequently, trajectory prediction models trained on one dataset often fail to generalize effectively to another, limiting their robustness in real-world applications. For real-world deployment, a consistent and accurate estimation module is essential. Dynamic SLAM frameworks [ 7 , 8 , 9 ] provide a promising solution by converting raw sensor inputs into precise pose and motion estimations, forming the foundation for trajectory forecasting. Unlike the dataset provided ground-truth data that undergoes extensive pre-processing within the dataset as well as often before each prediction model individual training, accurate dynamic SLAM outputs are generated directly from sensor measurements, reducing latency and avoiding the errors introduced during pre-processing. To address these challenges, we propose a system that integrates a dynamic SLAM module to estimate objects’ poses and motions directly from raw sensor data. These estimations are used as input for training, testing, and evaluating trajectory prediction models, eliminating the need for ground truth data during the training process. By relying on data generated by our system, we ensure consistent input quality across different environments, mitigating the variability seen in existing datasets. Moreover, this direct pipeline enhances real-time decision-making by reducing computational overhead caused by additional pre-processing stages. This paper introduces a novel framework for direct trajectory prediction of multiple objects utilizing accurate multi-motion estimation from a dynamic SLAM system. To assess the reliability of our approach, we systematically compare the estimation data generated by our system with that from publicly available datasets, evaluating both consistency and accuracy. Additionally, we analyze the impact of our estimation data on prediction performance by comparing trajectory prediction models trained and tested with our data against those using dataset-provided data. Furthermore, we propose a new evaluation metric designed to measure prediction consistency across consecutive time steps, enhancing the robustness of trajectory prediction analysis. Finally, we argue that trajectory prediction and motion estimation are interdependent modules that should not be studied in isolation. Improvements in one can enhance the other, highlighting the potential benefits of integrating these systems. Our approach serves as a step forward in building robust, real-time, and generalizable trajectory prediction systems for autonomous vehicles. II Related Work Dynamic SLAM methods extend traditional SLAM by integrating measurements of dynamic objects, enabling simultaneous estimation of sensor pose, the static background, and object states within the environment. The state estimation problem for objects can vary depending on the modeling approach. Some methods choose to model the object state using simple geometric primitives such as cuboids [ 9 ] , ellipsoids [ 10 ] or quadrics [ 11 ] . While these approaches successfully estimate object poses, they do not account for motion or velocity. In contrast, other methods focus explicitly on estimating object motion [ 7 , 12 , 8 , 13 ] , which is commonly represented as a 3D rigid-body transformation. This approach also allows highly accurate object pose to be recovered. Of these of these methods [ 7 ] reports the best accuracy in terms of object pose and motion estimation. Trajectory prediction methods can be broadly categorized into physics-based, learning-based, and hybrid approaches [ 14 , 15 , 16 ] . Classical physics-based models, such as constant velocity and constant acceleration for kinematic models, and the bicycle model for dynamic models, provide interpretable and computationally efficient solutions. These methods rely on motion equations to extrapolate future states, making them effective for short-term predictions. However, they often neglect complex agent interactions and environmental data, limiting their applicability in urban traffic scenarios. To address these limitations, modern trajectory prediction methods have increasingly adopted data-driven approaches. While classic machine learning and reinforcement learning methods remain competitive, they are often outperformed by deep learning approaches [ 17 ] . Combining data-driven methods with physics-based models has emerged as a promising direction, improving prediction accuracy by leveraging spatiotemporal data while maintaining physical realism through constraints and dynamic models. Recent state-of-the-art models reflect this trend. Pedestrian trajectory prediction models often focus on socially-aware predictions [ 18 , 19 ] , while models for urban environments with both pedestrians and vehicles utilize diverse input sources, such as High-Definition (HD) maps [ 1 , 20 , 21 , 22 ] . The challenge of domain shift across datasets and generalization across varying road conditions, regions, and driving styles persists. Ivanovic et al . [ 23 ] address this by introducing an adaptive layer for efficient domain transfer through offline fine-tuning and online adaptation. Feng et al . [ 22 ] tackle the issue by enhancing dataset size and diversity, leveraging ScenarioNet [ 24 ] to unify data formats, perform single-step preprocessing, and harmonize discrepancies such as varying recording frequencies, object observation durations, and map annotation precision. Notably, all these state-of-the-art models rely on ground truth data for training. In this work, we bridge the gap between pose estimation, motion estimation, and trajectory prediction by integrating the entire process from raw sensor data to trajectory forecasting. Unlike existing methods that rely on preprocessed pose data, our unified system ensures consistency across environments without external dependencies. To our knowledge, this is the first approach directly linking sensor inputs, estimation, and prediction, making it well-suited for real-world deployment in diverse settings. III Methodology Fig. 1 : System diagram. Our pipeline processes RGB-D sensor data through the DynoSAM estimation module, which computes

Read the complete text