SKETCH: Semantic Key-Point Conditioning for Long-Horizon Vessel Trajectory Prediction
Linyong Gan, Zimo Li, Wenxin Xu, Xingjian Li, Jianhua Z. Huang, Enmei Tu, Shuhang Chen · 2026
Read SKETCH: Semantic Key-Point Conditioning for Long-Horizon Vessel Trajectory Prediction by Linyong Gan, Zimo Li, Wenxin Xu, Xingjian Li, Jianhua Z. Huang, Enmei Tu, Shuhang Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18537.txt.
Introduction
Linyong Gan and six colleagues aim to guess where a ship will be hours from now, not just in the next few ticks. Ship paths bend with wind, tide, and the aims of the crew. Small slips at the start grow fast as the guess runs on. Past tools tend to drift off the true path or draw paths no ship would take.
Their tool, named SKETCH, pins the guess to key points on the route. Those points act like sketch marks that hold the broad line of the trip. The fine path is then drawn to fit the marks. A held line should keep long guesses sane and close to how ships move. Port crews could use such guesses to plan berths and to spot ships that stray toward risk.
Catalog record
| CREATOR | Linyong Gan, Zimo Li, Wenxin Xu, Xingjian Li, Jianhua Z. Huang, Enmei Tu, Shuhang Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18537
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SKETCH: Semantic Key-Point Conditioning for Long-Horizon Vessel Trajectory Prediction Linyong Gan, Zimo Li, Wenxin Xu, Xingjian Li, Jianhua Z. Huang, Enmei Tu, Shuhang Chen Abstract Accurate long-horizon vessel trajectory prediction remains challenging due to compounded uncertainty from complex navigation behaviors and environmental factors. Existing methods often struggle to maintain global directional consistency, leading to drifting or implausible trajectories when extrapolated over long time horizons. To address this issue, we propose a semantic-key-point-conditioned trajectory modeling framework, in which future trajectories are predicted by conditioning on a high-level Next Key Point (NKP) that captures navigational intent. This formulation decomposes long-horizon prediction into global semantic decision-making and local motion modeling, effectively restricting the support of future trajectories to semantically feasible subsets. To efficiently estimate the NKP prior from historical observations, we adopt a pretrain-finetune strategy. Extensive experiments on real-world AIS data demonstrate that the proposed method consistently outperforms state-of-the-art approaches, particularly for long travel durations, directional accuracy, and fine-grained trajectory prediction. 1 Introduction Maritime transportation is the basis of global trade, carrying over 80% of goods worldwide by volume ( 9 ) . Accurate vessel trajectory prediction is therefore a fundamental capability for maritime intelligence, supporting collision avoidance ( 16 ; 34 ) , port operation optimization ( 17 ) , search and rescue ( 11 ) , and fuel-efficient voyage planning ( 35 ) . Meanwhile, the widespread use of the Automatic Identification System (AIS) has enabled data-driven approaches by providing large-scale, high-frequency vessel motion records ( 6 ; 14 ; 29 ; 32 ) . However, the availability of large-scale data alone does not eliminate the intrinsic difficulty of long-horizon trajectory forecasting, where uncertainty compounds over time. Building upon such data, existing approaches can be broadly categorized into non-learning and learning-based methods. Early non-learning approaches embed explicit mathematical models or statistical priors, including the Constant Velocity Model (CVM) ( 30 ) , the Nearly Constant Velocity (NCV) model ( 23 ) , Extended Kalman Filter (EKF) variants ( 18 ; 19 ) , stochastic processes such as the Ornstein–Uhlenbeck (OU) process ( 13 ) , Gaussian Process (GP) models ( 24 ) , and knowledge-based particle filtering methods ( 12 ) . These approaches are favored for their computational efficiency and simplicity ( 3 ; 30 ) , but rely on simplified abstractions of complex vessel dynamics that often neglect environmental influences ( 7 ) . As a result, their performance degrades significantly during maneuvers and under noisy conditions ( 3 ; 4 ) , making them inherently inadequate for medium- and long-horizon trajectory prediction ( 15 ) . To overcome the limitations of purely statistical modeling, learning-based approaches have been widely explored for sequential trajectory prediction. Recurrent Neural Networks (RNNs) and Long Short-Term Memory (LSTM) networks improve expressive capacity but often struggle to capture long-range dependencies and multimodal future behaviors ( 4 ; 3 ) . In particular, MP-LSTM predicts midpoints and last points, and interpolates intermediate trajectories, which limits their ability to model fine-grained kinematic variations and directional changes ( 4 ) . These limitations become increasingly pronounced as the prediction horizon grows. More recently, Transformer-based models have shown promise due to their ability to model long-range dependencies via self-attention ( 26 ) . Approaches such as TrAISformer enhance medium-term trajectory prediction and more effectively capture multimodal uncertainty ( 15 ) . Nevertheless, we observe that standard autoregressive Transformers still degrade severely in long-horizon settings. Notably, both TrAISformer ( 15 ) and recent token-based GPT-style forecasters, such as TrackGPT ( 25 ) , convert continuous trajectory attributes into discrete tokens and learn embeddings over these discrete representations as the input to a Transformer backbone. Due to the discretization of continuous geographic space, token-based trajectory models are trained only on a sparse subset of spatial tokens. When deployed in previously unseen regions, the model must extrapolate beyond the empirical support of the training distribution, often leading to unstable or incoherent predictions. As uncertainty accumulates, predictions tend to collapse toward nearly horizontal trajectories. This observation suggests that increasing model capacity alone is insufficient for robust long-term trajectory forecasting. One more limitations stem from the lack of explicit modeling of global navigational way intent. In real-world maritime navigation, vessels follow a hierarchical decision process: high-level route planning toward the Next Key Points, coupled with low-level continuous control of speed and heading ( 20 ) . Most existing trajectory prediction models, however, operate solely at the local kinematic level. As a result, long-term navigational intent must be implicitly inferred from short-term motion patterns, which becomes increasingly unreliable over extended horizons. Motivated by this observation, we reformulate long-horizon vessel trajectory prediction as a hierarchical forecasting problem with explicit modeling of global navigational intent. Our main contributions are summarized as follows: 1. We identify the lack of explicit modeling of global navigational intent as a fundamental limitation in existing long-horizon vessel trajectory prediction methods. 2. We introduce the Next Key Point (NKP) as a semantic intent variable and condition trajectory prediction on it, thereby restructuring long-horizon forecasting into a hierarchical problem that separates global navigational decisions from local motion modeling. 3. We develop an efficient training strategy to estimate the NKP-conditioned model, enabling generalization to open-set navigational targets without relying on a fixed, closed-set of predefined geometric waypoints commonly used in prior work. 4. Extensive experiments on large-scale AIS datasets demonstrate state-of-the-art performance, particularly for long-duration trajectory prediction. 2 Related Works 2.1 Decoder-only Transformer Trajectory Predictor Decoder-only Transformers, such as GPT-2 ( 21 ; 26 ) , consist of multiple blocks of masked multi-head self-attention and position-wise feed-forward layers, with residual connections, layer normalization, and dropout. They generate outputs autoregressively, predicting the next token conditioned on previous tokens: p(x_{1:T})=\prod_{t=1}^{T}p(x_{t}\mid x_{<t}). (1) Originally designed for natural language, decoder-only Transformers have also been successfully applied to sequential data in computer vision ( 22 ) , audio generation ( 27 ) , and time series forecasting ( 2 ) . In our work, vessel trajectories are treated as sequences of tokens (\text{latitude, longitude, SOG, COG}) , allowing autoregressive modeling of future positions in a vessel trajectory context. 2.2 Retrieval-Augmented Verification Retrieval-Augmented Detection ( 8 ) and Verification ( 28 ) extend traditional prediction by incorporating reference samples from an external database, effectively transforming prediction into a verification task. A query sample is compared with stored embeddings via similarity metrics, and labels are inferred from retrieved matches. This framework naturally supports open-set recognition and interpretable predictions. We adopt this framework for NKP prediction: trajectories that are semantically similar (i.e., leading to the same Next Key Point) are represented as hidden states, and label prediction is achieved by verifying similarity with stored trajectories: \{\hat{h}_{k}\}_{k=1}^{K}=\arg\max_{h\in H}\text{sim}_{\cos}(h_{k},h)=\arg\max_{h\in H}\frac{h_{k}\cdot h}{\|h_{k}\|\cdot\|h\|} (2) The top- K retrieved trajectories guide label assignment, providing robustness against noisy or missing destination information. 2.3 Contrastive Learning for Embedding Consistency Contrastive learning ( 5 ) is used to ensure that trajectories leading to the same NKP have similar embeddings while different ones are pushed apart. For hidden states h_{1},h_{2}\in\mathbb{R}^{B\times T\times H} , average pooling and L2 normalization yield sequence-level embeddings \hat{v}_{1},\hat{v}_{2} , and the cosine similarity D_{i}=\text{sim}_{\cos}(\hat{v}_{1},\hat{v}_{2}) is computed. The loss function is: Figure 1 : Overall Architecture. The inputs of AIS data go through Encoder 1 and MiniMind model