Saliency-Guided Domain Adaptation for Left-Hand Driving in Autonomous Steering
Zahra Mehraban, Sebastien Glaser, Michael Milford, Ronald Schroeter · 2025
Read Saliency-Guided Domain Adaptation for Left-Hand Driving in Autonomous Steering by Zahra Mehraban, Sebastien Glaser, Michael Milford, Ronald Schroeter (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01223.txt.
Introduction
Zahra Mehraban and colleagues ask how a self driving steering model trained in one country adapts to driving on the other side of the road. They adapt PilotNet, an end to end driving model, from United States right hand traffic to Australian left hand highways using real road data.
Four training routes were compared. One was the raw United States baseline. Others used flipped United States data, fine tuning on Australian data, or pretraining on flipped data followed by Australian fine tuning. Flipped pretraining alone hurt stability, because the learned features were misaligned. Followed by fine tuning, though, it gave the lowest prediction error. It also gave the strongest attention to left side road cues. A saliency analysis tracked where the models look, and repeating the study on ResNet confirmed the same pattern.
Catalog record
| CREATOR | Zahra Mehraban, Sebastien Glaser, Michael Milford, Ronald Schroeter |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-01223
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Saliency-Guided Domain Adaptation for Left-Hand Driving in Autonomous Steering Zahra Mehraban, Sebastien Glaser, Michael Milford, Ronald Schroeter Abstract Domain adaptation is required for automated driving models to generalize well across diverse road conditions. This paper explores a training method for domain adaptation to adapt PilotNet, an end-to-end deep learning-based model, for left-hand driving conditions using real-world Australian highway data. Four training methods were evaluated: (1) a baseline model trained on U.S. right-hand driving data, (2) a model trained on flipped U.S. data, (3) a model pretrained on U.S. data and then fine-tuned on Australian highways, and (4) a model pretrained on flipped U.S. data and then fine-tuned on Australian highways. This setup examines whether incorporating flipped data enhances the model adaptation by providing an initial left-hand driving alignment. The paper compares model performance regarding steering prediction accuracy and attention, using saliency-based analysis to measure attention shifts across significant road regions. Results show that pretraining on flipped data alone worsens prediction stability due to misaligned feature representations, but significantly improves adaptation when followed by fine-tuning, leading to lower prediction error and stronger focus on left-side cues. To validate this approach across different architectures, the same experiments were done on ResNet, which confirmed similar adaptation trends. These findings emphasize the importance of preprocessing techniques, such as flipped-data pretraining, followed by fine-tuning to improve model adaptation with minimal retraining requirements. I INTRODUCTION Adapting a machine learning model trained on data from one context to perform well in a different dataset is a challenge in artificial intelligence, especially for expanding technologies such as Automated Vehicles (AVs) around the world [ 1 ] . This is important when the training environment is significantly different from the deployment environment, such as changes in traffic rules, road layouts, or weather conditions [ 2 ] . For instance, models trained on right-hand driving data (e.g., U.S. roads) may struggle when applied to left-hand driving regions (e.g., Australian roads) due to reversed lane positions, road structures, signage, and driving conventions. Such domain shifts can result in poor performance, requiring effective adaptation strategies that adapt existing models without requiring significant amounts of new data or extensive computing resources [ 3 ] . A compelling example of this broader issue is adapting AVs trained on U.S. data for Australian highways. While training a model from scratch on left-hand driving datasets is feasible, domain adaptation offers significant advantages by building on knowledge from larger right-hand driving datasets, reducing computational costs, and potentially improving generalization by retaining useful features learned from the source domain [ 4 ] . Fig. 1: Training Methodology: Pretraining on original/flipped U.S. data (top) and subsequent fine-tuning on Australian highway data (bottom) A widely used domain adaptation approach in deep learning is fine-tuning [ 5 ] , where a pretrained model is further trained on target domain data to improve model generalization under various conditions [ 6 ] . However, fine-tuning alone may not be sufficient for successful adaptation when the original training environment is substantially different from the target domain, such as from right-hand to left-hand driving. To address this, this paper explores a domain adaptation strategy: pretraining on flipped U.S. data, i.e., flipping images horizontally to mimic left-hand driving conditions, and then fine-tuning on Australian highway data. This method has a preliminary alignment with left-hand driving, which can improve steering prediction accuracy and shift the model’s attention toward left-side road features. We analyze whether this flipping-based strategy improves adaptation over direct fine-tuning on end-to-end deep neural networks (DNNs) like PilotNet [ 7 ] and ResNet [ 8 ] , which have revolutionized automated driving by enabling vehicles to predict steering angles directly from raw sensor inputs [ 9 ] . Analyzing the impact of flipping before fine-tuning requires more than conventional metrics such as loss values or steering errors. To address this, attention shifts are represented using saliency maps [ 10 ] , which illustrate how models generalize to left-hand driving. The proposed method is evaluated through steering prediction and attention analysis. The key contributions are: 1) Employing a local dataset collected on Australian highways to assess left-hand driving adaptation. 2) Investigating whether pretraining on flipped U.S. data provides an initial left-hand driving alignment improves fine-tuning efficiency and generalization, by comparing four training strategies (Fig. 1). 3) Using saliency maps to analyze attention shifts across key road regions (left, center, right), and to reveal how flipping before fine-tuning helps models focus on left-side road elements. The study explores the following research questions: • How does fine-tuning on Australian highways improve a right-hand trained automated driving model? • Does pretraining on flipped U.S. data improve adaptation compared to direct fine-tuning? • How do training strategies influence the attention distribution of the model in saliency maps? II RELATED WORKS II-A Domain Adaptation Automated driving models often struggle to generalize across different road environments because of changes in road structures, weather conditions, and traffic rules. This challenge, known as the domain gap, arises when a model trained on one dataset (source domain) performs poorly on another dataset (target domain) due to shifts in distribution [ 3 ] . Domain adaptation methods are regularly used to address this problem by transferring knowledge from the source domain to the target domain so that deep learning models can generalize better in unseen environments. Various approaches have been proposed, including feature alignment [ 11 ] , image style transfer [ 12 ] , adversarial training [ 13 ] , and self-training [ 14 ] . In the context of AVs, domain adaptation has been used to transfer knowledge between simulated and real-world driving environments [ 15 ] , between different geographic locations [ 2 ] , from daytime to night driving conditions [ 16 , 17 ] , and between several other contextual variations [ 18 , 19 ] . However, limited research has addressed domain adaptation for left-hand driving environments, where road structures and driving directions differ significantly. This work contributes to bridging this gap by introducing a simple flipped-data method before fine-tuning as an adaptation approach for left-hand driving conditions. Fine-tuning, a transfer learning technique, adapts a pretrained model to a new domain by updating its parameters with target data [ 20 ] . It is particularly useful when the target domain has limited labeled data, as it allows models to retain knowledge from the source domain while gradually adapting to new driving conditions. Prior studies have shown that fine-tuning improves steering prediction accuracy [ 21 ] , enhances robustness against environmental changes such as lighting variations and road textures [ 22 ] , adapts driving policies across regions [ 23 ] , and bridge the gap between simulation and real-world driving [ 15 ] . This paper builds on these findings by exploring a flipped-data method before fine-tuning, which allows the model to pre-align with left-hand driving conditions before exposure to real Australian road data. By evaluating the impact of flipped-data pretraining on model adaptation, this study provides insights into whether simple preprocessing techniques can enhance domain adaptation performance without requiring extensive retraining. II-B Saliency Maps for Explainability in AVs Saliency maps visually represent the decision-making process of a neural network by indicating which input features had the most impact [