SAMIRO: Spatial Attention Mutual Information Regularization with a Pre-trained Model as Oracle for Lane Detection Journal: Pattern Recognition Letters
Hyunjong Lee, Jangho Lee, Jaekoo Lee · 2025
Read SAMIRO: Spatial Attention Mutual Information Regularization with a Pre-trained Model as Oracle for Lane Detection Journal: Pattern Recognition Letters by Hyunjong Lee, Jangho Lee, Jaekoo Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-10385.txt.
Introduction
Hyunjong Lee, Jangho Lee, and Jaekoo Lee improve lane detection, the vision task that lets a vehicle find lane markings on the road. Real roads bring clutter, shifting light, and blocked views, and labeling enough training images is slow and costly. Their method, SAMIRO, borrows knowledge from a pretrained model while keeping general spatial information intact.
SAMIRO works as a plug-in that can be added to existing lane detection systems rather than replacing them. The team attached it to several leading detectors and tested on the CULane, TuSimple, and LLAMAS benchmarks. Performance improved consistently across models and data sets, suggesting the method helps detectors use context from nearby lanes and objects.
Catalog record
| CREATOR | Hyunjong Lee, Jangho Lee, Jaekoo Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-10385
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SAMIRO: Spatial Attention Mutual Information Regularization with a Pre-trained Model as Oracle for Lane Detection Journal: Pattern Recognition Letters Hyunjong Lee, Jangho Lee, Jaekoo Lee Abstract Lane detection is an important topic in the future mobility solutions. Real-world environmental challenges such as background clutter, varying illumination, and occlusions pose significant obstacles to effective lane detection, particularly when relying on data-driven approaches that require substantial effort and cost for data collection and annotation. To address these issues, lane detection methods must leverage contextual and global information from surrounding lanes and objects. In this paper, we propose a Spatial Attention Mutual Information Regularization with a pre-trained model as an Oracle , called SAMIRO . SAMIRO enhances lane detection performance by transferring knowledge from a pre-trained model while preserving domain-agnostic spatial information. Leveraging SAMIRO’s plug-and-play characteristic, we integrate it into various state-of-the-art lane detection approaches and conduct extensive experiments on major benchmarks such as CULane, Tusimple, and LLAMAS. The results demonstrate that SAMIRO consistently improves performance across different models and datasets. The code will be made available upon publication. 1 Introduction Lane detection is a fundamental component that enables vehicles to perceive road conditions and detect lane markings accurately, making it an essential task for autonomous driving [ 29 ] . However, achieving accurate lane detection remains a significant challenge due to factors such as background clutter, varying illumination, and occlusions [ 22 ; 43 ] . Since inaccurate lane detection can lead to accidents, it is essential to have a reliable and robust lane perception system that operates well under various road conditions. Existing state-of-the-art (SOTA) lane detection methods can be broadly categorized into two primary approaches. The first approach focuses on designing additional modules to enhance the detection of irregular lane characteristic [ 24 ; 38 ; 11 ] . For example, RESA [ 38 ] introduces a propagation mechanism that passes the spatial representations across both the row and column directions of feature maps, enhancing lane feature representations. While effective, this approach requires additional modules, leading to a trade-off between bottleneck and high accuracy. The second approach aims to improve lane detection by enhancing feature representations through improved training schemes [ 42 ; 16 ] . For instance, CLLD [ 42 ] employs self-supervised learning (SSL) to understand various patch images, thereby enriching the learned feature representations. This approach does not require additional modules. However, unlike other computer vision tasks, SSL has not been sufficiently investigated for its impact on lane detection performance [ 42 ; 8 ] . Despite the recent advancements, lane detection still faces challenges, particularly in generalizing to diverse road conditions with background clutter, illumination changes, and occlusions. Fig. 1 : Illustration of transfer learning. (a) Describes a scenario in transfer learning. (b) Provides an overview of Naïve transfer learning, which fails to address the domain gap between source and target data. (c) Represents a scenario where continuous interaction between source and target data through SAMIRO leads to learning domain-agnostic knowledge. To address these limitations and enhance generalization in lane detection, we propose a Spatial Attention Mutual Information Regularization with a pre-trained model as an Oracle , called SAMIRO . Specifically, our method is derived from a regularization method for domain generalization introduced MIRO [ 5 ] . SAMIRO effectively transfers knowledge from a pre-trained model, trained on abundant general image datasets (source domain), to a model trained on limited lane detection datasets (target domain). As illustrated in Figure 1 , typical transfer learning conveys domain-specific knowledge, which may not generalize well if the source and target domains have different properties and distributions. This discrepancy can lead to overfitting and degraded performance in the target domain. To address this issue in transfer learning, we propose SAMIRO, a novel framework that continuously transfers domain-agnostic knowledge from a pre-trained model to the lane detection model, thereby enhancing performance. SAMIRO comprises two key components: (i) spatial attention, (ii) mutual information regularization with a pre-trained model as an oracle. By incorporating spatial attention, the lane detection model focus on spatially relevant features crucial for lane detection. The mutual information regularization ensures that the lane detection model learns representations similar to the domain-agnostic knowledge of the pre-trained oracle model. Through extensive experiments on benchmark datasets [ 24 ; 32 ; 2 ] , we demonstrate that SAMIRO significantly improves the lane detection model’s performance. Our main contributions are summarized as follows: (i) MI - based, domain - agnostic spatial knowledge transfer improves robustness to illumination/occlusion/clutter. (ii) plug - and - play design enables broad, low - friction adoption. (iii) consistent gains across CULane, TuSimple, and LLAMAS demonstrate practical value. 2 Related Works Auxiliary Learning Modules In recent lane detection studies, most approaches have focused on auxiliary learning modules to enhance lane detection by addressing lane disappearance caused by background clutter, occlusions, and perspective distortion [ 24 ; 38 ; 19 ] . Pan et al. [ 24 ] introduced spatial CNN (SCNN), which captures spatial relationships by extending traditional convolutions from layer-by-layer to slice-by-slice within feature maps. Similarly, Zheng et al. [ 38 ] proposed the recurrent feature-shift aggregator (RESA) module, utilizing prior knowledge about lane contours by shifting feature maps vertically and horizontally to enrich spatial information. While these methods effectively enhance spatial features, they often come at the cost of increased computational complexity due to pixel-wise predictions. Laneformer [ 11 ] effectively integrates relationships between neighboring objects and lanes by incorporating an auxiliary detection module. Enhancing Feature Representation Alternatively, some approaches aim to directly enhance feature representations for lane detection without introducing additional learning modules. Inspired by the dispersion of lane features, SAD [ 16 ] reinforces the lane features between layers through self-attention distillation. Peng et al. [ 25 ] redesigned the conventional active learning by employing efficient feature selection based on knowledge distillation. However, these methods often suffer from significant performance degradation when encountering perspective variation or distortion not seen during training. Fig. 2 : Overall framework. (a) pre-training with masked image modeling, (b) transfer learning with SAMIRO. Self-supervised Learning (SSL) SSL aims to learn intrinsic representations or relations within data without relying on external labels provided by humans [ 9 ] . It helps enhance generalization performance by learning the inherent properties from the data [ 4 ; 17 ; 3 ; 5 ] . Kim et al. [ 17 ] successfully learned a domain-invariant representation using only positive data pairs without using the negative data pairs. The method of masked image modeling (MIM) [ 40 ] , as proposed by Kong and Zhang [ 18 ] , has demonstrated its capability to acquire robust features against occlusion. CLLD [ 42 ] applies transfer learning to the lane detection dataset following MIM training on the ImageNet [ 6 ] dataset. However, SSL approaches generally require substantial computational resources and large-scale training data. Regularization The goal of regularization is to reduce the overfitting and improve the generalization performance. Well-known methods like L1/L2 regularization [ 23 ] and dropout [ 28 ] impose constraints on network weights. Recently, feature-level regularization methods have gained attention [ 37 ; 5 ] . CS-KD [ 37 ] distills knowledge from the logit distributions obtained from samples of the same class. MIRO