OpenLKA: an open dataset of lane keeping assist from market autonomous vehicles
Yuhang Wang, Abdulaziz Alhuraish, Shengming Yuan, Shuyi Wang, Hao Zhou · 2025
Read OpenLKA: an open dataset of lane keeping assist from market autonomous vehicles by Yuhang Wang, Abdulaziz Alhuraish, Shengming Yuan, Shuyi Wang, Hao Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-03287.txt.
Introduction
Yuhang Wang and four co-authors release OpenLKA, an open dataset on how lane keeping assist behaves in cars already on sale. The feature is marketed as auto-steering, yet its real limits were little documented because test data were scarce. The team tested mainstream systems from leading American automakers in Tampa, Florida.
Their recordings combine vehicle network messages with video, perception output, and lateral path data from a quality front camera. Drives covered tricky geometry, bad weather, worn markings, and combinations of these. A vision-language model labeled the footage for weather, light, and traffic. Early findings: faint markings and low pavement contrast trouble the systems, and lane merges or intersections often cause departures or shutdowns.
Catalog record
| CREATOR | Yuhang Wang, Abdulaziz Alhuraish, Shengming Yuan, Shuyi Wang, Hao Zhou |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-03287
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OpenLKA: an open dataset of lane keeping assist from market autonomous vehicles Yuhang Wang, Abdulaziz Alhuraish, Shengming Yuan, Shuyi Wang, Hao Zhou Abstract The Lane Keeping Assist (LKA) system has become a standard feature in recent car models on the road. While marketed as providing auto-steering capabilities, the system’s operational characteristics and safety performance remain under explored, primarily due to a lack of real-world testing and comprehensive data. To address the gap, we conducted extensive testing of mainstream LKA systems from leading automakers in the U.S. market during the summer of 2024 in Tampa, Florida. Employing an innovative experimental method, we collected a comprehensive dataset that includes full Controller Area Network (CAN) messages with LKA attributes, as well as video, perception, and lateral trajectory planning data captured using a high-quality front-facing camera equipped with advanced vision detection and trajectory planning algorithms. Testing scenarios encompassed diverse and challenging conditions such as complex road geometry, adverse weather, varying lighting, degraded lane markings, and combinations of these factors. A vision language model (VLM) is utilized to further annotate the videos including features of weather, lighting, and surrounding traffic conditions etc. Based on the dataset gathered, this paper provides an empirical overview of the system’s operational features and safety performance. Key findings indicate that: (i) LKA’s perception is susceptible to faint lane markings and low contrast against pavement, reducing its effectiveness; (ii) LKA struggles in lane transition areas, such as merges, diverges, and intersections, often resulting in unintended lane departures or disengagements; (iii) LKA’s steering torque limitations contribute to frequent lane deviations or departures on sharp turns, posing significant safety risks; and (iv) LKA systems consistently exhibit a rigid lane-centering tendency, lacking the adaptability to adjust lane position on sharp curves or near large vehicles such as trucks. The paper concludes by highlighting how the dataset can serve both the infrastructure and self-driving technology sectors. In light of LKA limitations, we provide recommendations for improving road geometry design and pavement maintenance practices. Additionally, we demonstrate how the dataset can support the development of human-like LKA systems through the application of VLM with fine-tuning and Chain of Thought reasoning. The code and data are shared at: https://github.com/OpenLKA/OpenLKA . Fig. 1.: OpenLKA: A comprehensive framework for LKA analysis and enhancement. K eywords Automated vehicles \cdot Lane keeping assist \cdot Lane departure \cdot Large language models 1 Introduction The proliferation of Advanced Driver Assistance Systems (ADAS) in modern vehicles marks a pivotal shift in automotive technology [ 1 , 2 ] . Among these, Lane Keeping Assist (LKA) [ 3 ] has become a standard feature in recent car models, autonomously modulating steering to maintain lane centering [ 4 , 5 ] . Despite its widespread adoption, LKA systems’ real-world performance limitations [ 6 ] create critical challenges across multiple stakeholders. For drivers, the uncertainty about LKA’s capabilities [ 7 ] leads to confusion about when and where to engage the system, resulting in both steep learning curves and potential safety risks. Infrastructure operators and transportation authorities lack clear guidelines for adapting road design elements [ 8 ] , such as lane marking specifications and departure warning systems, to better support LKA functionality. Meanwhile, the autonomous driving technology sector faces obstacles in improving these systems due to limited sharing of performance data and failure cases within the research community, hindering collaborative efforts to enhance LKA reliability and safety [ 9 ] . While manufacturers rigorously test their systems during development in controlled environments, these evaluations fail to capture the complexity of real-world driving conditions. Some transportation departments have conducted preliminary assessments of road infrastructure impact on LKA performance [ 10 ] , their studies remain limited in scope, focusing on specific scenarios with a small number of test vehicles. The lack of comprehensive performance data across various vehicle models and manufacturers has left critical questions unanswered about LKA’s real-world capabilities, particularly under challenging conditions such as complex road geometries, adverse weather, and deteriorated lane markings [ 11 ] . This scarcity of extensive, multi-modal datasets has impeded both systematic assessment of existing systems and development of more robust algorithms [ 12 , 13 , 14 ] . To address these challenges, we introduce OpenLKA, a large-scale open dataset of LKA systems on market car models. While preliminary efforts have been made to assess LKA performance in limited scenarios [ 15 , 16 ] , our study represents a significant advancement in both scope and methodology. Since its launch in the summer of 2024, this systematic data collection initiative combines high-fidelity data from vehicle CAN networks, advanced vision systems, and machine learning techniques within a unified framework. Through extensive tests conducted in Tampa, Florida, we have leveraged the region’s subtropical climate to evaluate LKA performance under diverse weather patterns and road configurations. Additionally, we have incorporated driving data from the open-source community, significantly enhancing our dataset’s diversity and providing valuable insights into how different driving styles interact with LKA systems. This multi-faceted approach not only captures basic vehicle control data but also rich contextual information about the driving environment, enabling a thorough evaluation of LKA performance under real-world conditions. Our comprehensive analysis reveals significant limitations in current LKA systems across perception, planning, and control modules. While these systems perform adequately under normal conditions, they exhibit considerable deviations from lane center or even disengage completely when encountering scenarios such as sharp curves [ 17 ] or deteriorated lane markings. More importantly, compared to human drivers’ adaptability and safety awareness, LKA systems demonstrate rigid lane-centering behavior [ 18 ] , potentially leading to hazardous situations in edge cases. This inflexibility stands in stark contrast to human drivers’ ability to adjust their lateral position based on road conditions, surrounding vehicles, and other contextual factors. The key contributions of our paper are: I. We present OpenLKA, an extensive multi-modal driving dataset collected from a diverse fleet of LKA-equipped vehicles. Our data collection framework combines reverse-engineered OBD-II interfaces for accessing LKA system states, high-resolution dash-cam recordings, and state-of-the-art lane detection algorithms. The dataset encompasses over 130 hours of driving data across 15 different vehicle models, supplemented by comprehensive scene annotations generated through vision-language models, providing detailed interpretations of traffic scenarios, environmental conditions, and driving contexts. II. Through systematic overview of OpenLKA, we categorize and quantify LKA limitations across perception, planning, and control modules. Our empirical investigation reveals significant performance degradation in challenging scenarios, particularly on curved road segments. We establish quantitative relationships between lane-keeping deviations and road geometry parameters such as curvature radius and rate of curvature change, supported by extensive real-world measurements and statistical evidence. III. Based on our empirical findings, we develop concrete recommendations for improving LKA technology and infrastructure readiness. For LKA developers, we demonstrate how vision-language models can enhance system adaptability by incorporating human-like reasoning capabilities in lane-keeping decisions. For transportation authorities, we provide specific guidelines for lane marking designs and curve advisories that better support LKA operations. Additionally, we propose a standardized framework for evaluating and benchmarking LKA performance, facilitating more transparent development and validation processes within the autonomous driving community. We present an overview of our complete pipeline in Fig. 1 . The insights and methodologies developed through this research not only advance our understanding of current