Are requirements really all you need? A case study of LLM-driven configuration code generation for automotive simulations
Krzysztof Lebioda 1, Nenad Petrovic 1, Fengjunjie Pan 1, Vahid Zolfaghari 1, André Schamschurko 1, Alois Knoll 1 · 2025
Read Are requirements really all you need? A case study of LLM-driven configuration code generation for automotive simulations by Krzysztof Lebioda 1, Nenad Petrovic 1, Fengjunjie Pan 1, Vahid Zolfaghari 1, André Schamschurko 1, Alois Knoll 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13263.txt.
Description
Krzysztof Lebioda and co-authors present a 2025 case study on whether a language model can turn car test rules into working code. Car makers write test needs in dense standards and documents. The team fed such needs to a top current model and asked for setup code for CARLA, a driving simulator. The work tests how well the model grasps abstract orders, not just short prompts.
The study weighs what the model produces against what a working setup needs. Gaps show where human help and checks remain vital. Code tasks in safety fields punish small misreadings of source text. A model that drafts setups could still speed test work if experts vet its output. The authors frame their results as a reality check on bold claims for model coding skill.
Catalog record
| CREATOR | Krzysztof Lebioda 1, Nenad Petrovic 1, Fengjunjie Pan 1, Vahid Zolfaghari 1, André Schamschurko 1, Alois Knoll 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-13263