Are requirements really all you need? A case study of LLM-driven configuration code generation for automotive simulations

Krzysztof Lebioda 1, Nenad Petrovic 1, Fengjunjie Pan 1, Vahid Zolfaghari 1, André Schamschurko 1, Alois Knoll 1 · 2025

Read Are requirements really all you need? A case study of LLM-driven configuration code generation for automotive simulations by Krzysztof Lebioda 1, Nenad Petrovic 1, Fengjunjie Pan 1, Vahid Zolfaghari 1, André Schamschurko 1, Alois Knoll 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13263.txt.

Description

Krzysztof Lebioda and co-authors present a 2025 case study on whether a language model can turn car test rules into working code. Car makers write test needs in dense standards and documents. The team fed such needs to a top current model and asked for setup code for CARLA, a driving simulator. The work tests how well the model grasps abstract orders, not just short prompts.

The study weighs what the model produces against what a working setup needs. Gaps show where human help and checks remain vital. Code tasks in safety fields punish small misreadings of source text. A model that drafts setups could still speed test work if experts vet its output. The authors frame their results as a reality check on bold claims for model coding skill.

Catalog record

CREATORKrzysztof Lebioda 1, Nenad Petrovic 1, Fengjunjie Pan 1, Vahid Zolfaghari 1, André Schamschurko 1, Alois Knoll 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-13263

Browse the full library · About the Tower of Babel