Retrieval-Augmented Fine-Tuning With Preference Optimization For Visual Program Generation

Deokhyung Kang, Jeonghun Cho, Yejin Jeon, Sunbin Jang, Minsub Lee, Jawoon Cho, Gary Geunbae Lee · 2025

Read Retrieval-Augmented Fine-Tuning With Preference Optimization For Visual Program Generation by Deokhyung Kang, Jeonghun Cho, Yejin Jeon, Sunbin Jang, Minsub Lee, Jawoon Cho, Gary Geunbae Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-16529.txt.

Description

Deokhyung Kang and co-authors teach language models to write visual programs for factory control systems, in a 2025 paper. Visual programming lets users build software from diagrams rather than typed code. One such language, Ladder Diagram, runs much industrial automation and demands deep site-specific knowledge. Simply prompting a large model to write it works poorly, since one prompt cannot hold all that detail.

The team shows that training a model beats prompting, even when the trained model is smaller. Their recipe has two stages. First, the model learns from past examples fetched to match each new task, since factory programs reuse the same building blocks again and again. A second stage then ranks better outputs above worse ones to polish the results. The work points toward AI help that fits the habits of real industrial code.

Catalog record

CREATORDeokhyung Kang, Jeonghun Cho, Yejin Jeon, Sunbin Jang, Minsub Lee, Jawoon Cho, Gary Geunbae Lee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-16529

Browse the full library · About the Tower of Babel