SeDi-Instruct : Enhancing Alignment of Language Models through Self-Directed Instruction Generation

Jungwoo Kim, Minsang Kim, Sungjin Lee · 2025

Read SeDi-Instruct : Enhancing Alignment of Language Models through Self-Directed Instruction Generation by Jungwoo Kim, Minsang Kim, Sungjin Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04774.txt.

Description

Jungwoo Kim, Minsang Kim, and Sungjin Lee put forth SeDi-Instruct in 2025, a cheaper way to make training data for language models. Models learn to follow orders from sets of sample tasks. A known method asks a top model to write those tasks, then throws most of them away as too weak, which wastes costly calls. Their frame keeps more of each batch by guarding its variety.

A second loop feeds what the model learns in training back into the next round of task writing. In their tests, models trained this way scored about five percent higher. Data costs fell by about a third at the same time. The team frames the gain as better data, not more data.

Catalog record

CREATORJungwoo Kim, Minsang Kim, Sungjin Lee
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04774

Browse the full library · About the Tower of Babel