SeDi-Instruct : Enhancing Alignment of Language Models through Self-Directed Instruction Generation
Jungwoo Kim, Minsang Kim, Sungjin Lee · 2025
Read SeDi-Instruct : Enhancing Alignment of Language Models through Self-Directed Instruction Generation by Jungwoo Kim, Minsang Kim, Sungjin Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04774.txt.
Description
Jungwoo Kim, Minsang Kim, and Sungjin Lee put forth SeDi-Instruct in 2025, a cheaper way to make training data for language models. Models learn to follow orders from sets of sample tasks. A known method asks a top model to write those tasks, then throws most of them away as too weak, which wastes costly calls. Their frame keeps more of each batch by guarding its variety.
A second loop feeds what the model learns in training back into the next round of task writing. In their tests, models trained this way scored about five percent higher. Data costs fell by about a third at the same time. The team frames the gain as better data, not more data.
Catalog record
| CREATOR | Jungwoo Kim, Minsang Kim, Sungjin Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04774