GFlowPO : Generative Flow Network as a Language Model Prompt Optimizer
Junmo Cho, Suhan Kim, Sangjune An, Minsu Kim, Dong Bok Lee, Heejun Lee, Sung Ju Hwang, Hae Beom Lee · 2026
Read GFlowPO : Generative Flow Network as a Language Model Prompt Optimizer by Junmo Cho, Suhan Kim, Sangjune An, Minsu Kim, Dong Bok Lee, Heejun Lee, Sung Ju Hwang, Hae Beom Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03358.txt.
Description
Prompt search is treated as posterior use by Junmo Cho, leading a team of 7 others, in a system called GFlowPO. Finding effective prompts is critical yet difficult, because the prompt space is combinatorially large and evaluating each option on the target model is expensive, making rewards sparse. Reinforcement learning optimizers that sample on-policy from a fixed meta-prompt spread explore inefficiently and waste those costly reviews on unpromising regions.
Their method fine-tunes a lightweight prompt model with an off-policy generative flow network objective, reusing past reviews through replay for sample-efficient exploration. A dynamic memory update then refreshes the meta-prompt with diverse replay prompts and top performers from a priority queue, concentrating search on high-reward regions without extra training. Across classification, instruction induction, and question answering, GFlowPO beat recent discrete prompt tuning earlier methods.
Catalog record
| CREATOR | Junmo Cho, Suhan Kim, Sangjune An, Minsu Kim, Dong Bok Lee, Heejun Lee, Sung Ju Hwang, Hae Beom Lee |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-03358