GFlowPO : Generative Flow Network as a Language Model Prompt Optimizer

Junmo Cho, Suhan Kim, Sangjune An, Minsu Kim, Dong Bok Lee, Heejun Lee, Sung Ju Hwang, Hae Beom Lee · 2026

Read GFlowPO : Generative Flow Network as a Language Model Prompt Optimizer by Junmo Cho, Suhan Kim, Sangjune An, Minsu Kim, Dong Bok Lee, Heejun Lee, Sung Ju Hwang, Hae Beom Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03358.txt.

Description

Prompt search is treated as posterior use by Junmo Cho, leading a team of 7 others, in a system called GFlowPO. Finding effective prompts is critical yet difficult, because the prompt space is combinatorially large and evaluating each option on the target model is expensive, making rewards sparse. Reinforcement learning optimizers that sample on-policy from a fixed meta-prompt spread explore inefficiently and waste those costly reviews on unpromising regions.

Their method fine-tunes a lightweight prompt model with an off-policy generative flow network objective, reusing past reviews through replay for sample-efficient exploration. A dynamic memory update then refreshes the meta-prompt with diverse replay prompts and top performers from a priority queue, concentrating search on high-reward regions without extra training. Across classification, instruction induction, and question answering, GFlowPO beat recent discrete prompt tuning earlier methods.

Catalog record

CREATORJunmo Cho, Suhan Kim, Sangjune An, Minsu Kim, Dong Bok Lee, Heejun Lee, Sung Ju Hwang, Hae Beom Lee
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03358

Browse the full library · About the Tower of Babel