Bayesian Optimization in Language Space: An Eval-Efficient AI Self-Improvement Framework

Enoch Hyunwook Kang, Hema Yoganarasimhan · 2025

Read Bayesian Optimization in Language Space: An Eval-Efficient AI Self-Improvement Framework by Enoch Hyunwook Kang, Hema Yoganarasimhan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-12063.txt.

Introduction

Enoch Hyunwook Kang and Hema Yoganarasimhan present TextBO, a method for self-improving language models when checking results costs far more than making them. Prompt-based self-improvement can beat fine-tuning, yet most work counts how many tries are made, not how much costly feedback is used. Their aim is to gain the most from each evaluation.

TextBO extends a Bayesian optimization method with known efficiency guarantees into language space, where prompts are text and normal gradients do not apply. The authors show that simple text edits proposed by the model, paired with picking the best of several tries, mimic the right search direction. The result works purely in language, without extra training.

Catalog record

CREATOREnoch Hyunwook Kang, Hema Yoganarasimhan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE140 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-12063

Browse the full library · About the Tower of Babel