LLINBO: Trustworthy LLM-in-the-Loop Bayesian Optimization

Chih-Yu Chang, Milad Azvar, Chinedum Okwudire, Raed Al Kontar · 2025

Read LLINBO: Trustworthy LLM-in-the-Loop Bayesian Optimization by Chih-Yu Chang, Milad Azvar, Chinedum Okwudire, Raed Al Kontar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-14756.txt.

Description

Chih-Yu Chang, Milad Azvar, Chinedum Okwudire, and Raed Al Kontar pair language models with classic statistics to search for the best settings of expensive processes. Bayesian optimization is the standard tool for such searches, and language models bring useful background knowledge when data are scarce. Left alone, though, a language model has no honest sense of its own uncertainty, and its choices cannot be steered or audited.

Their framework, LLINBO, uses the language model for bold early exploration. A Gaussian process expert then takes over the careful exploitation of what has been learned. Three mechanisms pass control between them, each backed by theory. A real test in 3D printing serves as proof of concept. Code is published. The authors pitch the hybrid as the trustworthy way to use language models in optimization.

Catalog record

CREATORChih-Yu Chang, Milad Azvar, Chinedum Okwudire, Raed Al Kontar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE83 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-14756

Browse the full library · About the Tower of Babel