Direct Regret Optimization in Bayesian Optimization

Fengxue Zhang, Yuxin Chen · 2025

Read Direct Regret Optimization in Bayesian Optimization by Fengxue Zhang, Yuxin Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-06529.txt.

Description

Fengxue Zhang and Yuxin Chen wrote a 2025 paper on a smarter way to search for the best setting of a costly test. Such searches are used when each run of a test is slow or pricey. Standard methods pair a fixed guess model with a hand built rule for picking the next run, and they plan just one step ahead.

Their method learns the model and the picking rule together, with a direct aim at low regret over many steps. Fake search runs from a bank of guess models train a transformer to pick each next point. A few real runs then tune the models as the search goes. Tests showed top or near top results, with the biggest gains on hard high dimension tasks.

Catalog record

CREATORFengxue Zhang, Yuxin Chen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-06529

Browse the full library · About the Tower of Babel