Bayesian Optimization from Human Feedback: Near-Optimal Regret Bounds
Aya Kayal, Sattar Vakili, Laura Toni, Da-shan Shiu, Alberto Bernacchia · 2025
Read Bayesian Optimization from Human Feedback: Near-Optimal Regret Bounds by Aya Kayal, Sattar Vakili, Laura Toni, Da-shan Shiu, Alberto Bernacchia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23673.txt.
Description
Aya Kayal and co-authors sharpen theory for Bayesian optimization from human feedback in a 2025 paper. In this setting, a learner does not see a score for an action. It only learns which of two actions a person prefers, which makes each query costly and information poor.
Within a standard preference model, the team derive tighter regret bounds, the gap between chosen and best actions over time. For common kernels, their bounds match the sample needs of richer feedback methods. In plain terms, pairwise human choices can be nearly as efficient as full scores, when the algorithm is well designed.
Catalog record
| CREATOR | Aya Kayal, Sattar Vakili, Laura Toni, Da-shan Shiu, Alberto Bernacchia |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 72 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-23673