MAPLE: A Framework for Active Preference Learning Guided by Large Language Models
Saaduddin Mahmud, Mason Nakamura, Shlomo Zilberstein · 2024
Read MAPLE: A Framework for Active Preference Learning Guided by Large Language Models by Saaduddin Mahmud, Mason Nakamura, Shlomo Zilberstein (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07207.txt.
Description
Saaduddin Mahmud, Mason Nakamura, and Shlomo Zilberstein teach AI systems to learn what people prefer with less nagging, in this 2024 paper. Preference learning usually grills users with endless comparisons. Their framework, MAPLE, lets a large language model help carry the model of what the user wants, fed by both plain-language comments and standard pairwise rankings.
MAPLE picks its questions actively, aiming at the ones that shrink doubt the most while staying easy to answer. Tests ran on two benchmarks, one a real-world route planning task built on open map data. The framework learned faster than rivals and improved how well people could answer its questions. The authors pitch it as a way to make preference learning cheaper in effort and clearer to follow.
Catalog record
| CREATOR | Saaduddin Mahmud, Mason Nakamura, Shlomo Zilberstein |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-07207