SELAUR: Self Evolving LLM Agent via Uncertainty-aware Rewards
Dengjia Zhang, Xiaoou Liu, Lu Cheng, Yaqing Wang, Kenton Murray, Hua Wei · 2026
Read SELAUR: Self Evolving LLM Agent via Uncertainty-aware Rewards by Dengjia Zhang, Xiaoou Liu, Lu Cheng, Yaqing Wang, Kenton Murray, Hua Wei (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-21158.txt.
Description
Reward design makes or breaks language-model agents that act over many steps. Dengjia Zhang, Xiaoou Liu, Lu Cheng, Yaqing Wang, Kenton Murray, and Hua Wei argue one signal is missed in this 2026 arXiv paper: the model's own doubt. Their setup, SELAUR, builds doubt straight into reward-learning rewards for self-growing agents.
Entropy, least-trust, and margin measures join into a token-level doubt gauge, giving dense trust-matched guidance. A failure-aware remolding tool injects those signals into step- and path-level rewards, lifting search yield and learning steadiness. Trials on two yardsticks show steady success-rate gains over strong base cases, with cut-out tests backing doubt's role in search and toughness.
Catalog record
| CREATOR | Dengjia Zhang, Xiaoou Liu, Lu Cheng, Yaqing Wang, Kenton Murray, Hua Wei |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-21158