SAUP: Situation Awareness Uncertainty Propagation on LLM Agent
Qiwei Zhao, Xujiang Zhao, Yanchi Liu, Wei Cheng, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Huaxiu Yao, Haifeng Chen · 2024
Read SAUP: Situation Awareness Uncertainty Propagation on LLM Agent by Qiwei Zhao, Xujiang Zhao, Yanchi Liu, Wei Cheng, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Huaxiu Yao, Haifeng Chen (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01033.txt.
Description
Qiwei Zhao and co-authors wrote this machine learning paper, published in two thousand twenty-four, on measuring doubt in language model agents. Such agents act in steps, and a small doubt early can grow as later steps build on it.
Most past methods score doubt only at the final answer, which misses that build-up. The team's framework, SAUP, carries doubt forward step by step through the agent's work. Each step's doubt is weighted by how much the situation at that step matters. The frame can sit on top of many one-step scoring methods. In tests on standard benchmarks, SAUP beat the best prior methods by up to a fifth on a key accuracy measure. The authors offer it as a way to know when an agent's plan should not be trusted.
Catalog record
| CREATOR | Qiwei Zhao, Xujiang Zhao, Yanchi Liu, Wei Cheng, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Huaxiu Yao, Haifeng Chen |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-01033