SAUP: Situation Awareness Uncertainty Propagation on LLM Agent

Qiwei Zhao, Xujiang Zhao, Yanchi Liu, Wei Cheng, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Huaxiu Yao, Haifeng Chen · 2024

Read SAUP: Situation Awareness Uncertainty Propagation on LLM Agent by Qiwei Zhao, Xujiang Zhao, Yanchi Liu, Wei Cheng, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Huaxiu Yao, Haifeng Chen (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01033.txt.

Description

Qiwei Zhao and co-authors wrote this machine learning paper, published in two thousand twenty-four, on measuring doubt in language model agents. Such agents act in steps, and a small doubt early can grow as later steps build on it.

Most past methods score doubt only at the final answer, which misses that build-up. The team's framework, SAUP, carries doubt forward step by step through the agent's work. Each step's doubt is weighted by how much the situation at that step matters. The frame can sit on top of many one-step scoring methods. In tests on standard benchmarks, SAUP beat the best prior methods by up to a fifth on a key accuracy measure. The authors offer it as a way to know when an agent's plan should not be trusted.

Catalog record

CREATORQiwei Zhao, Xujiang Zhao, Yanchi Liu, Wei Cheng, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Huaxiu Yao, Haifeng Chen
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE33 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-01033

Browse the full library · About the Tower of Babel