Active Task Disambiguation with LLMs

Katarzyna Kobalczyk, Nicolás Astorga *, Tennison Liu, & Mihaela van der Schaar · 2025

Read Active Task Disambiguation with LLMs by Katarzyna Kobalczyk, Nicolás Astorga *, Tennison Liu, & Mihaela van der Schaar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04485.txt.

Description

Katarzyna Kobalczyk and co-authors tackle, in a 2025 paper, how a language model agent can ask the right questions when a task is stated vaguely. Vague tasks are the norm in real chats, and guessing wrong wastes the whole answer. The authors give a formal account of task ambiguity and frame good questioning as an experiment design problem.

Their agent picks questions that promise the most new information about the hidden task. That shifts the work from silent guessing to open probing of the solution space. Tests showed the targeted questions cleared up tasks better than methods that reason only about the questions themselves. Picking what to ask, it turns out, is a skill of its own.

Catalog record

CREATORKatarzyna Kobalczyk, Nicolás Astorga *, Tennison Liu, & Mihaela van der Schaar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04485

Browse the full library · About the Tower of Babel