Active Task Disambiguation with LLMs
Katarzyna Kobalczyk, Nicolás Astorga *, Tennison Liu, & Mihaela van der Schaar · 2025
Read Active Task Disambiguation with LLMs by Katarzyna Kobalczyk, Nicolás Astorga *, Tennison Liu, & Mihaela van der Schaar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04485.txt.
Description
Katarzyna Kobalczyk and co-authors tackle, in a 2025 paper, how a language model agent can ask the right questions when a task is stated vaguely. Vague tasks are the norm in real chats, and guessing wrong wastes the whole answer. The authors give a formal account of task ambiguity and frame good questioning as an experiment design problem.
Their agent picks questions that promise the most new information about the hidden task. That shifts the work from silent guessing to open probing of the solution space. Tests showed the targeted questions cleared up tasks better than methods that reason only about the questions themselves. Picking what to ask, it turns out, is a skill of its own.
Catalog record
| CREATOR | Katarzyna Kobalczyk, Nicolás Astorga *, Tennison Liu, & Mihaela van der Schaar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 74 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04485