Random-Set Large Language Models
Muhammad Mubashar, Shireen Kudukkil Manchingal, Fabio Cuzzolin · 2025
Read Random-Set Large Language Models by Muhammad Mubashar, Shireen Kudukkil Manchingal, Fabio Cuzzolin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-18085.txt.
Description
Muhammad Mubashar, Shireen Manchingal, and Fabio Cuzzolin ask how much we can trust the words a language model writes, in a 2025 paper. Their answer swaps the usual output, a spread of odds over words, for a belief set over groups of words. The set's size can show how unsure the model should be.
Scanning all word groups is far too costly, so they cluster words and keep a budget of key groups, called focal sets. Tests on two question sets with three open models beat the standard output on answer correctness. The sets also flagged cases where the model was likely making things up, a step toward honest self doubt.
Catalog record
| CREATOR | Muhammad Mubashar, Shireen Kudukkil Manchingal, Fabio Cuzzolin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-18085