Value Profiles for Encoding Human Variation
Taylor Sorensen, Pushkar Mishra, Roma Patel, Michael Henry Tessler, Michiel Bakker, Georgina Evans, Iason Gabriel, Noah Goodman, Verena Rieser · 2025
Read Value Profiles for Encoding Human Variation by Taylor Sorensen, Pushkar Mishra, Roma Patel, Michael Henry Tessler, Michiel Bakker, Georgina Evans, Iason Gabriel, Noah Goodman, Verena Rieser (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15484.txt.
Description
People disagree when they rate the same text, and a single average score erases that variation. Taylor Sorensen and co-authors propose describing each rater with a value profile: a short natural-language summary of the values behind their past ratings, distilled from examples of their work. A steerable decoder model then predicts how that person would rate new items, given their profile.
The team measured how much useful signal each kind of rater description carries. Raw examples carried the most, profiles came next, and basic background facts last, yet profiles kept over 70 percent of the examples' signal. Grouping raters by profile explained disagreement better than grouping by background. The decoder's predictions also shifted sensibly when profiles changed, and simulated rater groups reproduced real disagreement. The authors argue profiles offer an inspectable way to model how people differ.
Catalog record
| CREATOR | Taylor Sorensen, Pushkar Mishra, Roma Patel, Michael Henry Tessler, Michiel Bakker, Georgina Evans, Iason Gabriel, Noah Goodman, Verena Rieser |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 172 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-15484