Modified for use with the MRC workshop series
Yan-Ying Chen, Yue Weng, Alexandre Filipowicz, Rumen Iliev, Francine Chen, Shabnam Hakimi, Yanxia Zhang, Matthew Lee, Kent Lyons, Charlene Wu · 2025
Read Modified for use with the MRC workshop series by Yan-Ying Chen, Yue Weng, Alexandre Filipowicz, Rumen Iliev, Francine Chen, Shabnam Hakimi, Yanxia Zhang, Matthew Lee, Kent Lyons, Charlene Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21704.txt.
Introduction
Yan-Ying Chen and co-authors present a 2025 computing paper on predicting human choices by learning what makes each person different. The head title is Learning to Represent Individual Differences for Choice Decision Making; the catalog title is a stray workshop note. People vary in how they decide, and prediction tools that ignore that spread lose accuracy.
Questionnaires and lab models measure personal traits, but they squeeze those traits into a few numbers and are not tuned to the task. The team instead learns a personal embedding for each subject from mixed data, including free text answers. In an economic decision task, models with these embeddings beat models without them at every turn. Free text also offers a less invasive way to gather personal signals than standard forms.
Catalog record
| CREATOR | Yan-Ying Chen, Yue Weng, Alexandre Filipowicz, Rumen Iliev, Francine Chen, Shabnam Hakimi, Yanxia Zhang, Matthew Lee, Kent Lyons, Charlene Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-21704
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Modified for use with the MRC workshop series Yan-Ying Chen, Yue Weng, Alexandre Filipowicz, Rumen Iliev, Francine Chen, Shabnam Hakimi, Yanxia Zhang, Matthew Lee, Kent Lyons, Charlene Wu Abstract Human decision making can be challenging to predict because decisions are affected by a number of complex factors. Adding to this complexity, decision-making processes can differ considerably between individuals, and methods aimed at predicting human decisions need to take individual differences into account. Behavioral science offers methods by which to measure individual differences (e.g., questionnaires, behavioral models), but these are often narrowed down to low dimensions and not tailored to specific prediction tasks. This paper investigates the use of representation learning to measure individual differences from behavioral experiment data. Representation learning offers a flexible approach to create individual embeddings from data that are both structured (e.g., demographic information) and unstructured (e.g., free text), where the flexibility provides more options for individual difference measures for personalization, e.g., free text responses may allow for open-ended questions that are less privacy-sensitive. In the current paper we use representation learning to characterize individual differences in human performance on an economic decision-making task. We demonstrate that models using representation learning to capture individual differences consistently improve decision predictions over models without representation learning, and even outperform well-known theory-based behavioral models used in these environments. Our results propose that representation learning offers a useful and flexible tool to capture individual differences. [[email protected], ] [[email protected], ] [[email protected], ] [[email protected], ] [[email protected], ] [[email protected], ] [[email protected], ] [[email protected], ] [[email protected], ] [[email protected], ] keywords individual differences ,representation learning ,decision making † † copyrightyear: 2022 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: MRC 2022 – The Thirteenth International Workshop Modelling — Reasoning — Context. Held at IJCAI-ECAI 2022, July 23-29, 2022, Vienna, Austria. † † address: Toyota Research Institute, 4440 El Camino Real, Los Altos, CA 94022, United States 1 Introduction There is a growing framework of machine learning models aimed at predicting human decisions Plonsky et al. 2017 ; Hartford et al. 2016 . However, predicting human decision making can be challenging because of complex factors that influence human choices. Indeed, factors such as uncertainty, risk, time, and perceived effort have all been shown to influence everyday decisions Kahneman and Tversky 2013 ; Odum 2011 ; Kivetz 2003 . In addition to these external factors, stable characteristics that distinguish one individual from another, known in psychology as ”individual differences”, can also interact with external factors to influence choices. For example, individual differences such as age, country of origin, education and factors related to mental health have all been shown to influence the extent to which people perceive and respond to risk when making decisions Weber and Hsee 1998 ; Mata et al. 2011 ; Gächter et al. 2021 ; Hartley and Phelps 2012 . Thus, in order to accurately predict people’s choices, modeling methods should be well suited to account for individual differences. Despite the importance of individual differences in predicting human decisions, accurately measuring these differences can come with some challenges. Some individual differences, such as geographic location or age, are reasonably straight forward to measure. Others related more to preferences or personality traits (e.g., extroversion, pro-social tendencies, etc) can be more challenging. Current behavioral science approaches often use psychometric measures (e.g., questionnaires) to measure these latter types of individual differences. Properly validated questionnaires can be a powerful measure of different facets of personality. However, these are generally restricted to a low dimension and are not optimized toward the designated task, e.g., predicting choice decisions. The current paper attempts to measure individual differences in human decisions using representation learning. Representation learning has been used to personalize predictions based on user data (e.g., personalize the results of a recommendation systems Cheng et al. 2016 ), and thus offers a rich class of methods to capture individual differences in the context of behavioral experiments. We see two main advantages of representation learning over more traditional approaches to measuring individual differences. First, representation learning can be trained on a wide range of data types ranging from choices, to demographics, to open-ended text responses. This flexibility offers it as a method to capture individual differences from a broad range of data sources including some with higher variance (e.g., free text) and to fit use cases that need different levels or aspects of privacy for personalization. For example, in a use case where demographic information is sensitive, it can design relevant open-ended questions that allow participants to respond more comfortably using free text. Second, representation learning represents individuals in a high dimensional space that captures more complexity than more targeted and lower dimensional measures (e.g., questionnaires). This offers the ability to capture a richer representation of differences between individuals that are not limited to one modality. This, coupled with the broad data types to which representation learning is suited, offer it as a strong candidate method to measure individual differences. This paper will investigate ways to leverage the strengths of representation learning to represent individual differences in human decision making. We compare our approach with a theory-based behavioral model Kahneman and Tversky 2013 specifically designed for modeling risky behaviors in gambling decision tasks such as the data used in our experiment. Our article makes three main contributions: 1. we introduce the use of representation learning to model individual differences in behavioral experiments of decision making. 2. we lay out a novel framework to measure individual differences in decision-making from unstructured and open-ended text responses. 3. we investigate whether machine learning approaches can obtain competitive results in comparison to a model driven by well-known behavioral theories for the designated behavioral experiment. In the following sections, we first discuss the related work followed by the dataset and problem definition. We then introduce the approaches used in representation learning, and our novel use of open-ended questions as well as the model driven by behavioral theories for comparison. We conclude with by presenting our experimental analysis and findings. Figure 1: (a) Example of choice questions and demographic attributes and (b) the open-ended questions participant’s answered with free text in the behavioral experiment. 2 Related Work Representation learning has been successfully used to identify latent contexts in a high dimensional space. Pioneering research applied representation learning to words Mikolov et al. 2013 and documents Le and Mikolov 2014 by converting these text-based data into vectors. In addition to natural language, representation learning is commonly used to create embeddings of images Krizhevsky et al. 2012 to represent visual content and networks Perozzi et al. 2014 to encode network structures. Representation learning is also used to represent users by creating embeddings from a variety of personal data (e.g., entities relation, user attributes), and has been applied to fields such as fraud detection Li et al. 2019 and recommendation systems Cheng et al. 2016 where interactions between users and a variety of entities are leveraged. Here we use representation learning to represent individual differences for choice prediction in the context of behavioral experiments. In this context, data to capture individual difference are generally collected in laboratory settings (e.g., questionnaires), where only sparse personal