Generative Modeling of Individual Behavior at Scale

Nabil Omi, Lucas Caccia, Anurag Sarkar, Siddhartha Sen · 2025

Read Generative Modeling of Individual Behavior at Scale by Nabil Omi, Lucas Caccia, Anurag Sarkar, Siddhartha Sen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14998.txt.

Introduction

Nabil Omi and co-authors present a 2025 study on modeling the personal style of individual players, not just average behavior. Most behavior models work at the group level. Their approach treats each person as a separate task in one shared model. A compact style vector for each person switches on shared skill settings, so the model can both recognize a player from their moves and generate new moves in that player's style.

The team applied the method to chess, with 47,864 players, and to the game Rocket League, with 2,000 players. A steering technique can nudge a style vector toward a chosen trait. They also ported the idea to image generation, learning vectors for more than ten thousand celebrities and steering their portraits. The work shows one framework can capture personal style across very different domains.

Catalog record

CREATORNabil Omi, Lucas Caccia, Anurag Sarkar, Siddhartha Sen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-14998

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Generative Modeling of Individual Behavior at Scale Nabil Omi, Lucas Caccia, Anurag Sarkar, Siddhartha Sen Abstract There has been a growing interest in using AI to model human behavior, particularly in domains where humans interact with this technology. While most existing work models human behavior at an aggregate level, our goal is to model behavior at the individual level. Recent approaches to behavioral stylometry —or the task of identifying a person from their actions alone—have shown promise in domains like chess, but these approaches are either not scalable (e.g., fine-tune a separate model for each person) or not generative, in that they cannot generate actions. We address these limitations by framing behavioral stylometry as a multi-task learning problem—where each task represents a distinct person —and use parameter-efficient fine-tuning (PEFT) methods to learn an explicit style vector for each person. Style vectors are generative: they selectively activate shared “skill" parameters to generate actions in the style of each person. They also induce a latent space that we can interpret and manipulate algorithmically. In particular, we develop a general technique for style steering that allows us to steer a player’s style vector towards a desired property. We apply our approach to two very different games, at unprecedented scales: chess (47,864 players) and Rocket League (2,000 players). We also show generality beyond gaming by applying our method to image generation, where we learn style vectors for 10,177 celebrities and use these vectors to steer their images. 1 Introduction The rapid advances in machine learning in recent years has made it increasingly important to find constructive ways for humans to interact with this technology. Even in domains where AI has achieved superhuman performance, it is often important to understand how humans approach these tasks. Such an understanding can help identify areas for improvement in humans, develop better AI partners or teachers, and create more enjoyable experiences. AI that solely aims to solve a task optimally often fails in these respects, because they tend to be difficult to interpret, provide limited instructional value, and can be awkward to interact with. A common method for capturing human behavior is behavioral cloning (BC), a form of imitation learning ( Schaal, 1996 ) that applies supervised learning to fixed demonstrations for a given task. BC has been used in various domains, such as supply chain management ( Kurian et al., 2023 ) , legal cases ( Ma et al., 2021 ) , robotics ( Florence et al., 2022 ) , and self-driving vehicles ( Pomerleau, 1988 ) . Recently, BC has seen increasing use in gaming, such as in Counter-Strike ( Pearce and Zhu, 2022 ) , Overcooked ( Carroll et al., 2019 ) , Minecraft ( Schäfer et al., 2023 ) , Bleeding Edge ( Pearce et al., 2024 ) , and chess McIlroy-Young et al. (2020) . The above work focuses on modeling human behavior in aggregate, motivated by goals like developing better AI partners or training tools. However, we believe such goals are better served by modeling human behavior at the individual level, because this allows us to tailor solutions to the individual’s needs (e.g., creating an AI training partner that targets an individual’s weaknesses). To that end, recent work in chess has shown the most promise. McIlroy-Young et al. (2020) used BC to create a set of models called Maia that mimic human play at 9 different skill levels. They then fine-tuned these models on the data of 400 individual players to create a personalized model for each player ( McIlroy-Young et al., 2022 ) . Using these models, the authors perform behavioral stylometry , where the goal is to identify which person played a given query set of games, by applying each of the 400 models to the query set and outputting the one with the highest accuracy. McIlroy-Young et al. (2021) propose a more scalable approach of training a Transformer-based embedding on the games of each player. They perform stylometry across 2,844 players by embedding the query set of games and matching it to the closest player’s embedding. These approaches have different merits. The individualized approach creates a generative model for each player that can play in their style, but it is not scalable: adding a new player requires fine-tuning a separate model. The embedding approach is much more scalable: it learns a single-vector representation of each player in a shared style space, and uses few-shot learning to embed a new player in this space. However, it cannot be used to generate moves, and hence cannot reason about player behavior in practice. An ideal solution would combine these properties: generative, scalable, compact representation. Our key insight for achieving this is to view behavioral stylometry as a multi-task learning problem, where each task represents an individual person . The goal here is to generalize across an initial set of players (tasks) while supporting few-shot learning of new players (tasks). To do this efficiently, we leverage recent advances in parameter-efficient fine-tuning (PEFT) ( Ponti et al., 2023 ; Caccia et al., 2023 ) . Specifically, we augment an existing BC model with a set of Low Rank Adapters (LoRAs) as well as a routing matrix that specifies a distribution over these adapters for each player. Unlike approaches that train a separate LoRA for each task, this modular design allows players to softly share parameters in a fine-grained manner. We apply this adapter framework to two very different gaming models: a modified version of the Maia model for chess, and a Transformer-based model for Rocket League, a 3D soccer video game played by cars in a caged arena. We chose these games because they have a large, public collection of human games that span a diversity of skill levels and playing styles. The base models we create outperform the state-of-the-art BC models for Rocket League and chess. Our fine-tuning process encourages the adapters to learn different latent skills , while each row of the routing matrix induces a weight distribution over these skills. We call each row the style vector for the corresponding player. Style vectors are versatile and powerful. They support few-shot learning which enables stylometry at scale. They induce a generative model for each player that we can run and observe. They induce a shared style space that we can interpret and manipulate algorithmically. Leveraging these properties, we develop a general, human-interpretable technique for style steering that identifies a subset of players who exhibit a desired style property, and steers a new player towards that property. This paper makes the following contributions: 1. We use a black-box adapter framework to model individual human behavior and create style vectors for players. We show that style vectors can be combined, interpolated, and steered in an interpretable way. 2. We perform behavioral stylometry at an unprecedented scale for chess (47,864 players, 94.4% accuracy) and Rocket League (2,000 players, 86.7% accuracy), given a query set of 100 games. Our per-player generative models achieve move-matching accuracy in the range 45-69% for chess and 44-72% for Rocket League. 3. We present novel applications of style vectors, including a method to steer player styles to strengthen human-interpretable attributes of their gameplay. We show the generality of style steering by applying

Read the complete text