A Statistical Framework for Learning Preferences from the Past

Tamojit Sadhukhan, Moulinath Banerjee, Krishanu Maulik, Parthanil Roy · 2026

Read A Statistical Framework for Learning Preferences from the Past by Tamojit Sadhukhan, Moulinath Banerjee, Krishanu Maulik, Parthanil Roy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10042.txt.

Introduction

Sadhukhan and three co-authors build a stats frame for learning user tastes from past choices, the repeat picks people make among a fixed set of options in tips and shopper choice. Gauging those tastes well drives custom future tips. Their model rests on a natural monotonicity rule: options chosen more often or more intensely in the past are likelier to be chosen again.

The approach widens a fixed-form ant-colony path-choice model without fixed forms, drawing on the generalised elephant random walk, and estimates preference probabilities by maximum likelihood under the monotonicity constraint. Theoretical guarantees for the estimator are derived, and both simulations and real-world data sets support its effectiveness. The first author was partly supported by an IMU Breakout Graduate Fellowship.

Catalog record

CREATORTamojit Sadhukhan, Moulinath Banerjee, Krishanu Maulik, Parthanil Roy
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.10042

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Statistical Framework for Learning Preferences from the Past Thanks: The first author is partially supported by an IMU Breakout Graduate Fellowship. Tamojit Sadhukhan, Moulinath Banerjee, Krishanu Maulik, Parthanil Roy Abstract . In many real-world settings such as online recommendation or consumer choice modeling, individuals make repeated choices from a fixed set of options. Accurately estimating their underlying preferences is essential for generating personalized future recommendations. Probabilistic models for understanding user choice behavior from past decisions can serve as a valuable addition to existing recommender systems and choice prediction methods. To this end, in this article, we introduce a novel statistical framework for predicting user preferences based on their past choices, under a natural monotonicity assumption: options that were chosen more frequently or more intensely in the past are more likely to be chosen again in the future. Our approach builds on a parametric model proposed by [ 7 ] , originally used to describe how ants in an ant colony select a path among many pre-existing paths. We propose a non-parametric generalization of this model, drawing inspiration from the generalized elephant random walk introduced by [ 16 ] . We develop a method of maximum likelihood estimation of the user preference probabilities under the above-mentioned monotonicity constraint. We also derive theoretical guarantees for our estimator and demonstrate the effectiveness of our method through both simulated experiments and real-world datasets. 2020 Mathematics Subject Classification Primary: 62G05; Secondary: 62M05, 62M20, 60G25 1. Introduction In many everyday scenarios, individuals are faced with multiple options and make choices based on their personal preferences. For instance, a shopper needs to decide which product to buy from a wide catalog in a retail shop or in an e-commerce platform. A viewer must choose the next movie, show, or song to watch on a streaming service. Users confronted with online ads may click on some but ignore others, while a customer ordering food using food delivery apps must pick which restaurant or dish best matches their tastes. In these scenarios, what matters is not only which option a user selects, but also how that choice is expressed. The intensity of a choice often provides a stronger quantification of preference than frequency alone. For example, in e-commerce, the amount a user spends on a product can reflect the strength of their commitment; in streaming platforms, the duration of viewing captures how engaged the user is with the content; in online advertising, the time spent interacting with an advertisement goes beyond a simple click to reveal genuine interest; and in food delivery apps, the size or value of an order can signal stronger loyalty than a casual, low-cost purchase. Across all these diverse settings, user behavior exhibits a natural reinforcement pattern: options that have been chosen more frequently or more intensely in the past are expected to be more likely to be chosen again in the future. Classical examples of such reinforcement dynamics can also be found in nature, for example in the foraging behavior of ants. Ants coordinate path selection through pheromone deposition: when an ant travels along a path, it leaves pheromones that increase the attractiveness of that path for subsequent ants. [ 9 ] introduced a parametric model that studied how ants in an ant colony select between two branches of a path leading to food. In this model, each ant deposits pheromone when it traverses a branch, and the probability that subsequent ants choose a branch increases with the quantity of pheromone already present in it. This local reinforcement mechanism produces a feedback loop, eventually leading the colony to favor one branch over the other, even if the two branches are initially identical. This biological example provides a natural analogy to human decision-making: just as pheromones bias future ant choices, past user choices can reinforce certain options, shaping future preferences in a predictable manner. Accurately estimating user preferences is essential for entities that offer choice options, in order to deliver personalized and effective recommendations, as it directly influences user satisfaction and engagement. One approach to such preference estimation, building on the framework of [ 9 ] , was proposed in [ 7 ] , where statistical procedures were developed for estimating the parameters of the underlying model. Specifically, [ 7 ] studied a two-colored urn process as a mathematical analogue of the branch selection problem, and developed both maximum likelihood estimation and weighted least squares estimation methods. They established consistency and asymptotic normality of these estimators, providing a statistically rigorous foundation for analyzing such reinforcement dynamics. Furthermore, they applied their methods to experimental data on ant path selection, showing how model parameters could be reliably inferred from observed choices, thereby moving beyond heuristic curve-fitting methods of [ 9 ] that lack statistical guarantees. This line of work illustrates how reinforcement-driven behaviors can be both modeled and estimated quantitatively, offering valuable insights for analogous problem in human choice modeling. Inspired by the work of [ 7 ] , we introduce a novel framework for estimating the probabilities of a user selecting each of the given options, based on their past choices, under a natural monotonicity assumption: the chance of an option being chosen increases with the frequency and intensity of its past selection, capturing the intuition that repeated intense choices signal stronger preferences. Our framework is probabilistic, interpretable, and grounded in reinforcement dynamics, offering both statistical validity and intuitive insights into user behavior. Moreover, while [ 7 ] deals with a parametric setting, our approach is non-parametric, providing greater flexibility to capture diverse user behaviors without imposing strong functional form assumptions. This non-parametric approach is motivated by the generalized elephant random walk models of [ 16 ] , with which it shares a natural connection that we elaborate on in Section 2 . Importantly, our model also incorporates the intensity of choices, acknowledging that not all user actions carry the same weight. Furthermore, we develop estimation procedures for this model and demonstrate their effectiveness through both theoretical analysis and empirical evaluation. Beyond its standalone interest, our framework can also serve as a useful component within modern recommendation systems. Recommendation systems have become the standard approach for predicting user preferences. Collaborative filtering such as neighborhood-based approach, matrix factorization, content-based filtering (for an overview of these methods, see, for example, [ 1 ] and the references therein) and more recently, deep learning methods ( [ 6 ] , [ 8 ] , [ 25 ] ) have achieved considerable success in practice. Probabilistic reinforcement-based models such as ours can potentially provide additional interpretable preference structures or informative priors for such systems. In particular, the ability to model calibrated choice probabilities may help enrich recommendation pipelines in settings where understanding user decision behavior is important. The remainder of the paper is organized as follows. In Section 2 , we introduce our model and describe the associated estimation methods, along with its connection to the generalized elephant random walks. Section 3 presents the main theoretical results and discusses their implications. Section 4 and Section 5 provide empirical evidence through simulation studies and real data applications, respectively. Proofs of the theoretical results are in Section 7 . 2. Estimation of User Preference Probabilities under Monotonicity Constraint 2.1. Setup and The

Read the complete text