Cold Start Active Preference Learning in Socio-Economic Domains

Mojtaba Fayazbakhsh 1 , Danial Ataee 2 , MohammadAmin Fazli 1 · 2025

Read Cold Start Active Preference Learning in Socio-Economic Domains by Mojtaba Fayazbakhsh 1 , Danial Ataee 2 , MohammadAmin Fazli 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-05090.txt.

Introduction

Mojtaba Fayazbakhsh, Danial Ataee, and MohammadAmin Fazli warm up preference learning when no labeled examples exist yet, in a paper from twenty twenty-five. Learning what people prefer by asking a few smart questions is efficient, but the method stumbles at the start, before any answers arrive. Fixes existed for image and text tasks, not for preference learning.

Borrowing from social and economic research practice, the method begins with a self-taught phase. A standard compression technique reads the data's own structure and invents rough labels, giving a warmed-up model. Questions to a noisy stand-in expert then refine it. On datasets covering creditworthiness, career success, and social status, the approach beat cold-start rivals throughout.

Catalog record

CREATORMojtaba Fayazbakhsh 1 , Danial Ataee 2 , MohammadAmin Fazli 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-05090

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Cold Start Active Preference Learning in Socio-Economic Domains Mojtaba Fayazbakhsh 1 , Danial Ataee 2 , MohammadAmin Fazli 1 Abstract Active preference learning is a powerful paradigm for efficiently modeling preferences, yet it suffers from the cold-start problem: a significant drop in performance when no initial labeled data is available. This challenge is particularly acute in computational social systems and economic analysis, where labeled data is often scarce, expensive, and subject to expert noise. To address this gap, we propose a novel framework for cold-start active preference learning. Our method initiates the learning process through a self-supervised pre-training phase, utilizing Principal Component Analysis (PCA) to derive initial pseudo-labels from the data’s inherent structure, thereby creating a “cold-start” model without any initial oracle interaction. Subsequently, the model is refined through an active learning loop that strategically queries a simulated noisy oracle for labels. We conduct extensive experiments on diverse datasets from different domains, including financial credibility, career success rate, and socio-economic status. The results demonstrate that our cold-start approach outperforms standard active learning strategies that begin from a blank slate, achieving higher accuracy with substantially fewer labeled pairs. Our framework offers a practical and effective solution to mitigate the cold-start problem, enhancing the sample efficiency and applicability of preference learning in data-constrained environments. We release our code here . I Introduction Comprehensive analysis in social and economic research often requires the integration of multiple factors in assessments to capture the complexity of real-world phenomena. For example to gauge overall societal progress effectively, the UK Government’s guidance on appraisal emphasizes the importance of considering a range of indicators beyond mere economic outputs, such as health, education, and environmental quality, [ 1 ] . Another instance, is the literature around measuring and analysing poverty considering it’s multidimensional essence [ 2 , 3 ] . While defining simple and theoretically interpretable evaluation criteria are sometimes infeasible, formal preference models, address the challenges of preference elicitation and offer a way to express the assessment of a decision maker in a clear and declarative manner. Developing a preference model over alternatives, has an extensive background with analogous terminologies in a group of diverse disciplines including machine learning, artificial intelligence, operations research, social sciences, economics, and decision theory [ 4 ] . Revealed preference theory, introduced by economist Paul Samuelson in 1938 [ 5 , 6 ] , asserts that consumer preferences can be inferred from their purchasing decisions, assuming rational behavior aimed at maximizing utility given constraints like price and income [ 7 , 8 ] . This approach emphasizes that actual choices made by consumers reflect their true preferences more accurately than self-reported data, which can be biased or unreliable [ 7 ] . Multi-criteria decision making (MCDM), a known term in operational research and decision sciences [ 9 ] , focuses on providing disciplined methods to structure complex decision problems and evaluate alternatives concerning multiple conflicting aspects [ 10 ] , for example cost and quality [ 11 ] . Systematic reviews, have shown robust growth for applying MCDM methods [ 10 ] in finance, transportation, medicine, management, engineering and sustainable development studies [ 12 , 13 ] . The process of multi-citeria decision making generally involves two phases of evaluating alternatives per different subcriteria and combining evaluation vectors to a final comparable score for each item [ 14 ] . While there are recent efforts to exploit machine learning techniques [ 15 , 16 ] , the aggregation of subcriteria-wise evaluations (i.e. the core of the preference model) is usually done by each method’s proposed rule. In machine learning, preference learning is considered a task that focuses on the automated acquisition of preference models from observed or revealed preference information. Preference learning involves predicting preferences over a collection of alternatives [ 14 ] . These preferences can be represented in various forms, such as utility functions, preference relations, or logical representations. The task is to learn these preferences from empirical data, which may include pairwise comparisons, or other types of preference information [ 17 , 18 ] . Similar to revealed preferences and consumer theory, preference learning involves using algorithms to analyze past preference outcomes to predict future choices, effectively learning the underlying preferences based on observed actions rather than hypothetical scenarios [ 19 , 20 ] . Both frameworks operate on the principle that real-world data provides a more reliable foundation for understanding consumer behavior than theoretical constructs alone. Thus, the intersection of revealed preferences and preference learning highlights a shared goal: to derive insights into decision-making by focusing on actual made choices rather than assumptions about utility or comparison mechanisms. One approach to preference learning is through the use of utility functions. These functions assign an absolute degree of utility to each alternative, allowing for the ranking of alternatives based on their utility scores. Learning utility functions can be framed as a regression problem, depending on whether the utility scale is numerical or ordinal. Another approach involves learning binary preference relations, which predict whether one alternative is preferred over another. This method reduces preference learning to a binary classification problem, where the goal is to learn a preference predicate that compares pairs of alternatives. This approach is more general and can handle partial order relations, but it may lead to inconsistencies such as preferential cycles [ 4 ] . One of the primary challenges when using machine learning lies in the labeling process. Labeling espacially in socio-economic domains is often difficult because these problems are complex and multi-faceted, and expert knowledge alone may not be sufficient to provide accurate and comprehensive labels for training data. Furthermore, experts may have differing interpretations of the same problem and disagree on what constitutes the “correct” label, introducing subjectivity and inconsistencies in the dataset. This can be especially problematic when the domain involves ethical, cultural, or political considerations that are not easily quantified. This subjectivity can introduce biases into the data, which might not be immediately apparent but can significantly affect model performance and fairness [ 21 ] . Experts are often influenced by their personal experiences and societal norms, which can result in biases that go unnoticed during the labeling process [ 22 ] . These biases, once embedded in the training data, can lead to biased predictions from the model, especially in socio-economic domains, where the stakes for fairness and equality are high. Moreover, the resource-intensive nature of labeling large datasets further complicates the process, as it requires expert time and knowledge, which may be limited or not readily available. This situation becomes even more difficult when data is incomplete or noisy, forcing experts to make judgments based on imperfect information, which can degrade the quality of the labeled data. The above mentioned concerns underscore the importance of having methods to address expert biases and reduce the reliance on large and inconsistent labeled datasets, enabling more scalable and efficient learning in socio-economic contexts. Some researches have proposed evaluation metrics which are derived from unsupervised techniques such as principal component analysis, not letting labeling challenges to be an issue [ 23 , 24 , 25 , 26 ] . Surprisingly, these methods have shown acceptable performance in practice leading to a widespread adoption of

Read the complete text