Incentivizing Truthfulness and Collaborative Fairness in Bayesian Learning
Rachael Hwee Ling Sim, Jue Fan, Xiao Tian, Xinyi Xu, Patrick Jaillet, Bryan Kian Hsiang Low · 2026
Read Incentivizing Truthfulness and Collaborative Fairness in Bayesian Learning by Rachael Hwee Ling Sim, Jue Fan, Xiao Tian, Xinyi Xu, Patrick Jaillet, Bryan Kian Hsiang Low (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11889.txt.
Introduction
Rachael Hwee Ling Sim and five colleagues design the first system that locks in group fairness and rewards honesty in Bayesian learning. Current data valuation rewards sources for data as given, letting sources inflate rewards with copied or noisy data. Their design joins semivalues such as the Shapley value with an honest scoring rule based on a check set hidden from sources. Theory plus tests on mock and real data confirm it.
Catalog record
| CREATOR | Rachael Hwee Ling Sim, Jue Fan, Xiao Tian, Xinyi Xu, Patrick Jaillet, Bryan Kian Hsiang Low |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 148450 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11889
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Incentivizing Truthfulness and Collaborative Fairness in Bayesian Learning Rachael Hwee Ling Sim, Jue Fan, Xiao Tian, Xinyi Xu, Patrick Jaillet, Bryan Kian Hsiang Low Abstract Collaborative machine learning involves training high-quality models using datasets from a number of sources . To incentivize sources to share data, existing data valuation methods fairly reward each source based on its data submitted as is. However, as these methods do not verify nor incentivize data truthfulness, the sources can manipulate their data (e.g., by submitting duplicated or noisy data) to artificially increase their valuations and rewards or prevent others from benefiting. This paper presents the first mechanism that provably ensures ( F ) collaborative fairness and incentivizes ( T ) truthfulness at equilibrium for Bayesian models. Our mechanism combines semivalues (e.g., Shapley value), which ensure fairness, and a truthful data valuation function (DVF) based on a validation set that is unknown to the sources. As semivalues are influenced by others’ data, we introduce an additional condition to prove that a source can maximize its expected data values in coalitions and semivalues by submitting a dataset that captures its true knowledge. Additionally, we discuss the implications and suitable relaxations of ( F ) and ( T ) when the mediator has a limited budget for rewards or lacks a validation set. Our theoretical findings are validated on synthetic and real-world datasets. † † affiliationnotice: Equal contribution 1 Introduction In recent years, there has been more interest in applying collaborative machine learning (ML) 1 1 1 App. B.1 describes how our collaborative ML setting differs from the federated learning and crowd-sourcing settings. to build high-quality ML models ( 46 ) . Although an individual data source may have limited data, multiple sources when combined would have larger and more diverse data. For example, in healthcare, a local hospital with limited data diversity and quantity can draw on data from other hospitals to improve disease prediction ( 34 ; 28 ) . As another example, financial institutions can share data to build a more accurate fraud classification model ( 2 ) . Existing works ( 36 ; 27 ; 37 ; 42 ) have recognized that since data sources incur significant costs for data collection, they require incentives for collaboration. So, these works suggest how to provide incentives, such as ( F ) collaborative fairness which ensures that a source receives a higher monetary reward (or a more valuable model as a reward) by contributing more valuable data and enforces that a source’s reward should depend on others’ contribution (e.g., lower if its data is redundant due to similarity to others) ( 35 ) . The above existing works share a common limitation: They value the data submitted as is without incentivizing or verifying ( T ) truthfulness of the data. This limitation is problematic as untruthfulness can harm the performance of the jointly trained ML model, reduce the overall benefits of collaboration, and disincentivize truthful data sources who are unwilling to benefit harmful untruthful sources. In Sec. 3 and App. C.1 , we describe how untruthful data sources can submit duplicated data to artificially increase their valuations and rewards or introduce noise to their data to prevent others from benefiting. This raises the key question: [I] How can we define the data valuation function (DVF, which maps each dataset to a value) to prefer data that contributes to better model performance while incentivizing truthfulness ? Intuitively, the untruthful sources can artificially increase their data values/rewards if they had complete information about the DVF. For instance, knowing that only data size/cardinality matters, they can duplicate data to increase their rewards. Similarly, knowing the exact validation set, they can discard the irrelevant part of their datasets to better align with the validation set and increase their rewards ( 47 ) . To counter such strategies and incentivize ( T ) truthfulness, the DVF must be based on some information that remains unknown to all data sources and assumptions are needed. On the other hand, existing approaches that incentivize truthful data submission may not ensure ( F ) collaborative fairness . The approaches of 5 ; 47 value a source i based on the change in log-likelihood of others’ data and of a validation set after observing source i ’s dataset, respectively. ( T ) Truthful data submission leads to the highest expected data value compared to untruthful submissions. However, with only two data sources, peer prediction approaches (e.g., 5 ) may unfairly assign equal values to a smaller, less informative dataset and a more informative one. The approach of 47 may unfairly value a redundant source (with data similar to several others) equally with a unique data source that contributes a greater improvement in the log-likelihood after observing all sources’ datasets (App. B.2 ). Since these approaches do not enforce that a source’s reward depends on others’ contribution to achieve collaborative fairness, we pose the second question: [II] Can post-processing additionally ensure collaborative fairness while still preserving the truthfulness incentive? We show that it is possible with an additional assumption to address the influence of others’ data ( due to ensuring collaborative fairness) on truthfulness. Table 1 : Comparison of related works on ( F ) collaborative fairness, ( T ) truthfulness, ( O ) considering other incentives or constraints, and ( E ) multi-source experiments. Only ours simultaneously ensures fairness (Sec. 2 ), provably guarantees truthfulness (Sec. 3 ), and is empirically verified with multiple sources (Sec. 6 ). The \times marks DVFs that do not satisfy the fairness conditions (Sec. 2 ) or are proven to disincentivize truthfulness (App. C.1 ). Blank cells indicate no theoretical guarantees of ( T ) or no consideration of ( O/E ). However, some works may still demonstrate truthfulness empirically. More differences are highlighted in Secs. 1 and 7 . ( F ) ( T ) ( O ) ( E ) Ours ✓ ✓ ✓ ✓ 47 \times ✓ 36 ; 37 ✓ \times ✓ ✓ 5 \times ✓ ✓ 44 ✓ \times ✓ 12 ; 15 ; 43 ; 42 ✓ ✓ This paper seeks to fill the gap and achieve both ( T ) truthfulness and ( F ) collaborative fairness simultaneously (Fig. 4 ). We address [I] and ensure ( T ) by defining our DVF based on the log-likelihood of the validation set for Bayesian models. Next, to achieve ( F ), we decide the reward of each source based on the semivalues ( 9 ) of the cooperative game with all sources and the DVF as the characteristic function. We address [II] by proving the existence of a truthful equilibrium where every source maximizes its semivalue/reward by truthful data submission (on the condition that other sources are truthful). Lastly, we address the following question: [III] is it possible to incentivize (T) and (F) while simultaneously considering other incentives/constraints, e.g., when removing the need for a validation set? Our work generalizes that of 47 by addressing [II] and [III] . It also goes beyond existing data valuation methods based on validation accuracy ( 12 ; 15 ) and collaborative ML works that ensure ( F ) ( 36 ) by specifying reasonable assumptions required to