ShapE-GRPO: Shapley-Enhanced Reward Allocation for Multi-Candidate LLM Training
Rui Ai, Yu Pan, David Simchi-Levi, Chonghuan Wang · 2026
Read ShapE-GRPO: Shapley-Enhanced Reward Allocation for Multi-Candidate LLM Training by Rui Ai, Yu Pan, David Simchi-Levi, Chonghuan Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29871.txt.
Description
Ai and co-authors improve how group-based training rewards sets of model answers. Tasks like recommendation reward the whole set, not single items. Standard GRPO gives every candidate the same set-level score. Weak items then free-ride on one strong peer. Their ShapE-GRPO uses Shapley values to split the set reward per candidate. The split keeps the Shapley axioms yet stays cheap to compute. Tests across datasets beat standard GRPO and converge faster.
Catalog record
| CREATOR | Rui Ai, Yu Pan, David Simchi-Levi, Chonghuan Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62271 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.29871