ShapE-GRPO: Shapley-Enhanced Reward Allocation for Multi-Candidate LLM Training

Rui Ai, Yu Pan, David Simchi-Levi, Chonghuan Wang · 2026

Read ShapE-GRPO: Shapley-Enhanced Reward Allocation for Multi-Candidate LLM Training by Rui Ai, Yu Pan, David Simchi-Levi, Chonghuan Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-29871.txt.

Description

Ai and co-authors improve how group-based training rewards sets of model answers. Tasks like recommendation reward the whole set, not single items. Standard GRPO gives every candidate the same set-level score. Weak items then free-ride on one strong peer. Their ShapE-GRPO uses Shapley values to split the set reward per candidate. The split keeps the Shapley axioms yet stays cheap to compute. Tests across datasets beat standard GRPO and converge faster.

Catalog record

CREATORRui Ai, Yu Pan, David Simchi-Levi, Chonghuan Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62271
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.29871

Browse the full library · About the Tower of Babel