Training Data Efficiency in Multimodal Process Reward Models
Jinyuan Li, Chengsong Huang, Langlin Huang, Shaoyang Xu, Haolin Liu, Wenxuan Zhang, Jiaxin Huang · 2026
Read Training Data Efficiency in Multimodal Process Reward Models by Jinyuan Li, Chengsong Huang, Langlin Huang, Shaoyang Xu, Haolin Liu, Wenxuan Zhang, Jiaxin Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04145.txt.
Description
Reward models that grade each reasoning step are hungry for labeled data. Jinyuan Li and 6 co-authors show much of that data is redundant. Their 2026 paper studies training data efficiency for multimodal process reward models, which supervise visual reasoning step by step using Monte Carlo annotations.
Random subsampling saturated performance quickly, signaling waste. Their theory says informative updates depend on the mix of positive and negative steps and on label reliability. A Balanced-Information Score ranks existing data by both factors at no extra annotation cost. Subsets chosen by the score matched or beat full-data training on two model backbones, cutting the annotation bill for step-level supervision.
Catalog record
| CREATOR | Jinyuan Li, Chengsong Huang, Langlin Huang, Shaoyang Xu, Haolin Liu, Wenxuan Zhang, Jiaxin Huang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04145