AGPO: Adaptive Group Policy Optimization with Dual Statistical Feedback

Miaobo Hu, Bokun Wang, Shuhao Hu, Ruohan Wang, Xin Wang, Xiaobo Guo, Daren Zha, Jun Xiao · 2026

Read AGPO: Adaptive Group Policy Optimization with Dual Statistical Feedback by Miaobo Hu, Bokun Wang, Shuhao Hu, Ruohan Wang, Xin Wang, Xiaobo Guo, Daren Zha, Jun Xiao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20722.txt.

Description

Miaobo Hu and seven colleagues propose AGPO, an adaptive group policy optimization method for language-model reasoning. Standard PPO and GRPO methods use fixed clipping and fixed decoding temperature, which renders training brittle and tuning-heavy. AGPO employs group-level statistics to control both update size and exploration, with adaptive clipping driven by reward spread, skewness, and entropy signals. Bidirectional temperature sampling heats or cools decoding around a base value, and tests show gains on maths benchmarks.

Catalog record

CREATORMiaobo Hu, Bokun Wang, Shuhao Hu, Ruohan Wang, Xin Wang, Xiaobo Guo, Daren Zha, Jun Xiao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29448
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20722

Browse the full library · About the Tower of Babel