InftyThink + : Effective and Efficient Infinite-Horizon Reasoning via Reinforcement Learning

Yuchen Yan, Liang Jiang, Jin Jiang, Shuaicheng Li, Zujie Wen, Zhiqiang Zhang, Jun Zhou, Jian Shao, Yueting Zhuang, Yongliang Shen · 2026

Read InftyThink + : Effective and Efficient Infinite-Horizon Reasoning via Reinforcement Learning by Yuchen Yan, Liang Jiang, Jin Jiang, Shuaicheng Li, Zujie Wen, Zhiqiang Zhang, Jun Zhou, Jian Shao, Yueting Zhuang, Yongliang Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06960.txt.

Description

Yuchen Yan and nine co-authors tackle the cost of long chains of thought in reasoning models. Stretching a chain grows cost in a quadratic way, hits context limits, and lets key facts get lost in the middle. Summing up thoughts at intervals helps, but old methods do not learn when to sum up, what to keep, or how to pick back up. Their system, InftyThink+, learns the whole iterative path by reward training.

Training runs in two stages: a taught cold start, then path-level reward learning, so the model learns smart summing-up and continuation choices. On a distilled reasoning model it lifted accuracy on a math test by 21 percent and clearly beat usual long-chain reward learning, while carrying over better to out-of-distribution tests. It also cut run-time lag and sped up training, pairing stronger reasoning with better efficiency.

Catalog record

CREATORYuchen Yan, Liang Jiang, Jin Jiang, Shuaicheng Li, Zujie Wen, Zhiqiang Zhang, Jun Zhou, Jian Shao, Yueting Zhuang, Yongliang Shen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE157 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-06960

Browse the full library · About the Tower of Babel