TTVS: Boosting Self-Exploring Reinforcement Learning via Test-time Variational Synthesis

Sikai Bai, Haoxi Li, Jie Zhang, Yongjiang Liu, Song Guo · 2026

Read TTVS: Boosting Self-Exploring Reinforcement Learning via Test-time Variational Synthesis by Sikai Bai, Haoxi Li, Jie Zhang, Yongjiang Liu, Song Guo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08468.txt.

Description

Bai and four colleagues let large reasoning models improve at test time without labeled data, using only the unlabeled test questions themselves. Their TTVS framework turns static questions into varied but equivalent versions, then balances accuracy seeking use of strong variants with consistency seeking exploration across them. Across eight model designs it beat other test time methods and even supervised rivals trained on vast labeled data.

Catalog record

CREATORSikai Bai, Haoxi Li, Jie Zhang, Yongjiang Liu, Song Guo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42729
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.08468

Browse the full library · About the Tower of Babel