Soft-SVeRL: Self-Verified Reinforcement Learning with Soft Rewards

name=Saurabh Dash, affiliation=1, name=Pierre Clavier, affiliation=2, name=John Dang \lone, affiliation=1, name=Matthias Galle \ltwo, affiliation=1, name=Marzieh Fadaee, affiliation=1, name=Ahmet Üstün, affiliation=2, name=Beyza Ermis, affiliation=1 · 2026

Read Soft-SVeRL: Self-Verified Reinforcement Learning with Soft Rewards by name=Saurabh Dash, affiliation=1, name=Pierre Clavier, affiliation=2, name=John Dang \lone, affiliation=1, name=Matthias Galle \ltwo, affiliation=1, name=Marzieh Fadaee, affiliation=1, name=Ahmet Üstün, affiliation=2, name=Beyza Ermis, affiliation=1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28561.txt.

Description

Saurabh Dash and six colleagues introduce Soft-RLVR, learning from decomposed verification signals for partially verifiable tasks. Many prompts carry several requirements, and responses may meet only some. Soft-RLVR turns each prompt into a checklist, scores responses item by item, and trains on the soft reward. Checklist rewards densify sparse pass-fail signals but can reward incomplete responses. Self-verification needs stabilization against reward inflation, and controlled tests show IFEval gains up to about eleven points.

Catalog record

CREATORname=Saurabh Dash, affiliation=1, name=Pierre Clavier, affiliation=2, name=John Dang \lone, affiliation=1, name=Matthias Galle \ltwo, affiliation=1, name=Marzieh Fadaee, affiliation=1, name=Ahmet Üstün, affiliation=2, name=Beyza Ermis, affiliation=1
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81365
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28561

Browse the full library · About the Tower of Babel