Soft-SVeRL: Self-Verified Reinforcement Learning with Soft Rewards
name=Saurabh Dash, affiliation=1, name=Pierre Clavier, affiliation=2, name=John Dang \lone, affiliation=1, name=Matthias Galle \ltwo, affiliation=1, name=Marzieh Fadaee, affiliation=1, name=Ahmet Üstün, affiliation=2, name=Beyza Ermis, affiliation=1 · 2026
Read Soft-SVeRL: Self-Verified Reinforcement Learning with Soft Rewards by name=Saurabh Dash, affiliation=1, name=Pierre Clavier, affiliation=2, name=John Dang \lone, affiliation=1, name=Matthias Galle \ltwo, affiliation=1, name=Marzieh Fadaee, affiliation=1, name=Ahmet Üstün, affiliation=2, name=Beyza Ermis, affiliation=1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28561.txt.
Description
Saurabh Dash and six colleagues introduce Soft-RLVR, learning from decomposed verification signals for partially verifiable tasks. Many prompts carry several requirements, and responses may meet only some. Soft-RLVR turns each prompt into a checklist, scores responses item by item, and trains on the soft reward. Checklist rewards densify sparse pass-fail signals but can reward incomplete responses. Self-verification needs stabilization against reward inflation, and controlled tests show IFEval gains up to about eleven points.
Catalog record
| CREATOR | name=Saurabh Dash, affiliation=1, name=Pierre Clavier, affiliation=2, name=John Dang \lone, affiliation=1, name=Matthias Galle \ltwo, affiliation=1, name=Marzieh Fadaee, affiliation=1, name=Ahmet Üstün, affiliation=2, name=Beyza Ermis, affiliation=1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81365 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28561