PerMix-RLVR: Preserving Persona Expressivity under Verifiable-Reward Alignment
Jihwan Oh, Soowon Oh, Murad Aghazada, Minchan Jeong, [0.2em] MyeongSeok Kang, Sungnyun Kim, Se-Young Yun, [0.5em] KAIST AI · 2026
Read PerMix-RLVR: Preserving Persona Expressivity under Verifiable-Reward Alignment by Jihwan Oh, Soowon Oh, Murad Aghazada, Minchan Jeong, [0.2em] MyeongSeok Kang, Sungnyun Kim, Se-Young Yun, [0.5em] KAIST AI (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08986.txt.
Description
Oh and five colleagues tackle persona prompting's robustness-fidelity trade-off. Assigning a character steers a language model, but the best persona costs time to find and its quality effect stays unclear. Prior fixes search prompts at inference, adding compute. Training with verifiable rewards dulls persona sensitivity and flattens expression in role-play. Their PerMix-RLVR method mixes personas during training, preserving robustness to shifts and faithful adoption where needed. It lifts persona stability by about 21 percent on MATH500 and fidelity by about 11 percent on PersonaGym.
Catalog record
| CREATOR | Jihwan Oh, Soowon Oh, Murad Aghazada, Minchan Jeong, [0.2em] MyeongSeok Kang, Sungnyun Kim, Se-Young Yun, [0.5em] KAIST AI |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 91980 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.08986