PluralisticBehaviorSuite : Stress-Testing Multi-Turn Adherence to Custom Behavioral Policies
Prasoon VarshneyNVIDIA [email protected], Makesh Narsimhan SreedharNVIDIA [email protected] Liwei JiangNVIDIA [email protected] Traian RebedeaNVIDIA [email protected] Christopher ParisienNVIDIA [email protected] · 2025
Read PluralisticBehaviorSuite : Stress-Testing Multi-Turn Adherence to Custom Behavioral Policies by Prasoon VarshneyNVIDIA [email protected], Makesh Narsimhan SreedharNVIDIA [email protected] Liwei JiangNVIDIA [email protected] Traian RebedeaNVIDIA [email protected] Christopher ParisienNVIDIA [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05018.txt.
Description
Prasoon Varshney and co-authors present PB Suite, a test suite that checks if language models stick to custom behavior rules over long chats. Most models are tuned to one broad set of public norms, yet firms must follow their own brand, legal, and ethics rules.
The suite holds 300 realistic behavior policies drawn from 30 fields of work. Its live test frame stresses how well a model holds those rules turn after turn in a chat. The work gives a shared way to grade fit with local values, not just global safety norms.
Catalog record
| CREATOR | Prasoon VarshneyNVIDIA [email protected], Makesh Narsimhan SreedharNVIDIA [email protected] Liwei JiangNVIDIA [email protected] Traian RebedeaNVIDIA [email protected] Christopher ParisienNVIDIA [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 73 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-05018