PluralisticBehaviorSuite : Stress-Testing Multi-Turn Adherence to Custom Behavioral Policies

Prasoon VarshneyNVIDIA [email protected], Makesh Narsimhan SreedharNVIDIA [email protected] Liwei JiangNVIDIA [email protected] Traian RebedeaNVIDIA [email protected] Christopher ParisienNVIDIA [email protected] · 2025

Read PluralisticBehaviorSuite : Stress-Testing Multi-Turn Adherence to Custom Behavioral Policies by Prasoon VarshneyNVIDIA [email protected], Makesh Narsimhan SreedharNVIDIA [email protected] Liwei JiangNVIDIA [email protected] Traian RebedeaNVIDIA [email protected] Christopher ParisienNVIDIA [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-05018.txt.

Description

Prasoon Varshney and co-authors present PB Suite, a test suite that checks if language models stick to custom behavior rules over long chats. Most models are tuned to one broad set of public norms, yet firms must follow their own brand, legal, and ethics rules.

The suite holds 300 realistic behavior policies drawn from 30 fields of work. Its live test frame stresses how well a model holds those rules turn after turn in a chat. The work gives a shared way to grade fit with local values, not just global safety norms.

Catalog record

CREATORPrasoon VarshneyNVIDIA [email protected], Makesh Narsimhan SreedharNVIDIA [email protected] Liwei JiangNVIDIA [email protected] Traian RebedeaNVIDIA [email protected] Christopher ParisienNVIDIA [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-05018

Browse the full library · About the Tower of Babel