Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI

Sharan Maiya, Henning Bartsch, Nathan Lambert, Evan Hubinger · 2025

Read Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI by Sharan Maiya, Henning Bartsch, Nathan Lambert, Evan Hubinger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01689.txt.

Introduction

Sharan Maiya, Henning Bartsch, Nathan Lambert, and Evan Hubinger open up a stage of chatbot development. Industry uses it, but academia has barely studied it. It is character training: the deliberate shaping of an AI assistant's persona. That covers its apparent values, beliefs, and manner. They present the first open implementation, built on Constitutional AI.

Their pipeline fine-tunes models on synthetic introspective data, text in which the assistant reflects on its own character, rather than relying on system prompts or activation steering. Three open-weights models were trained into 11 example personas, from humorous and deeply caring to malevolent. A revealed-preference analysis shows the personas took hold coherently. They held up against adversarial prompting better than the prompt- and steering-based alternatives. Standard capability benchmarks were barely affected. The full method is released as open source.

Catalog record

CREATORSharan Maiya, Henning Bartsch, Nathan Lambert, Evan Hubinger
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE120 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-01689

Browse the full library · About the Tower of Babel