Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI
Sharan Maiya, Henning Bartsch, Nathan Lambert, Evan Hubinger · 2025
Read Open Character Training: Shaping the Persona of AI Assistants through Constitutional AI by Sharan Maiya, Henning Bartsch, Nathan Lambert, Evan Hubinger (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01689.txt.
Introduction
Sharan Maiya, Henning Bartsch, Nathan Lambert, and Evan Hubinger open up a stage of chatbot development. Industry uses it, but academia has barely studied it. It is character training: the deliberate shaping of an AI assistant's persona. That covers its apparent values, beliefs, and manner. They present the first open implementation, built on Constitutional AI.
Their pipeline fine-tunes models on synthetic introspective data, text in which the assistant reflects on its own character, rather than relying on system prompts or activation steering. Three open-weights models were trained into 11 example personas, from humorous and deeply caring to malevolent. A revealed-preference analysis shows the personas took hold coherently. They held up against adversarial prompting better than the prompt- and steering-based alternatives. Standard capability benchmarks were barely affected. The full method is released as open source.
Catalog record
| CREATOR | Sharan Maiya, Henning Bartsch, Nathan Lambert, Evan Hubinger |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 120 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-01689