PICon : A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistency

Minseo Kim Sujeong Im Junseong Choi Junhee Lee Chaeeun Shim Edward Choi · 2026

Read PICon : A Multi-Turn Interrogation Framework for Evaluating Persona Agent Consistency by Minseo Kim Sujeong Im Junseong Choi Junhee Lee Chaeeun Shim Edward Choi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-25620.txt.

Description

Kim and co-authors introduce PICon, a test of whether persona agents stay consistent. Persona agents are language models that play the role of a set character. PICon questions them over many turns with logically chained prompts. It checks self-consistency, agreement with real-world facts, and stability when questions repeat. The team tested seven groups of agents and 63 human participants. They report that even strong agents fell below the human baseline on all three checks. Chained questions exposed contradictions and evasive replies.

Catalog record

CREATORMinseo Kim Sujeong Im Junseong Choi Junhee Lee Chaeeun Shim Edward Choi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61531
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.25620

Browse the full library · About the Tower of Babel