Mimetic Alignment with ASPECT: Evaluation of AI-inferred Personal Profiles Conference: ; ; CCS: Human-centered computing Collaborative and social computing systems and tools CCS: Human-centered computing Empirical studies in collaborative and social computing CCS: Human-centered computing User studies
Ruoxi Shang, Dan Marshall, Edward Cutrell, Denae Ford · 2026
Read Mimetic Alignment with ASPECT: Evaluation of AI-inferred Personal Profiles Conference: ; ; CCS: Human-centered computing Collaborative and social computing systems and tools CCS: Human-centered computing Empirical studies in collaborative and social computing CCS: Human-centered computing User studies by Ruoxi Shang, Dan Marshall, Edward Cutrell, Denae Ford (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-26922.txt.
Introduction
Shang and co-authors present ASPECT, a pipeline that builds personal communication profiles for AI agents. Agents writing for a person must match that person's real style. ASPECT has language models score validated communication traits against workplace behavior data. It needs no per-person training runs. In a study with 20 participants, the profiles matched self-assessments moderately well. Its drafted responses beat generic and self-report baselines overall, with wide variation. Linked evidence also helped participants spot and fix mischaracterizations of themselves.
Catalog record
| CREATOR | Ruoxi Shang, Dan Marshall, Edward Cutrell, Denae Ford |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 88238 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.26922
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mimetic Alignment with ASPECT: Evaluation of AI-inferred Personal Profiles Conference: ; ; CCS: Human-centered computing Collaborative and social computing systems and tools CCS: Human-centered computing Empirical studies in collaborative and social computing CCS: Human-centered computing User studies Ruoxi Shang, Dan Marshall, Edward Cutrell, Denae Ford Abstract . AI agents that communicate on behalf of individuals need to capture how each person actually communicates, yet current approaches either require costly per-person fine-tuning, produce generic outputs from shallow persona descriptions, or optimize preferences without modeling communication style. We present ASPECT (Automated Social Psychometric Evaluation of Communication Traits), a pipeline that directs LLMs to assess constructs from a validated communication scale against behavioral evidence from workplace data, without per-person training. In a case study with 20 participants (1,840 paired item ratings, 600 scenario evaluations), ASPECT-generated profiles achieved moderate alignment with self-assessments, and ASPECT-generated responses were preferred over generic and self-report baselines on aggregate, with substantial variation across individuals and scenarios. During the profile review phase, linked evidence helped participants identify mischaracterizations, recalibrate their own self-ratings, and negotiate context-appropriate representations. We discuss implications for building inspectable, individually scoped communication profiles that let individuals control how agents represent them at work. 1. Introduction AI agents are increasingly expected to communicate not just for people but as them: auto-replying to messages, attending meetings on a user’s behalf, or acting as conversational proxies when someone is unavailable ( 9 ; 34 ; 43 ) . For these agents to be useful, they must capture how a specific individual communicates, not produce a generic approximation ( 33 ; 24 ) . Unlike public figures with documented personas that models can learn from ( 7 ) , ordinary individuals have private, sparse, and context-dependent communication patterns. A person may be direct with peers and diplomatic with leadership, verbose in brainstorming and terse in status updates. Representing someone faithfully means capturing these patterns from their actual behavior. To date, existing approaches to personalization fall short. Persona prompting, where the model is given a short description of who to imitate, produces outputs that look superficially different but are similar across individuals ( 52 ; 8 ) . Per-person fine-tuning or preference-based alignment (RLHF, DPO) can capture individual patterns but requires substantial data and compute for each person, does not scale, and produces opaque models that the individual cannot inspect or adjust. We introduce ASPECT (Automated Social Psychometric Evaluation of Communication Traits) , a pipeline that uses LLMs guided by a validated psychometric scale to extract representative snippets from a person’s social interaction data and build a structured, evidence-grounded communication profile without per-person training. As each dimension score is linked to specific quotes and rationales, the profile is interpretable—the person can inspect where it is aligned or not. Whether such a profile is socially appropriate, however, can only be determined by the person it represents ( 25 ; 9 ; 21 ) . We therefore conducted a case study with 20 participants from a single organization to assess what the pipeline captures and where it falls short (Section 3.3 ). Each participant first reviewed their inferred profile against their own self-ratings, inspecting the behavioral evidence and rationales behind each construct. They then evaluated scenario-based responses generated under three conditions: Profiled (from ASPECT-inferred profile), Self-Report (based upon self-ratings only), and Generic (vanilla GPT with no personalization). Our evaluation reveals three key patterns: profiled responses were preferred over both baselines on aggregate, though with substantial individual and scenario variation; LLMs exhibited a consistent positivity bias, over-rating socially desirable traits; and profile review prompted participants to recalibrate their own self-ratings and negotiate context-appropriate representations. This paper contributes: (1) ASPECT , a profiling pipeline that operationalizes a validated psychometric instrument as a prompt-based data compression method, generating structured communication profiles that are portable across models and inspectable by the people they describe. (2) Empirical evidence from 20 participants providing the first systematic account of LLM-based communication profiling evaluated by the individuals being modeled, revealing that inference preserves relative profile shape but introduces predictable biases—findings that directly inform calibration strategies for future systems. (3) Design implications for human-in-the-loop profile negotiation: we demonstrate that evidence-linked review shifts profiling from a classification task to a collaborative negotiation, where individuals decide not just whether a profile is accurate but which version of themselves they want an agent to represent. 2. Related Work 2.1. From communication support to AI representation AI-mediated communication (AI-MC) systems help users communicate more effectively by modifying, augmenting, or generating messages for interpersonal objectives ( 21 ) . Applications include rewriting for empathy ( 49 ) , reframing negative perspectives ( 54 ) , smart reply suggestions ( 22 ) , persuasion enhancement ( 26 ) , conveying status ( 44 ) or trustworthiness ( 35 ) , promoting democratic discourse ( 1 ) , and increasing affectionate communication between partners ( 27 ) . In each case, the user remains the communicator; the AI operates on the message, not on the person’s behalf. A different line of work builds agents that communicate as individuals. Dittos are personalized embodied agents that attend meetings when users are unavailable ( 34 ) . Recent work has experimented with generative agents that simulate human behavior in virtual environments ( 41 ) and mimetic models predict specific individuals’ responses ( 37 ) . Platforms like Character.AI generate representations of public figures and fictional characters ( 7 ) . Public figures have documented personas that models can learn from. For ordinary individuals with private footprints, building an accurate representation remains an open problem, and these developments raise concerns about identity fragmentation, autonomy, and whether individuals can recognize and approve how AI speaks for them ( 33 ) . The dominant paradigm for aligning model behavior to users is preference-based optimization. RLHF ( 40 ) and DPO ( 46 ) train models to produce outputs that humans prefer, and recent personalized variants learn per-user reward functions from heterogeneous feedback ( 45 ; 6 ) . These methods address a different problem than ours. Preference alignment optimizes which output a user likes; style representation captures how a specific person communicates. A person might prefer concise AI responses while writing lengthy, discursive emails themselves. Preference-based methods also require hundreds to thousands of comparisons per individual, each encoding a binary signal along an unspecified axis, and produce opaque reward functions tied to specific model weights. Representing someone’s communication style for social contexts requires a structured, interpretable profile that the person can inspect and adjust. Closest works to ours are agent simulations initialized from survey data reproduce behaviors for over 1,000 individuals ( 42 ) , and general user models infer structured beliefs from everyday computer use traces ( 48 ) . However, these aforementioned approaches do not typically use observational data and experiment with profiling for social communication contexts as we do in our approach. 2.2. Building structured profiles of individuals Design personas compress user segments into qualitative narratives that ground coordination across teams ( 39 ) . Psychometric instruments take a complementary approach: they decompose individual behavior into quantitative, theory-backed constructs that can be reliably measured and compared across people ( 13 ; 15 ) . The Big Five personality model, for example, captures individual