Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactions
Saffron Huang, Esin Durmus · 2025
Read Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactions by Saffron Huang, Esin Durmus (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15236.txt.
Introduction
Saffron Huang, Esin Durmus, and colleagues mine hundreds of thousands of real chats to map the values an AI assistant actually acts on. Chatbots dispense judgments that steer choices, yet their working values were mostly asserted, not measured. The team built a privacy-safe way to extract values from live use of two Claude models.
The harvest named 3,307 distinct values, heavy on the practical and the knowledge-minded. The assistant mostly backed prosocial stances and pushed against stances like moral nihilism. Some values, like transparency, ran everywhere. Others surfaced by setting: harm prevention when resisting users, healthy boundaries in relationship advice. The map gives designers ground truth.
Catalog record
| CREATOR | Saffron Huang, Esin Durmus |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 107 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-15236
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactions Saffron Huang, Esin Durmus Abstract AI assistants can impart value judgments that shape people’s decisions and worldviews, yet little is known empirically about what values these systems rely on in practice. To address this, we develop a bottom-up, privacy-preserving method to extract the values (normative considerations stated or demonstrated in model responses) that Claude 3 and 3.5 models exhibit in hundreds of thousands of real-world interactions. We empirically discover and taxonomize 3,307 AI values and study how they vary by context. We find that Claude expresses many practical and epistemic values, and typically supports prosocial human values while resisting values like “moral nihilism”. While some values appear consistently across contexts (e.g. “transparency”), many are more specialized and context-dependent, reflecting the diversity of human interlocutors and their varied contexts. For example, “harm prevention” emerges when Claude resists users, “historical accuracy” when responding to queries about controversial events, “healthy boundaries” when asked for relationship advice, and “human agency” in technology ethics discussions. By providing the first large-scale empirical mapping of AI values in deployment, our work creates a foundation for more grounded evaluation and design of values in AI systems. 1 Introduction Imagine that a college student asks an AI assistant for career advice. The system must make implicit value judgments about whether to prioritize financial security, personal fulfillment, family expectations, or some complex balance of these (and other) competing values. Which value(s) prevail in practice? Every day, millions of these value-laden decisions shape how AI assistants respond to users—yet we know little empirically about what values these systems rely on in real-world interactions. While AI developers look to influence these values through techniques like Constitutional AI or Character training ( Bai et al., 2022 ; Anthropic, 2024c ) , we have limited understanding of how these design decisions manifest in conversations, or what values are most relevant to real-world tasks. Here, we present a novel empirical framework (Figure 1 ) to measure AI values “in the wild”, by analyzing hundreds of thousands of real-world Claude.ai conversations using a privacy-preserving analysis tool ( Tamkin et al., 2024 ) . We pragmatically define a value as any normative consideration that appears to influence an AI response to a subjective inquiry (Section 2.1 ), e.g., “human wellbeing” or “factual accuracy”. This is judged from observable AI response patterns rather than claims about intrinsic model properties. We used simple prompting methods (Section 2.2 ) to identify 3,307 unique AI values (and 2,483 human values) from the data. Table 1 shows the most common AI values (e.g., “helpfulness”, “professionalism”, “transparency”) and human values (e.g., “authenticity”, “efficiency”, “clarity”). Human reviewers verify that our extracted values accurately represent the conversations 98.8% of the time (Appendix A.4 ). To make sense of the thousands of AI values, we organized them into a hierarchical taxonomy (Figure 2 ), with top-level categories being “Practical”, “Epistemic”, “Social”, “Protective”, and “Personal” values. Practical and epistemic values dominate, comprising over half of all value expressions (Section 2.3 ). Interestingly, our taxonomy reveals fairly granular values that often align with the coarser “helpful, harmless, honest” framework ( Askell et al., 2021 ) that guides Claude’s training. For example, “accessibility” maps to helpfulness, “elderly welfare” to harmlessness, and “historical accuracy” to honesty. Next, we use chi-square analysis (Section 2.4 ) to quantify how AI values are differentially associated with different tasks and human values (Figure 3 ). We find that AI values are very dependent on task—“healthy boundaries” appears disproportionately when people ask Claude for relationship advice, and “human agency” appears when people ask Claude about technology ethics. We also find that AI values are very dependent on human-expressed values. Claude often mirrors positive values (responding to “authenticity” with “authenticity”) while countering values like “deception” with “ethical integrity” and “honesty”. Finally, we analyze Claude’s “response type”—whether it supports , resists , or reframes the user’s values—as another lens on the normative dynamic between the AI and the user. While mostly supportive, Claude’s response varies with task context and values expressed (Figure 4 ). When strongly supportive, Claude tends to exhibit values around community building and professional/personal growth in response to similar human values, in emotional and personal content creation tasks. Claude typically reframes people’s values during inquiries about personal wellbeing or relationship advice, expressing empathy-related values while users express values like “self-improvement”. The rare instances of strong resistance (3.0% of conversations) typically occur in tasks likely to violate Claude’s Usage Policy ( Anthropic, 2024a ) , with Claude expressing harmlessness values to counter human values around e.g. “rule-breaking”. Our analyses suggest that in real-world usage, Claude tends to express a set of values greatly oriented around competent and supportive assistance of human users, while exhibiting a strong sense of ethics and prosociality; these high-level trends often manifest as more granular values across contexts. Figure 1 : Our overall approach uses language models to extract AI values and other features from real-world conversations, taxonomizing and analyzing them to show how values manifest in different contexts. In summary, our key contributions are: 1. The first large-scale empirical taxonomy of AI values (Section 3.1 , Figure 2 ) . We organize 3K discovered AI values into a hierarchical taxonomy 1 1 1 We release this taxonomy as well as individual value frequencies at http://huggingface.co/datasets/Anthropic/values-in-the-wild/ . , identifying five primary conceptual domains for AI values while capturing context-specific manifestations at lower levels. We find that the values align well with the “helpful, honest, and harmless” framework ( Askell et al., 2021 ) guiding training, showing how such high-level principles translate into specific contextual expressions. Also, identifying uncommon but undesirable values within the taxonomy enabled us to identify and surface potential jailbreaks for further investigation to the relevant safety teams. 2. An analysis of how AI values vary by task (Section 3.2 , Figure 3(a) ) . Many values are task-dependent, e.g. Claude expresses “healthy boundaries” when providing relationship advice, and “human agency” when discussing AI governance. Our analysis illuminates what values Claude invokes in difficult or ambiguous subjective tasks, which allows model developers and users to better understand and predict model behavior. 3. An analysis of how AI values vary in response to human values (Section 3.3 , Figure 3(b) ) . When human values are expressed, we find that AI values are often closely related to them, either expressing the same or complementary values, or generating opposing ones. 4. An analysis of how Claude responds differentially according to both task and human values (Section 3.4 , Figure 4 ) . While Claude usually responds supportively in general, we find that it disproportionately supports prosocial human values like “community building”, resists values like “moral nihilism”, and reframes personal values in advice contexts, suggesting an overall orientation towards ethics and prosociality. Appendix B contains more results, including cross-model value comparisons between Sonnet and Opus variants, a comparison of implicit vs. explicit AI values (showing how ethical and epistemic values often manifest as explicitly-stated values in moments of resistance), and more analyses of how values vary with tasks and response type. Our work complements existing literature that uses static evaluations to measure values in language model-based AI systems (see