Whose Alignment? Comparing LLM Process Alignment Across Diverse Organizational Decision Contexts

Niklas Weller, Emilio Barkett · 2026

Read Whose Alignment? Comparing LLM Process Alignment Across Diverse Organizational Decision Contexts by Niklas Weller, Emilio Barkett (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25256.txt.

Introduction

Niklas Weller and Emilio Barkett ask whether a language model follows an organization's own decision rules, not just its final verdicts. Their process-alignment yardstick shows wide variation across models, tracking neither price nor general test scores. In European human-rights rulings, closer process match predicts more accurate outcomes, and spelling out past policy lifts weak models. In credit decisions, alignment stays low and models resist the firm's weighting of protected traits, so tighter matching is not always desirable.

Catalog record

CREATORNiklas Weller, Emilio Barkett
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE40097
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25256

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Whose Alignment? Comparing LLM Process Alignment Across Diverse Organizational Decision Contexts Niklas Weller, Emilio Barkett Abstract Steerable pluralism requires a model to faithfully represent one specified perspective. Organizations are a natural setting for this demand, since they deploy LLMs to make decisions that must reflect their own policy. Yet, most existing work fixes that perspective at the level of individuals or demographic groups. We rely on a decision-policy capturing method to measure process alignment in organizational settings, assessing whether an LLM faithfully reproduces the organization’s decision policy rather than merely reaching the same conclusions. We find heterogeneity along two axes. Across models, baseline alignment varies strongly and tracks neither pricing nor general benchmark performance. Across organizations, the structure of alignment changes. In ECHR Article 6 decisions, process alignment predicts output accuracy ( r = 0.85 r=0.85 , p < .001 p<.001 ), and making the organization’s past decision policy explicit improves poorly aligned models. In consumer credit decisions, process alignment is low overall but varies more than output accuracy, and the models resist adopting the organization’s weighting of protected attributes. Because historical credit decisions encode potentially discriminatory patterns, higher alignment there is not always desirable. Process-level measurement is therefore necessary, and depending on whether the target policy is normatively desirable, the same procedure can calibrate or audit a model. Deciding which policy to align to, and whether higher alignment is feasible or desirable, makes organizational alignment a pluralistic problem in its own right. † † affiliationnotice: Equal contribution 1 Introduction Pluralistic alignment asks how AI systems can faithfully serve stakeholders with diverse, conflicting values rather than converging on a single dominant worldview ( Sorensen et al. 2024 ) . Most work in this space focuses on between-person plurality: aggregating individual preferences, handling annotation disagreements, or enabling models to adopt different user perspectives. We argue that between-organization plurality is an equally important but largely neglected dimension. Organizations encode values as historically contingent decision policies, and these policies differ systematically across organizations, domains, and time. Artificial intelligence (AI) models vary in which organizational value systems they implicitly align with, and this variation is not captured by any existing pluralistic alignment evaluation framework. Recognizing between-organization plurality expands the scope of pluralistic alignment from whose individual preferences? to whose institutional norms? This question has direct consequences for how AI systems are deployed, audited, and governed in high-stakes settings. Organizations are repositories and integrators of knowledge accumulated through experience, routines, culture, and institutional history ( Walsh & Ungson 1991 ; Grant 1996 ) . Some of this knowledge is explicit: rules, policies, codified procedures. Much is tacit: embedded in practice and professional judgment, resistant to full articulation ( Polanyi 1966 ; Pakarinen & Huising 2025 ; Nonaka 1994 ) . When organizations deploy large language models (LLMs) to decide in line with their intentions and values, they implicitly assume they can transfer this knowledge to a model. The tacit dimension resists explicit transfer. This creates a problem that reaches beyond output accuracy. Due to differences in effective contextual knowledge, an LLM can reach the right decision for the wrong reasons, weighting information differently than the organization while still achieving adequate accuracy on the output metrics ( Geirhos et al. 2020 ) . We refer to this divergence as process misalignment: a mismatch between organizational and LLM cue-utilization policies that output agreement alone may fail to detect. To operationalize and measure decision process divergence, we rely on a methodology inspired by the Brunswik Lens Model ( Brunswik 1952 ; Hammond et al. 1964 ) . This allows us to estimate and compare the cue-weighting policy as a proxy for the decision process of both organizations and LLMs from observed decisions. We then compute cosine similarity between these policy vectors as the primary alignment metric. Similar procedures are well-established for studying expert judgment in clinical, educational, and managerial domains ( Karelaia & Hogarth 2008 ; Karren & Barringer 2002 ) . For example, Smith et al. 2003 use its symmetric structure to compare normative guidelines for clinical depression-treatment against individual practitioners’ prescribing policies, surfacing cue-weighting differences in the decision-policy. We adopt the same comparative move, with an organizational policy derived from past decisions in place of the guidelines (alignment target) and an LLM in place of the individual practitioner. In the following, we refer to this method as the Contextualized Alignment Lens Model (CALM) and apply it in two domains: Study 1 (ECHR): We analyze 1,000 ECHR Article 6 decisions from the collection released by Chalkidis et al. 2021 across ten LLM models under three prompting conditions. We find sharp variation in baseline process alignment and show that explicit knowledge externalization substantially improves alignment for poorly-aligned models. Study 2 (German Credit): We analyze decisions on consumer credit risk using the German Credit Dataset ( Hofmann 1994 ) . Unlike the legal domain, the credit benchmark is derived from historical decisions that encode potentially discriminatory patterns. While the models perform poorly overall, we find that process alignment differs more than output accuracy and knowledge externalization fails to reliably improve alignment, which is partly caused by the models resisting to adjust their weighting of protected attributes. This is a distinctively pluralistic challenge: whose values should the model align to? Together, these studies reveal heterogeneity in organizational alignment along two axes. Across models, baseline alignment varies widely and tracks neither pricing nor general-purpose benchmark performance, so the choice of model is itself a choice among organizational value systems. Across organizations, the relationship between process alignment and output accuracy is unstable: strong and steerable in the legal domain, unreliable and resistant to intervention in the credit domain. The cross-domain contrast is the clearest instance of this between-organization plurality, the second axis our framework makes visible. This plurality forces a normative question that output-level evaluation cannot surface: which policy the model should align to, and whether higher alignment is desirable when the target encodes contested values. A related question, which we return to in the discussion, is whether a model’s stated reasoning reflects the behavioral policy CALM estimates. We treat CALM as one instantiation of process-level measurement, and we expect that pluralistic alignment will require a family of such tools. We further argue that organizational steerability should become a design target for foundation models, and we outline a benchmark for it as future work. 2 Background 2.1 The Brunswik Lens Model The operationalization of the Brunswik lens model ( Brunswik 1952 ; Hammond et al. 1964 ) represents judgment as a linear combination of observable cues: J=\beta_{0}+\sum_{i}\beta_{i}C_{i} , where C_{i} are cues and \beta_{i} are learned weights. Originally developed for human decision-makers, it measures ecological validity (do cues genuinely predict outcomes?) and achievement (do the decision-maker’s weights match ecological realities?). Applied to our setting of organizations and LLMs, it reveals whether they weight the same cues in the same direction and magnitude. This way, it provides a measure for whether their observed behavioral policies are aligned. Meta-analytic evidence confirms that human judges systematically misweight cues relative to ecological validities ( Karelaia & Hogarth 2008 ) ; the same divergence between stated and behavioral weights appears when comparing organizational guidelines to individual practitioners’ actual decisions ( Smith et al. 2003 ) . 2.2

Read the complete text