Relative Principals, Pluralistic Alignment, and the Structural Value Alignment Problem \acmConference@name ( \acmConference@shortname ), \acmConference@date , \acmConference@venue Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada DOI: 10.1145/3805689.3812420 ISBN: 979-8-4007-2596-8/2026/06 CCS: Computing methodologies Philosophical/theoretical foundations of artificial intelligence CCS: Computing methodologies Machine learning CCS: Applied computing Sociology CCS: Applied computing Economics CCS: Social and professional topics CCS: Computing methodologies Distributed artificial intelligence CCS: Applied computing Psychology

Travis LaCroix · 2026

Read Relative Principals, Pluralistic Alignment, and the Structural Value Alignment Problem \acmConference@name ( \acmConference@shortname ), \acmConference@date , \acmConference@venue Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada DOI: 10.1145/3805689.3812420 ISBN: 979-8-4007-2596-8/2026/06 CCS: Computing methodologies Philosophical/theoretical foundations of artificial intelligence CCS: Computing methodologies Machine learning CCS: Applied computing Sociology CCS: Applied computing Economics CCS: Social and professional topics CCS: Computing methodologies Distributed artificial intelligence CCS: Applied computing Psychology by Travis LaCroix (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-20805.txt.

Introduction

LaCroix argues that the value alignment problem for AI is better seen as a structural question about governance. The real question is how much alignment, for whom, and at what price. He borrows the principal-agent framework from economics, tracing misalignment to three linked axes: objectives, information, and principals. It clarifies that alignment is not a single tech trait but an outcome shaped by aims, information, and stakes. It must be managed through formal steps that set aims, check systems, and let groups contest calls.

Catalog record

CREATORTravis LaCroix
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64746
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.20805

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Relative Principals, Pluralistic Alignment, and the Structural Value Alignment Problem \acmConference@name ( \acmConference@shortname ), \acmConference@date , \acmConference@venue Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada DOI: 10.1145/3805689.3812420 ISBN: 979-8-4007-2596-8/2026/06 CCS: Computing methodologies Philosophical/theoretical foundations of artificial intelligence CCS: Computing methodologies Machine learning CCS: Applied computing Sociology CCS: Applied computing Economics CCS: Social and professional topics CCS: Computing methodologies Distributed artificial intelligence CCS: Applied computing Psychology Travis LaCroix Abstract . The value alignment problem for artificial intelligence (AI) is often framed as a purely technical or normative challenge, sometimes focused on hypothetical future systems. I argue that the problem is better understood as a structural question about governance: not whether an AI system is aligned in the abstract, but whether it is aligned enough, for whom, and at what cost. Drawing on the principal-agent framework from economics, this paper reconceptualises misalignment as arising along three interacting axes: objectives, information, and principals. The three-axis framework provides a systematic way of diagnosing why misalignment arises in real-world systems and clarifies that alignment cannot be treated as a single technical property of models but an outcome shaped by how objectives are specified, how information is distributed, and whose interests count in practice. The core contribution of this paper is to show that the three-axis decomposition implies that alignment is fundamentally a problem of governance rather than engineering alone. From this perspective, alignment is inherently pluralistic and context-dependent, and resolving misalignment involves trade-offs among competing values. Because misalignment can occur along each axis—and affect stakeholders differently—the structural description shows that alignment cannot be “solved” through technical design alone, but must be managed through ongoing institutional processes that determine how objectives are set, how systems are evaluated, and how affected communities can contest or reshape those decisions. † † cc-license: by 1. Introduction The value alignment problem for artificial intelligence (sometimes called “AI alignment” or “agent alignment”) is commonly described as the challenge of ensuring that AI systems act in accordance with human intentions or values ( 67 ; 11 ; 27 ) . However, this standard description underdetermines the problem since it does not specify what or whose values are (or ought to be) considered the proper targets of alignment. To ask whether a system is aligned requires understanding for whom it is aligned, to what degree, and according to what standard. This highlights that alignment is not merely a technical problem, to be solved through engineering or normative encoding, nor is it a philosophical or sociological problem of determining the “correct” values; instead, it is a relational and evaluative judgment that depends on whose values are prioritised, how trade-offs are made, and how degrees of alignment are measured. In practice, contemporary alignment research aims to address a wide range of concrete problems in existing machine learning (ML) systems via reinforcement learning from human feedback (RLHF) and robustness, interpretability, and evaluation methods for deployed models. At the same time, however, discussions of alignment have historically emerged out of theoretical concerns about highly capable, hypothetical future systems such as artificial general intelligence (AGI) or superintelligence. 1 1 1 For example, 31 suggests that the alignment problem “refers to the challenge of ensuring that AI systems behave as their creators intend, especially when the systems become more intelligent and capable than their human designers …[because as] AI systems become more intelligent, they may develop goals and values that differ from those of their creators, which could lead to unexpected and potentially harmful outcomes” (p. 77). See also, ( 16 ; 64 ; 25 ; 14 ; 41 ; 5 ; 4 ) . 19 highlights that most “concerns in the literature about the difficulty of aligning hypothetical future AGI systems to human values are motivated by the risk of ‘instrumental convergence’ of those systems” (p. 10). See, e.g., ( 8 ; 9 ; 60 ; 75 ; 73 ; 40 ; 59 ; 5 ) . A comprehensive survey is provided in 46 . While these debates have clarified important conceptual issues, their intellectual legacy can sometimes obscure the fact that problems of misalignment already arise in present-day systems and must be addressed within existing institutional and governance structures. Similarly, discussions of alignment are typically abstract, meaning they do not provide guidance for practical solutions grounded in the real-world functioning of these systems. Although some strands of alignment research are practical and engineering-focused, the normative, governance, and institutional dimensions of alignment—e.g., how competing stakeholders define alignment objectives, how evaluation standards are set, and how accountability mechanisms operate—remain comparatively under-theorised. Recent scholarship has sought to refine the standard definition by distinguishing between its normative and technical components ( 27 ) , differentiating inner and outer forms of alignment ( 44 ) , or separating forward- and backward-facing approaches to addressing misalignment ( 46 ) . While such distinctions add conceptual precision, they do not in themselves yield practical methods for mitigating misalignment. For example, identifying a “normative” dimension of the problem acknowledges that questions of value are central; however, this acknowledgement itself offers no framework for deciding which values ought to guide AI systems or why they should be prioritised. Likewise, distinguishing between forms of misalignment is analytically useful, but it does not explain how the underlying normative issues should be addressed. This conceptual ambiguity motivates the present analysis: rather than proposing new technical alignment methods, this paper seeks to clarify the structural conditions under which instances of the alignment problem can arise across socio-technical contexts. 2 2 2 Importantly, this perspective complements rather than replaces existing technical work. Techniques such as RLHF, interpretability tools, dataset governance practices, and benchmarking frameworks represent concrete efforts to mitigate misalignment in deployed systems. The claim here is that understanding how these techniques function within broader socio-technical environments requires conceptual frameworks that explicitly account for pluralistic values, informational asymmetries, and institutional power relations. What is needed is clarity on value alignment as a class of problems, rather than a single, unified challenge. Instead of asking which values are the “correct” objects of alignment and how those values can be encoded, it is more productive to ask under what conditions value misalignment tends to arise generally . That is to say, what is the structure of the value alignment problem, and in what contexts is it truly a problem? Reframing the question in this way reveals that the challenge of aligning values is not unique to AI, but rather a special case of more general coordination problems among agents with differing goals and information. In light of this challenge, I present a structural definition of the value alignment problem for AI, grounded in the principal-agent framework from economics. According to this model, value misalignment emerges in human-AI interactions whenever (a) the objectives of the AI system are mis-specified, or (b) informational asymmetries exist between (human) principals and (artificial) agents. Hence, misalignment can occur along three orthogonal, but interacting, axes: (1) objectives, (2) information, and (3) principals. These three axes provide a diagnostic framework for analysing why alignment failures occur in practice. Misalignment along the objectives axis arises when

Read the complete text