Evaluating Intra-firm LLM Alignment Strategies in Business Contexts
Noah Broestl, Benjamin Lange, Cristina Voinea, Geoff Keeling, Rachael Lam · 2025
Read Evaluating Intra-firm LLM Alignment Strategies in Business Contexts by Noah Broestl, Benjamin Lange, Cristina Voinea, Geoff Keeling, Rachael Lam (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18779.txt.
Introduction
Broestl and co-authors argue that firms must deliberately steer the viewpoints of their AI assistants in this 2025 paper. Instruction-tuned models now help with thinking work across companies. Their built-in perspectives shape decisions, teamwork, and culture.
Those perspectives come from training data biases and developer tuning goals. The authors frame in-house alignment as a strategic and ethical duty, warning about automation bias and weakened critical thinking. They propose three strategies: a supportive assistant that backs the firm's mission, an adversarial one that stress-tests ideas, and a diverse one that voices many stakeholder views. Each carries trade-offs for manager and peer relationships. The paper analyzes those trade-offs through business ethics.
Catalog record
| CREATOR | Noah Broestl, Benjamin Lange, Cristina Voinea, Geoff Keeling, Rachael Lam |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18779
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluating Intra-firm LLM Alignment Strategies in Business Contexts Noah Broestl, Benjamin Lange, Cristina Voinea, Geoff Keeling, Rachael Lam Abstract Instruction-tuned Large Language Models (LLMs) are increasingly deployed as AI Assistants in firms for support in cognitive tasks. These AI assistants carry embedded perspectives which influence factors across the firm including decision-making, collaboration, and organizational culture. This paper argues that firms must align the perspectives of these AI Assistants intentionally with their objectives and values, framing alignment as a strategic and ethical imperative crucial for maintaining control over firm culture and intra-firm moral norms. The paper highlights how AI perspectives arise from biases in training data and the fine-tuning objectives of developers, and discusses their impact and ethical significance, foregrounding ethical concerns like automation bias and reduced critical thinking. Drawing on normative business ethics, particularly non-reductionist views of professional relationships, three distinct alignment strategies are proposed: supportive (reinforcing the firm’s mission), adversarial (stress-testing ideas), and diverse (broadening moral horizons by incorporating multiple stakeholder views). The ethical trade-offs of each strategy and their implications for manager-employee and employee-employee relationships are analyzed, alongside the potential to shape the culture and moral fabric of the firm. 1 Boston Consulting Group 2 Ludwig-Maximilians-Universität München 3 Munich Center for Machine Learning 4 Uehiro Oxford Institute, University of Oxford 5 Google, Paradigms of Intelligence Team [email protected], [email protected], [email protected], [email protected], [email protected] 1 Introduction Instruction-tuned Large Language Models (LLMs) are increasingly deployed as general-purpose AI Assistants in firms. 1 1 1 The deployment of LLMs as general-purpose AI assistants is likely to apply more broadly to non-commercial organizations, but for the purposes of this paper we focus on AI Assistants deployed in firms. Generally, these systems are enterprise deployments of products like ChatGPT. These systems are used in tasks that could be broadly considered “thought partnership,” completing cognitive tasks that were previously completed by individuals or groups of employees acting in collaboration. AI Assistants are distinct from the use of Generative AI as a component of applications produced by the firms; for example, a non-AI Assistant application could be the integration of Generative AI into a tool that summaries unstructured data for compliance purposes. Enterprise deployments of ChatGPT-like products are generally provided out of the box with little to no modification. They are typically available to every member of the firm, and they are intended to increase productivity by supporting common use cases such as conducting research, editing documents, and brainstorming. These uses of LLMs allow employees to offload some of their cognitive tasks from drafting emails to strategic thinking. However, the impacts of AI assistants in firms are not limited to the output of individual content. Rather, AI assistants will shape the way employees interact and the culture of the entire firm as these impacts happen at scale. AI Assistants are now deeply embedded into workflows, so they have a strong influence on how decisions are made, and how colleagues relate to one another within a firm. But, as we show in this paper, AI Assistants embed distinct “perspectives”—that is, they exhibit behavioral dispositions which seep into decision-making processes, ultimately influencing how authority is exercised, how collaboration happens, and how employees and managers understand their roles, obligations, and relate to one another. This paper argues that firms are morally required to be intentional about how AI Assistants are developed and deployed. Alignment is a strategic and ethical imperative if and to the extent that firms want to retain control over their cultures ( Kaptein 2008 ) . Alignment, as we understand it, is not only a technical matter, but a fundamentally ethical and relational one. To that end, we argue for the need to understand the alignment of the perspectives of AI Assistants in relation to the objectives and values of firms. We propose three distinct strategies (supportive, adversarial, and diverse) for the deployment of AI Assistants and analyze the ethical trade-offs that stem from each strategy. We then show that the choice of strategy impacts intra-firm relational dynamics and thus requires an evaluation of how the specific norms governing manager-employee and employee-employee relationships will be shaped by the introduction of AI Assistants. The paper proceeds as follows. Section 2 develops a conception of what it means for an AI Assistant to have a perspective. Section 3 discusses where these perspectives may have an impact on the firms. Section 4 draws on scholarship in normative business ethics, to better characterize the intra-firm moral norms and significant intra-firm human relationships that AI Assistants are likely to affect. Against this backdrop, Section 5 then develops three AI Assistant alignment strategies and analyzes their ethical trade-offs. Section 6 concludes the discussion. 2 Perspectives of AI Assistants We can think of AI Assistants as having a perspective on the world. This perspective can be understood as a set of behavioral dispositions to address user queries in line with particular social, political, ethical or cultural biases. For example, an AI Assistant used in a political consultancy firm could be disposed to answer questions in line with neoconservative commitments. Furthermore, firms may find certain model perspectives more desirable than others—in this case, a political consultancy firm may want an AI Assistant that is disposed to answer questions in line with neoconservative commitments. Metaphysically, perspectives can be interpreted in two ways ( Shanahan, McDonell, and Reynolds 2023 ) . On a causal reading, an AI Assistant has some unique perspective that features in causal explanations of its behavior in roughly the same way that a human’s perspective might causally explain their behavior (e.g. Anne advised Beth to \varphi because Anne is a neocon, and the AI Assistant advised Beth to \varphi because the AI Assistant is a neocon). On an epiphenomenal reading, the perspective of an AI Assistant is not a cause of the AI Assistant’s behavior, but rather something that is read onto the AI Assistant’s behavior to interpret that behavior in a human-like way. On this latter picture, the AI Assistant begins a dialogue in a superposition over the set of possible perspectives, and this superposition narrows as the dialogue advances and additional consistency requirements are imposed on what perspectives the AI assistant can reasonably be interpreted as occupying. For example, if the AI Assistant outputs text that is out-of-line with neocon commitments, then it can no longer be interpreted as having a neocon perspective. Here we interpret perspectives in line with the causal reading. Perspectives, so understood, result primarily from the interplay of two classes of factors. 2 2 2 It may be the case that additional factors causally impact the perspective realized in LLMs; for example, model architecture decisions, hyperparameters used in training, and data pre-processing techniques ( Bender et al. 2021 ) Even so, the training distribution and Reinforcement Learning with Human Feedback (RLHF) objectives are plausibly the principal determinants of a model’s perspective in the minimal sense that these factors offer two of the most straightforward intervention points for explicitly engineering a perspective into the model. The first class of factors is biases encoded in the LLM that undergirds the AI Assistant. Biases in the distribution of pre-training data or in the pre-processing of pre-training data can result in LLMs being disposed to answer user queries in line with