No More, No Less: Least-Privilege Language Models

Paulius Rauba, Dominykas Seputis, Patrikas Vanagas, Mihaela van der Schaar · 2026

Read No More, No Less: Least-Privilege Language Models by Paulius Rauba, Dominykas Seputis, Patrikas Vanagas, Mihaela van der Schaar (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-23157.txt.

Introduction

Paulius Rauba and three co-authors apply the least-privilege principle to language model services. In security, least privilege means granting only the minimum access a request needs. Deployed models rarely follow it: one endpoint serves every user and every request at full power.

That gap persists not because limits would be useless, but because they are hard to build. The authors argue deployments would gain much from cutting needless capability exposure. Least-privilege design could shrink the damage from misuse and prompt attacks. A single open endpoint is the anti-pattern named here, exposing full capability to every request regardless of need.

Catalog record

CREATORPaulius Rauba, Dominykas Seputis, Patrikas Vanagas, Mihaela van der Schaar
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-23157

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

No More, No Less: Least-Privilege Language Models Paulius Rauba, Dominykas Seputis, Patrikas Vanagas, Mihaela van der Schaar Abstract Least privilege is a core security principle: grant each request only the minimum access needed to achieve its goal. Deployed language models almost never follow it, instead being exposed through a single API endpoint that serves all users and requests. This gap exists not because least privilege would be unhelpful—deployments would benefit greatly from reducing unnecessary capability exposure. The real obstacle is definitional and mechanistic: what does “access” mean inside a language model, and how can we enforce it without retraining or deploying multiple models? We take inspiration from least privilege in computer systems and define a class of models called least-privilege language models , where privilege is reachable internal computation during the forward pass. In this view, lowering privilege literally shrinks the model’s accessible function class (as opposed to denying access via learned policies). We formalize deployment-time control as a monitor–allocator–enforcer stack, separating (i) request-time signals, (ii) a decision rule that allocates privilege, and (iii) an inference-time mechanism that selects privilege. We then propose Nested Least-Privilege Networks , a shape-preserving, rank-indexed intervention that provides a smooth, reversible control knob. We show that this knob yields policy-usable privilege–utility frontiers and enables selective suppression of targeted capabilities with limited collateral degradation across various policies. Most importantly, we see this as a defense of a completely new deployment paradigm which challenges the premise that we can only have output-level control of language models. 1 Introduction \blacktriangleright “The LLM provided simple instructions for how to cultivate Yersinia pestis, the bacterium that causes plague.” \blacktriangleright “The potential for an unknown, grave biological threat propelled or even generated by LLMs cannot be ruled out.” The above are two citations, verbatim, from the results of a red-team study on the operational risks of AI in large-scale biological attacks ( 41 ) . The fact that language models can provide information that is dangerous is by now well understood. While we have made progress with safeguards ( 59 ) , we currently must accept a daunting prospect: over a billion people use language models every day ( 31 ) , and these models possess, in principle , access to information that can pose harm to the overall population. (a) (A) Deployment-time control via least privilege. Request-time signals s(x) (risk, uncertainty, telemetry) are mapped by a privilege allocator \phi to a control g . A capability enforcer applies T_{g} inside the forward pass , inducing an effective deployed policy \pi_{\theta,g} while preserving the external interface. The key shift is from output filtering to explicit control over which internal computations are reachable. (b) (B) Shape-preserving, rank-indexed enforcement. Internal linear maps are re-parameterized with a nested factorization so that a deployer-set knob g selects a prefix of the factors. This yields a monotone family W(g) with \mathrm{rank}(W(g))\leq g and fixed tensor shapes, recovering the baseline computation at g_{\max} . The result is a reversible, fine-grained inference-time control interface compatible with pretrained models. Figure 1 : Least-privilege inference as an internal control problem. (A) At deployment, the model parameters are fixed, but the amount of internal capability exercised need not be. Separating signals , allocation , and enforcement exposes a concrete action space for controllers: choose how much computation the model is allowed to use for each request. (B) We instantiate enforcement with rank-indexed, shape-preserving interventions that operate inside the forward pass. Together, these panels define a deployer-facing control surface on which allocation policies can be evaluated by utility, privilege cost, and runtime overhead. The reason this is dangerous is that, prior to the era of language models, access to such information was highly safeguarded. Developing dangerous biological weapons, for example, typically required an extremely high level of educational attainment, possibly a PhD in chemistry, which functioned as an implicit barrier to adoption. That barrier is now vanishing. The key risk of language models leaking information is not that this information does not exist elsewhere (it clearly does), but that it can be explained relatively easily to anyone, with step-by-step instructions that remove these educational barriers. As a result, we face an extremely uncomfortable situation: if language models provide dangerous information to a malicious actor, it can be used against the public in life-threatening ways. While the risk may be small in any single interaction, with over a billion people using language models, the cumulative risk compounds rapidly. What can we do about this? Three approaches have dominated the community’s efforts to address this issue. Firstly , numerous training- and post-training-time methods to improve alignment have been developed. These include removing harmful data from training sets ( 43 ; 34 ) , using human feedback as a signal to make models helpful via reinforcement learning ( 4 ; 30 ; 16 ) or related techniques ( 46 ) , and safety-specific fine-tuning ( 13 ) , among others. Secondly , many output-level controls have been proposed. These include simple prompting strategies ( 65 ) , building “constitutions” ( 5 ) , or using rule-based methods to repair outputs deemed risky ( 23 ) , to name a few. Thirdly , there are activation-level approaches, such as activation steering ( 56 ; 55 ) , which enable control (“steering”) of model behavior at deployment time. However, such approaches are not fully satisfying. Superficially, we clearly observe that the risks still exist even in the presence of these approaches; that is, we have not yet solved the problem of language models revealing dangerous or unwanted information. Even more importantly, we are still left with the core problem. Even after training-time alignment, output filtering, and activation-level steering, the base model still retains the underlying capability, because the relevant computations remain encoded in its weights and can still be activated during inference under some prompts or sampling. Can we do better? We argue that the community has so far made one implicit assumption: that there are no ways to actively control and suppress actual model capabilities (i.e., language model policies) at test time in a manner that is fully reversible and adapted to each user. This assumption is also evident in how large AI firms, such as OpenAI and Anthropic, release their models: every user has access to the same base language model policy, with identical internal weights. This approach is natural: how could it be otherwise? After all, alternatives, such as deploying separate models with user-specific parameters, are inefficient and costly, while output-level control provides most guarantees. Yet this approach comes with a major sacrifice: language model policies always retain the same weights, which encode unwanted or unnecessary knowledge for a given task. In this work, we challenge the premise that we ought to accept this sacrifice. We argue that an alternative, so far unexplored solution to the deployment-time control problem is to reframe it as a least-privilege problem , following the principle of least privilege in computer science. That is, we aim to provide users only with the access they need for their specific tasks and suppress all other knowledge within the language model. No More, No Less . We call the extent of such knowledge “privilege.” Such deployment-time control should determine how much internal

Read the complete text