Out of Control - Why Alignment Needs Formal Control Theory (and an Alignment Control Stack)

Elija Perrier · 2025

Read Out of Control - Why Alignment Needs Formal Control Theory (and an Alignment Control Stack) by Elija Perrier (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-17846.txt.

Introduction

Elija Perrier argues a position in a 2025 paper on AI alignment. Alignment means steering advanced AI to act as humans intend. Perrier holds that formal control theory, the math used to steer machines, should sit at the center of that work. Current safety and inner-model studies, the paper says, lack the broad reach that control frames give other fields.

The paper sets out an Alignment Control Stack. The stack runs from physical layers up to social and technical ones. Each layer lists what can be measured and what controls can be applied. Layers must also work with each other in a formal way. Perrier says such a stack is key to the proof that regulators will need.

Catalog record

CREATORElija Perrier
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE93 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-17846

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Out of Control - Why Alignment Needs Formal Control Theory (and an Alignment Control Stack) Elija Perrier Abstract This position paper argues that formal optimal control theory should be central to AI alignment research, offering a distinct perspective from prevailing AI safety and security approaches. While recent work in AI safety and mechanistic interpretability has advanced formal methods for alignment, they often fall short of the generalisation required of control frameworks for other technologies. There is also a lack of research into how to render different alignment/control protocols interoperable. We argue that by recasting alignment through principles of formal optimal control and framing alignment in terms of hierarchical stack from physical to socio-technical layers according to which controls may be applied we can develop a better understanding of the potential and limitations for controlling frontier models and agentic AI systems. To this end, we introduce an Alignment Control Stack which sets out a hierarchical layered alignment stack, identifying measurement and control characteristics at each layer and how different layers are formally interoperable. We argue that such analysis is also key to the assurances that will be needed by governments and regulators in order to see AI technologies sustainably benefit the community. Our position is that doing so will bridge the well-established and empirically validated methods of optimal control with practical deployment considerations to create a more comprehensive alignment framework, enhancing how we approach safety and reliability for advanced AI systems. 1 Introduction Current AI alignment research is a vast enterprise incorporating technical, engineering, theoretical and socio-technical approaches to governance of AI systems. In particular, AI safety and security research has explored various avenues, including empirical evaluations of AI control protocols ( Greenblatt2023aicontrol ; Korbak2025sketch ) , assessing subversion capabilities ( Mallen2024subversion ) , developing adaptive deployment strategies for untrusted models ( Wen2024adaptive ) , and mitigating specific threats like steganographic collusion ( Mathew2024steganography ) . These works, along with research into mechanistic interpretability christiano2022mechanistic ; zou2023representation ; Sharkey2025openproblems and alignment and AI safety more generally, aim to make AI systems safer and more understandable. While these contributions are valuable, this paper posits that there are two systematic gaps in the AI alignment and control literature requiring attention: (a) the formalisation problem : much alignment research - even technical research - is often confined to empirical observations about specific models and lacks formalisation common in control literature. This makes it difficult to generalise results or compare techniques in rigorous ways; (b) the alignment coordination problem - alignment as a concept covers theoretical and applied engineering disciplines all the way to socio-technical fields. There is a lack of a clear layered control taxonomy to help organise where in the AI stack (from physical circuitry to the socio-technical) controls are directed at, how each layer of control interacts vertically and horizontally (when multiple systems are involved). Position : To address these gaps, our position argues for: 1. Alignment Control Stacks to address the coordination problem : that alignment research ought to adopt a stack-based model that clearly specifies where in the overall AI stack alignment and control are directed. 2. Control theory to solve the formalisation problem : that alignment research ought to integrate better principles of formal control theory - even where a layer or element of the stack is difficult to formalise or uncertain , control theory provides useful tools for estimating the uncertain degree of control which is useful in risk assessments. Combining a structured hierarchical taxonomy of alignment with formal control methods we believe will assist in facilitating a more coherent approach to alignment research and enable greater clarity regarding interoperability of control proposals. To this end our Position paper sets out: (a) an example of the technical control stack denoted the Alignment Control Stack - a hierarchical taxonomy that indicates the level at which measurement and control are directed; and (b) examples of how formal control frameworks can complement emerging AI control protocols and research. Layer Category Controls Description L1: Physical Hardware Networks Storage Voltage, Scheduling Concurrency, loading, topology Prefetching, caching Compute control exercised by adjusting physical hardware parameters e.g. power, concurrency settings, caching properties etc. L2: Software OS Kernel Runtime Distribution Scheduling, resource limits Heap size limits, timeouts Circuit breakers, retries Control over software infrastructure e.g. OS kernel, runtime services and distribution tooling. L3: AI framework DL Software Training Infra. Inference Hyperparameters, early stopping Synchronisation, aggregation rules Prefetching, caching Control via choice of SDE / ML packages, training infrastructure pipelines and inference methods (e.g. RL versus others). L4: Architecture Topology Parameters Comp Graphs Search, pruning, quantisation Weight initialisation, regularisation Graph rewriting, memory opt. Control via design of architecture configurations e.g. topology (how components connected), model parameters, computational graphs L5: Training Pipeline Optimisers Monitoring Data validation, error detection Adaptive learning, grad smoothing Early stopping, param. tuning Control via training parameters, including data preprocessing, learning protocols, gradient methods etc. L6: Behavioural Performance Robustness Calibration Performance thresholds, response vals Adversarial training, conf. thresh. Temperature scaling, uncert. reject. Control at behavioural level via adversarial methods, imposing thresholding, filtering, calibration L7: Interpretability State Circuits Explanations Activation settings, state validation Ablations, activation steering Consistency, explan. metrics Control exercised via interpretability e.g. via controlling activations, state validation requirements, consistency metrics L8: Rewards Goals Mitigation Trust Reward models, preference elicit. Safety classification, risk scoring Truth verification Control exercised via mechanism design and incentive/reward architecture, risk scoring or requiring truth validation L9: Agents Communication Group Behav. Joint Action Comms. protocols, mechanism design Group formation, consensus rules Trust calibration, interface design Agentic control via infrastructure, ontology, consensus requirements, constraining agent tool use etc. L10: SocioTech Economic Beliefs Governance Impact assessment, deployment Misinformation testing, bias testing Monitoring, auditing, reporting Control via sociotechnical mechanisms including public policy, tailoring economic incentives, governance of information dissemination etc Figure 1 : Alignment Control Stack (ACS). The Alignment Control Stack details a vertically hierarchical set of layers at which various forms of control may be utilised, ranging from the physical circuitry level (e.g. compute control) through to control via model hyperparameters, model behavioural testing (e.g. adversarial methods) and socio-technical measures (governance). 1.1 Control is Ubiquitous Formal control theory, encompassing concepts like system modelling (state-space representations), controller synthesis, stability analysis (e.g., Lyapunov theory), robust control (e.g., \mathcal{H}_{\infty} ), reachability analysis, and game-theoretic formulations for adversarial settings, provides a powerful toolkit for analysing and ensuring the safe behaviour of complex systems ( Berkovitz1995 ; goodfellow2019research ) . The principles of control theory are not limited to a single aspect of AI system design or operation. Rather, they can be conceptualised as a full stack of potential interventions and measurement points, spanning from the lowest levels of physical hardware to the highest levels of societal interaction and emergent multi-agent phenomena. This holistic view recognises that AI systems are complex, multi-layered entities, and opportunities for enhancing safety, reliability, and alignment through control exist at each layer. For instance, at the physical infrastructure layer, control methods might involve thermal management or workload scheduling - essentially controlling compute capability. Moving up the stack, system software controls may include resource quotas or sandboxing. At the AI framework and model architecture layers, controls like learning rate scheduling, regularization, or even architectural choices (e.g., pruning, quantization) are common. The training process itself

Read the complete text