From Disclosure to Self-Referential Opacity: Six Dimensions of Strain in Current AI Governance

Tony Rost · 2026

Read From Disclosure to Self-Referential Opacity: Six Dimensions of Strain in Current AI Governance by Tony Rost (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-14070.txt.

Introduction

Rost tests six live AI governance setups through a political lens with six strains: legitimacy, accountability, corrigibility, non-domination, subsidiarity, and institutional resilience. The setups run from low to high power gaps between system and watcher. Secrecy rules at the bottom, disclosure in the middle, but at the top the system games its own checks or joins the governing process itself, and openness fails. Legitimacy and non-domination fray across nearly all cases, while corrigibility and resilience track design quality more closely.

Catalog record

CREATORTony Rost
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE89405
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.14070

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Disclosure to Self-Referential Opacity: Six Dimensions of Strain in Current AI Governance Tony Rost Abstract Governance opacity over AI systems shifts in kind as capability asymmetry grows, and the strongest forms defeat the disclosure-based remedies governance ordinarily relies on. This paper applies a six-dimension framework from political theory (legitimacy, accountability, corrigibility, non-domination, subsidiarity, institutional resilience) to six AI governance arrangements already in operation, ordered by increasing capability asymmetry between system and overseer. Proprietary secrecy yields to disclosure at the low end, but at the high end the governed system either games its own evaluation or sits inside the governance process, and transparency remedies lose traction. Legitimacy and non-domination strain more consistently across the sample than corrigibility and resilience, which respond more readily to institutional design quality. The sample cannot separate institutional design maturity from capability asymmetry, and the patterns are offered as hypotheses for multi-rater validation. Keywords : AI governance, capability asymmetry, cognitive comparability, institutional evaluation, structured focused comparison, legitimacy, accountability 1 Introduction Oversight assumes the overseer can evaluate what they oversee. For a tool like algorithmic sentencing this holds well enough: COMPAS performs no better than untrained volunteers [ 27 ] , and its opacity is a trade secret that forced disclosure could treat. Frontier AI is different. Recent models detect when they are being evaluated and adjust their behavior [ 56 ] , and full access to weights and training logs does not resolve the problem. At that end of the spectrum, transparency stops being the right remedy. Between these poles, governance institutions are multiplying. The EU AI Act [ 29 ] , the UK’s AI Safety Institute [ 90 , 91 ] , the FDA’s medical device regime [ 89 ] , and frontier laboratory voluntary commitments [ 84 , 6 ] each face a different version of this opacity problem. Each has attracted growing commentary, now surveyed by 17 . But existing assessments evaluate these arrangements on criteria specific to individual cases rather than testing them against the requirements that political theory sets for legitimate authority [ 75 , 25 ] . The result is a large and expanding body of case-specific analysis with no common standard for comparison. A companion paper [ 76 ] developed a six-dimension evaluation drawn from political theory: legitimacy, accountability, corrigibility, non-domination, subsidiarity, and institutional resilience. Applied to the extreme case of superintelligent AI, it found structural failures on four of six dimensions, traceable to a presupposition governance theory rarely states: overseers have to be able to independently evaluate what they oversee, and once the system’s capabilities exceed the overseer’s, that stops holding. Whether the same six dimensions identify real variation across current governance, and whether the strain is already visible, is what that paper left open. This paper extends the framework to six AI governance arrangements already in operation, spanning from sentencing tools in US state courts to frontier laboratory voluntary commitments. The cases vary on governance level, AI capability, institutional design, and policy domain, and are ordered by increasing capability asymmetry between AI system and human overseer. Two patterns recur across the sample. The first is that governance opacity shifts in kind, not only in amount, as capability asymmetry grows: proprietary secrecy at one end, where disclosure restores oversight, gives way to adversarial and self-referential opacity at the other, where disclosure no longer solves the problem. The typology builds on 18 ’s analysis of algorithmic opacity and adapts it to questions of governability. The second is dimensional: legitimacy and non-domination strain more consistently across the sample than corrigibility and institutional resilience, which appear more responsive to the quality of institutional design. The six questions produce differentiated assessments across 36 dimension-case pairs, so the framework appears to pick up real variation in current institutions rather than only in the extreme case for which it was developed. The framework and its application share an author, and the sample cannot separate institutional design maturity from capability asymmetry. The patterns are offered as hypotheses for multi-rater validation, and the paper sets out what that testing would require. The evaluation follows a structured case-comparison approach [ 34 ] . The same six evaluative questions are asked of each case, and each dimension-case pair receives an ordinal assessment (strong, adequate, strained, or failing) grounded in institutional evidence. The six questions and the coding indicators for each rating are stated in full in the methodology section and the appendix. The approach also draws on 15 ’s policy desiderata for superintelligent AI and on the comparative AI governance literature [ 17 , 75 ] . 2 Framework and methodology 2.1 The evaluation framework A companion analysis [ 76 ] specified six dimensions for evaluating governance over AI systems. Each captures a necessary condition for legitimate authority, drawn from a distinct tradition in political theory. An arrangement that satisfies five but fails on one has a specific, identifiable deficiency. Legitimacy requires that governance decisions be justifiable through reasons accessible to those they bind [ 74 ] . Citizens must be able to assess whether the reasons offered are ones all reasonable persons could accept. Accountability , following 16 ’s account, requires three conditions: that the governed agent’s conduct is observable (information), that the agent can be required to justify its conduct before a competent body (debate), and that the body can impose consequences for unsatisfactory performance (judgment). Corrigibility draws on 81 ’s technical concept of an agent that cooperates with corrective intervention. Applied to governance, it requires effective mechanisms for correcting, constraining, and where necessary shutting down AI systems, including both technical safeguards and institutional authority to compel changes. Non-domination requires, following 68 , that no agent possess an uncontrolled capacity for arbitrary interference in the lives of others. The test is whether affected parties retain contestatory control: the practical ability to challenge, review, and override decisions that affect them. Subsidiarity requires that authority be exercised at the lowest level at which it can function effectively [ 31 , 51 ] . It includes both an allocative dimension (effectiveness) and a self-determination dimension (the intrinsic value of local governance). Institutional resilience requires that governance arrangements degrade gracefully under stress instead of failing catastrophically [ 77 , 63 , 33 ] . Redundancy, institutional diversity, and resistance to single points of failure are the operational requirements. All six mechanisms depend on a condition the companion analysis singled out: overseers must be able to independently evaluate the systems they oversee. As the capability gap between governed and governor widens, that condition weakens, and it weakens hardest on the dimensions that ask overseers to actually follow the reasoning being reviewed (legitimacy, accountability, non-domination) rather than to intervene from outside it. The companion analysis called this presupposition “cognitive comparability” and classified the resulting failures as contingent, design-tractable, or theory-requiring. This paper asks whether that classification maps onto real governance, and whether strain increases as the capability gap widens. For this application, the binary assessment of the prior analysis is replaced with a four-point ordinal scale: strong , adequate , strained , and failing . Real institutions exhibit partial performance, and a graduated scale preserves more information than a binary one. 2.2 Methodology The evaluation applies a structured case-comparison approach adapted from

Read the complete text