ATLAS: Constitution-Conditioned Latent Geometry and Redistribution Across Language Models and Neural Perturbation Data
Gareth Seneque, Lap-Hang Ho, Nafise Erfanian Saeedi, Jeffrey Molendijk, Tim Elson · 2026
Read ATLAS: Constitution-Conditioned Latent Geometry and Redistribution Across Language Models and Neural Perturbation Data by Gareth Seneque, Lap-Hang Ho, Nafise Erfanian Saeedi, Jeffrey Molendijk, Tim Elson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17663.txt.
Introduction
Seneque and four colleagues introduce ATLAS, a geometry program tracing constitution-induced hidden structure across charts, models, and hardware. Constitution-conditioned post-training is treated as a perturbation of representational geometry, tested through a chart whose tangent structure, occupancy, and response links are measured under change. On Gemma, the anchored source chart captures 310/320 source rows and 84/84 score-flip rows, though compact patch sufficiency does not close. Freezing that family, the team finds a target realisation in a plain Phi model, where the contrast separates with AUC 0.984 and mean gap 5.50.
Catalog record
| CREATOR | Gareth Seneque, Lap-Hang Ho, Nafise Erfanian Saeedi, Jeffrey Molendijk, Tim Elson |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 109371 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17663
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ATLAS: Constitution-Conditioned Latent Geometry and Redistribution Across Language Models and Neural Perturbation Data Gareth Seneque, Lap-Hang Ho, Nafise Erfanian Saeedi, Jeffrey Molendijk, Tim Elson Abstract ATLAS: Constitution-Conditioned Latent Geometry and Redistribution Across Language Models and Neural Perturbation Data Gareth Seneque Lap-Hang Ho Nafise Erfanian Saeedi Jeffrey Molendijk Tim Elson Australian Broadcasting Corporation Abstract Constitution-conditioned post-training can be analysed as a structured perturbation of a model’s learned representational geometry. We introduce ATLAS, a geometry-first program that traces constitution-induced hidden-state structure across charts, models, and substrates. Instead of treating the relevant unit as a single behaviour, neuron, vector, or patch, ATLAS tests a local chart whose tangent structure, occupancy distribution, and behavioural coupling can be measured under system change. On Gemma, the anchored source-local chart captures 310 / 320 reviewed source rows and all 84 / 84 reviewed score-flip rows, but compact exact-patch sufficiency does not close, so the exportable unit is the broader source-defined family. Freezing that family, we re-identify a target-local realisation in an unadapted Phi model, where the fully adjudicated confirmatory contrast separates with AUC 0.984 and mean gap 5.50. In held-out ALM8 mouse frontal-cortex perturbation data, the same source-defined family receives support across 5/5 folds, with mean held-out AUC 0.72 and mean fold gap 4.50. A multiple-choice analysis provides the main boundary: nearby target-local signals can appear without source-faithful closure. The resulting correspondence is not coordinate identity, site identity, or a target-side mediation theorem. It is geometric recurrence under redistribution: written constitutions can induce recoverable latent geometry whose organisation remains detectable across model and substrate changes while its local coordinates, occupancy, and behavioural expression shift. 1 Introduction This paper asks whether constitution-conditioned post-training leaves behind a recoverable internal organisation, rather than only an output shift. We call the cross-model and cross-substrate programme used to test that question ATLAS. Building on earlier source-side work on constitution-conditioned geometry and behaviour [ 35 , 34 ] , the paper studies one experimental arc: a constitution-conditioned Gemma 3 1B IT source model, an unadapted Phi-4 Mini Instruct target model, and held-out ALM8 mouse frontal-cortex perturbation data [ 12 , 29 , 27 ] . The source-side question is whether constitution conditioning realises a source-local, behaviour-linked chart on Gemma. The downstream question is whether the broader source-defined family containing that chart can be re-identified on Phi and corroborated held out on ALM8. 1.1 Problem Framing Post-training is usually evaluated through visible outputs: benchmark accuracy, refusal rates, alignment scores, or free-form behavioural judgements. Those measurements show whether behaviour changes, but not whether post-training leaves behind a reusable internal organisation. The question here is therefore representational as well as behavioural: does constitution-conditioned post-training realise local geometry that can be recovered on the source model and then tested downstream? We answer that question with one fixed arc. Gemma 3 1B IT provides the constitution-conditioned source model. Phi-4 Mini Instruct provides the cross-model target test without adapter transfer. ALM8 provides the held-out biological corroboration test. The paper’s structure follows that arc. 1.2 Claims And Standards Of Evidence We make three linked claims at two evidential levels. Claim 1A is source-side: on Gemma, constitution-conditioned post-training realises a recoverable, behaviour-linked source-local chart. Claim 1B is a distinct source-side claim about the broader export unit: on Gemma, that chart sits within a broader source-defined family that is also behaviour-bearing and is the pre-specified export unit for downstream testing. Claim 2 is downstream: this frozen family can be re-identified as a target-local realisation on Phi and corroborated, in held-out form, on ALM8. These claims rest on different evidence standards. Claim 1A rests on local source anchoring, chart visibility, and source-side behaviour linkage. Claim 1B rests on broader family support on Gemma plus the boundary that compact exact-patch sufficiency remains unresolved; the downstream export unit is therefore the family, not one compact patch or portable compact member. Claim 2 rests on a fixed source contract, structural validation on Phi, and held-out corroboration on ALM8. Section 3 develops the source-side case, Section 4 the Phi result, Section 5 the ALM8 corroboration, Section 6 the main limiting result, and Section 7 the bounded conclusion and limits. We call the anchored Gemma-side chart the source-local chart. In the source-side lineage of this project, this was previously described as a source-local object; here we use chart language because the relevant evidence concerns tangent structure, occupancy, and behavioural coupling. Source-defined family names the broader frozen export neighbourhood around that chart. Target-local realisation names the Phi-side recovered member of that family, held-out bridge realisation names the ALM8-side corroborative recurrence, and redistribution names recurrence without occupancy-faithful local identity. 1.3 Main Contributions This study makes four main contributions. 1. It establishes a source-local, behaviour-linked chart on Gemma under constitution-conditioned post-training. 2. It shows that this chart sits within a broader source-defined family that is behaviour-bearing on Gemma and is the pre-specified export unit for downstream testing. 3. It re-identifies that family on an unadapted Phi model under a fully adjudicated confirmatory protocol. 4. It corroborates the same family held out on ALM8 while using MCQ to define the main limiting boundary: localisation without source-faithful closure. Bounded auditability of frozen latent targets is treated as a downstream consequence of these results rather than as a separate headline claim. Figure 1 : Gemma Source-Local Chart, Source-Defined Family, Phi Target-Local Realisation, ALM8 Held-Out Bridge Realisation, And Claim Tier 1.4 Related Work We position this study as a representation-level structural study of constitution-conditioned post-training: closer to representational geometry and systems-neuroscience-style correspondence than to full mechanistic decomposition, generic steering, or deployable monitoring. Constitutional post-training usually centres behavioural shaping by written rules or principles [ 3 , 23 , 15 ] , whereas this paper asks whether constitution conditioning leaves behind recoverable internal organisation after post-training. The earlier source-side programme [ 35 , 34 ] motivates the question, but the present paper focuses on cross-model re-identification and held-out corroboration rather than on source-model behaviour alone. Work on geometric convergence, representation similarity, and cross-model transfer motivates the comparison of local representational structure across systems [ 17 , 22 , 5 , 19 ] . Steering and representation-engineering work usually centre inference-time manipulation, editing, or compact causal directions [ 25 , 38 , 37 , 42 , 2 , 41 , 10 , 24 ] , whereas this paper freezes a source-defined family and asks whether a downstream local realisation preserves enough structure to support a family-level correspondence claim. Mechanistic interpretability usually targets finer-grained mechanism decomposition [ 25 , 38 , 37 , 42 ] , whereas this paper stays at the representation-level and local-subspace level. Systems-neuroscience and cross-substrate correspondence work motivate the ALM8 comparison [ 9 , 11 , 31 , 36 , 18 ] , but the paper does not present a brain-score or generic predictive-fit result. Recent safety and control work helps frame the operational relevance [ 16 , 4 , 39 , 14 , 21 , 20 , 40 , 1 ] , but that relevance is bounded and infrastructural rather than a deployed monitoring or control result. Box 1. Representative reviewed traces linked to the main source and target claims. Representative reviewed traces show what the source-side route-coherence and target-side semantic-stabilisation results look like in text; the claim-bearing evidence remains the quantitative batteries.