Same Weights, Different Robot: A Deployment Safety View of VLA Policies

Jianwei Tai · 2026

Read Same Weights, Different Robot: A Deployment Safety View of VLA Policies by Jianwei Tai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03724.txt.

Introduction

Tai argues that a robot policy is more than its model weights. Vision-language-action policies are often treated as checkpoint-defined. Same weights, prompt, and benchmark are taken to mean the same deployment. Robot execution breaks that idea. One normalized output can become a different physical action after unnormalization and controller rules apply. Safety review can thus certify the checkpoint yet miss the real policy.

The executable policy includes the model, the action form, the unnormalizer picked by metadata, and controller conventions. Identical checkpoints can be executable-inequivalent under this view. A closed-form transform quantifies drift from metadata mismatch. An ExecSpec certificate measures action-space drift without running the model. On LIBERO replay tests, swapping one metadata key cuts success from perfect to near zero. The checks rule out simpler explanations for the drop. Deployment teams should treat action metadata as part of the policy itself.

Catalog record

CREATORJianwei Tai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03724

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Same Weights, Different Robot: A Deployment Safety View of VLA Policies Jianwei Tai Abstract Vision-language-action (VLA) policies are often treated as checkpoint-defined objects: if the weights, prompt, and benchmark suite match, the deployment is assumed to be the same policy. Robot execution breaks this assumption because the same normalized model output can become a different physical action after action unnormalization and controller conventions are applied. This creates a deployment-safety gap: safety review can certify the checkpoint while missing the executable robot policy that reaches the controller. We formalize this gap as an executable policy specification problem: a VLA policy includes the learned model, action representation, metadata-selected unnormalizer, and controller-facing conventions. Under this view, identical checkpoints can be executable-inequivalent. For quantile-style action normalization, we derive a closed-form metadata mismatch transform and an ExecSpec certificate that measures action-space semantic drift without model inference or rollout. On LIBERO-Goal replay, substituting a plausible sibling metadata key yields mean drift 0.199 over six non-gripper action dimensions and reduces success from 28/28 to 2/28 under full substitution. On LIBERO-Spatial replay, the same substituted key reduces success from 26/26 to 0/26. The same full-substitution protocol gives 0/28 success for all four Object substitutions and 0/23 or 1/23 success on Long. Identity-key, replay-validity, no-op filtering, raw-vs-correct replay, mask/gripper, synthetic upper-bound, and OpenVLA-style unnormalizer interface checks rule out several simpler explanations. These results do not certify closed-loop or hardware safety. They support a narrower deployment-safety view: action-space metadata is part of the executable policy and should be checked before rollout. 1 Introduction Vision-language-action (VLA) policies are moving robot control toward a checkpoint-centric deployment model. A policy is downloaded, paired with a processor, given an instruction, and expected to emit actions in a benchmark or robot environment. This workflow makes model weights the visible unit of reproducibility and safety review. A deployment is often cleared for evaluation once the checkpoint hash, prompt template, and benchmark suite match a tested artifact. For robots, that assumption is a deployment-safety risk, not merely a bookkeeping problem. The model output is not the physical action. Between the normalized action representation and the controller lies an executable specification: image preprocessing, action token decoding, action unnormalization, gripper convention, control frequency, and sometimes chunk execution. These components define the controller-facing semantics of the action space. When they are omitted from the policy object, the same weights and the same normalized outputs can instantiate a different executable robot policy: the controller receives different physical actions even though the checkpoint appears unchanged. This paper studies one concrete instance of that safety boundary: action normalization metadata. In many VLA and imitation-learning pipelines, the model emits normalized action coordinates, and a dataset-specific key selects quantile statistics used to map those coordinates back to physical actions. Such metadata is easy to treat as a configuration detail. It is also easy to copy from a sibling dataset, checkpoint, or suite. The resulting error is a silent interface failure: generated tokens and normalized actions remain unchanged, yet the deployment executes a different robot policy. This is precisely the kind of mismatch that a pre-rollout safety audit should detect before policy quality or hardware behavior is evaluated. The point is not simply that an incorrect statistic can cause a bad run. The paper’s object is policy identity: any field that changes the controller-facing action law is part of the executable policy, even when it is stored outside the neural checkpoint. Under this view, metadata mismatch is a pre-deployment executable non-equivalence, not merely a post-hoc configuration bug. It can therefore be checked as a specification condition before a model is rolled out. We argue that action normalization metadata is a safety-relevant component of the executable policy. This is not a claim that every metadata mismatch is catastrophic, nor that normalization is the only hidden deployment hazard. The claim is sharper: if a deployment changes the action unnormalizer while holding the model and normalized action sequence fixed, it changes the executable policy. For quantile normalizers this change is a closed-form affine transform in physical action space. It can be measured before model inference, simulation rollout, or robot execution. The safety issue is that this transform can cross task margins. Manipulation safety is often margin-based: approach direction, contact velocity, rotation, and gripper timing must remain within a local success basin, especially near contact. A displacement that is small relative to the full action range can still be large relative to a grasp or contact margin. A safety review that ignores action-space metadata can therefore approve a checkpoint while missing the physical action law that is actually deployed. We formalize this audit boundary through executable policy equivalence. A VLA policy is represented as an executable tuple (f_{\theta},\mathcal{I},\mathcal{Z},\mathcal{U}_{k},\mathcal{C}), (1) where \mathcal{U}_{k} is the metadata-selected unnormalizer and \mathcal{C} contains controller conventions. Two deployments are executable-equivalent only if they induce the same physical action law. This makes checkpoint equality insufficient: identical weights and prompts do not imply identical robot actions. We then derive an ExecSpec certificate for metadata mismatch. For quantile-style unnormalization, replacing key k_{c} with key k_{w} induces a deterministic per-dimension affine displacement \displaystyle\Delta_{i}(z;k_{c},k_{w}) \displaystyle=(q^{(w)}_{01,i}-q^{(c)}_{01,i}) (2) \displaystyle+z_{i}\Big[(q^{(w)}_{99,i}-q^{(w)}_{01,i})-(q^{(c)}_{99,i}-q^{(c)}_{01,i})\Big] on masked action dimensions. The certificate reports mean displacement, tail displacement, axis attribution, mask mismatch, and gripper displacement on a calibration set. It requires no model inference and serves as a pre-rollout interface screen: a large certificate says the deployment is not the intended executable policy before the robot moves. Empirically, plausible metadata substitutions are sufficient to flip replayed robot task success. On LIBERO-Goal, using goal-B as the intended key, substituting long-v2 yields mean drift 0.199 over six non-gripper action dimensions, p95 drift 0.275, and 43.5% of calibration frames above drift 0.20. On replay-valid demonstrations, success under long-v2 drops from 28/28 at the intended metadata to 2/28 at full substitution, with a dose-response curve of 28/28, 17/28, 7/28, 0/28, and 2/28 as interpolation moves from the correct key to the wrong key. On LIBERO-Spatial, using spatial-v2 as the intended key, long-v2 yields 0/26 success at full substitution. On LIBERO-Object, all four plausible sibling substitutions reduce replay success from 28/28 to 0/28 on replay-valid demonstrations. On LIBERO-Long, goal-B and spatial-v2 reduce success from 23/23 to 0/23, while mixed-all reduces it to 1/23. Identity-key, no-op filtering, raw-vs-correct replay, mask, gripper, synthetic upper-bound, and OpenVLA-style interface checks rule out several simpler explanations. These replay witnesses support the deployment-safety concern without claiming to certify closed-loop or hardware safety. The contribution is a deployment-safety view of executable VLA policies: 1. We define an executable-policy identity criterion for VLA deployment and show that checkpoint equality is insufficient for physical policy equality. 2. We derive a closed-form metadata mismatch transform and an exact pre-rollout certificate for one controller-facing semantic field: quantile-style action unnormalization metadata. 3. We provide LIBERO-Goal, LIBERO-Spatial, LIBERO-Object, and LIBERO-Long replay witnesses that this identity violation is physically consequential, with identity-key, no-op filtering, raw-vs-correct replay, mask, gripper, synthetic upper-bound, and interface-sanity controls ruling out simpler explanations. The paper is not a general claim that all VLA deployments fail under metadata mismatch. It identifies a hidden action-space semantics layer that must be specified for a robot policy to be reproducible and auditable. The broader deployment lesson is that artifacts outside the checkpoint can be load-bearing parts of the executable policy.

Read the complete text