A Watermark for Vision-Language-Action and World Action Models

Yule Liu Shuai Liu Jiaheng Wei Xinlei He · 2026

Read A Watermark for Vision-Language-Action and World Action Models by Yule Liu Shuai Liu Jiaheng Wei Xinlei He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-23574.txt.

Introduction

Liu and colleagues watermark robot control models by hiding the owner's mark inside random noise, in a 2026 paper on machine learning security. Vision-language-action models turn camera input and spoken commands directly into robot motor actions. They are costly to train and often sold as black-box services, so owners need proof of ownership. Earlier watermarks either relied on planted backdoor triggers or nudged the outputs, leaving a signal that attackers could spot and strip.

The proposed method swaps the random seed, the starting number for the noise the model draws before generating, for a keyed one with identical statistics. Fingerprinted actions therefore look completely ordinary. To verify ownership, the owner reruns the suspect model, recovers the seed from recorded actions by optimization, and tests it against the secret key. Across two models and two robot suites, detection stays reliable with little performance loss, even under attacks.

Catalog record

CREATORYule Liu Shuai Liu Jiaheng Wei Xinlei He
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE80 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.23574

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Watermark for Vision-Language-Action and World Action Models Yule Liu Shuai Liu Jiaheng Wei Xinlei He Abstract Vision-language-action (VLA) models and world-action models (WAM) are the generative models now driving general-purpose robot control, turning raw camera input directly into motor commands. They are increasingly deployed as black-box services, where a partner runs the policy through an interface while the owner keeps the weights private. Training such a model takes proprietary data and heavy computational power, making the deployed model itself a valuable intellectual property. To protect the model ownership, one standard tool is watermarking. Recent research has developed two types of watermarks for robot policies, i.e., backdoor-based and output-perturbation watermarks. However, the backdoor-based watermark cannot be extended to the multi-user identification scenario, while the output-perturbation watermark makes the watermark signal distributed in a narrow frequency band of the action output, which can be easily detected by the adversary. To address this, we propose the keyed latent-provenance verification method, which watermarks the policy through the seed of the Gaussian noise vector that the models draw before generation. At the injection stage, the owner swaps this seed for a keyed one with the same distribution as ordinary noise, so the fingerprinted actions are statistically identical to those of an ordinary run and an adversary watching the output finds no signal to detect or remove. At the verification stage, the owner runs the suspect model under authorized access and records the action channels the robot executes, a partial and possibly post-processed view of the policy’s output. From this view, the verifier recovers the seed by gradient-based maximum a posteriori (MAP) optimization, tests it for the secret key to score each rollout, and aggregates these scores into a single decision on whether the suspect model belongs to the owner. We evaluate the method on two representative models across two robot suites. The experiments cover detection of the fingerprint, identification of which of several keys a suspect carries, robustness to a range of attacks, and an analysis of why the design works. Across both models, the fingerprint can be detected reliably with little change to task performance, and it remains detectable under output-side removal attacks and weight-level edits. The code is available in https://github.com/Y-L-LIU/keyed-latent-watermarking-vla . 0 0 footnotetext: † Corresponding author: Xinlei He ( [email protected] ). Introduction Robotic control is moving from task-specific controllers to generative policies trained on robot demonstrations, visual data, and web-scale language supervision [ 3 , 7 , 9 , 2 , 13 ] . Two model families drive this shift: vision-language-action (VLA) models map camera images and a language instruction directly to motor actions [ 3 , 7 , 5 ] , while world-action models (WAMs) first predict how the scene will change and then infer the action that produces that change [ 10 , 16 ] . Although they differ internally, both expose the same deployment interface: run the policy on the observation and task command, and the robot receives an action chunk. This action interface is also what a verifier can observe after deployment. Research policies are often released with open weights or code [ 9 , 2 ] , but production policies are usually private derivatives. To reach better performance in real-world scenarios, a provider adapts a base policy with proprietary robot demonstrations and customer-specific task data. The production version may also use a larger model, more computational resources, or heavier serving infrastructure than a public research release. These adaptations make the deployed policy valuable intellectual property. The provider may serve it through an API or deliver it as a packaged service that a partner runs on site [ 8 , 6 , 5 ] . The weights can remain hidden in both cases, but a partner who can run the service can still query it, redeploy it, or dispute where a derived system came from. The ownership verification question is: from the action commands that reach the robot, can the provider detect a suspect service that is reusing the protected deployment to avoid training its own policy? Figure 1 : Overview of our method. Watermarking is the standard tool for ownership protection, but deployed robot policies need a mark that makes low-cost evasion insufficient. Existing methods can be categorized into backdoor-based or output-side watermarks. The backdoor-based watermark changes the weights so that a secret trigger makes the policy emit a telltale action [ 12 ] . It requires weight edits and trigger calibration. Multi-customer deployments also need separate trigger behaviors. Later fine-tuning or behavior cloning on ordinary task outputs can weaken the rare trigger behavior. The output-side watermark marks a stochastic policy’s exploration noise [ 1 ] . It shapes that noise into a secret frequency band and reads the band back from the robot’s trajectory. That signal is easy for the owner to score, but its visibility gives an adversary a cheap removal handle: spectral analysis locates the band, and a narrow filter removes it with little cost to task performance ( Section 5.2 ). Latent-noise watermarks for image generators, including Tree-Ring, Gaussian Shading, and RingID, embed ownership evidence in the keyed generation process [ 14 , 15 , 4 ] . They suggest a latent-side route for robot policies, but the audit surface is different: the owner can inspect only the action commands that reach the robot. Inspired by these latent-noise methods, our method has two stages (see Figure 1 ). In the injection stage, the challenge is to make the policy carry a key-dependent signal without changing the sampler’s noise law or exposing a simple removal target in the action stream. We therefore mark the random seed that the generator already draws before producing each action chunk. This seed is shared by both model families: the VLA can map it directly to an action chunk, while the WAM can use it to generate an intermediate future scene from which actions are inferred. At deployment, the owner mixes the ordinary Gaussian seed with a keyed Gaussian reference. The mixed seed still has the same Gaussian distribution as an ordinary seed, so individual sampler draws look like ordinary noise. The key appears only as a hidden correlation between the seed and the owner’s reference. The generator spreads that correlation through the action trajectory instead of adding an explicit output signal. In the verification stage, the challenge is the reverse one: the owner must recover evidence for that hidden correlation without seeing the seed. During an audit, the owner may only record the action commands that reach the robot’s actuators. These commands are a partial and altered view of the generator output. Some raw action channels may never reach the robot, and the deployment may clip, smooth, delay, or otherwise change the channels that do. For each marked chunk, the verifier searches for a latent seed that would make the owner’s generator reproduce the observed action commands while staying likely under the Gaussian prior. We frame this search as a maximum a posteriori (MAP) optimization problem: it balances an action-fitting term against a prior term that keeps the seed in a high-probability region of the Gaussian latent space. The verifier then compares the recovered seed with the owner’s keyed reference. Decoy keys put scores from different

Read the complete text