Capability and Robustness Cannot Both Be Free: An Information-Theoretic Bound for Vision-Language-Action Models
Jianwei Tai · 2026
Read Capability and Robustness Cannot Both Be Free: An Information-Theoretic Bound for Vision-Language-Action Models by Jianwei Tai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25889.txt.
Introduction
Tai proves a hard ceiling for vision-language-action models, which turn images and words into robot actions. Such models score highly on clean inputs yet collapse under tiny hostile pixel changes. Tai shows capability plus robustness cannot exceed a budget set by task uncertainty and attack strength. The proof uses a classic information-processing inequality twice. Tests across 308 cells find no violation, and the construction yields three label-free checks.
Catalog record
| CREATOR | Jianwei Tai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89239 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25889
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Capability and Robustness Cannot Both Be Free: An Information-Theoretic Bound for Vision-Language-Action Models Jianwei Tai Abstract Vision-Language-Action (VLA) models reach high success rates on clean inputs but collapse under small adversarial perturbations: a 16 / 255 16/255 PGD attack drops OpenVLA-7B’s LIBERO success from 95 % 95\% to under 5 % 5\% . Whether this trade-off has a theoretical floor was open. We prove that it does. For any VLA policy, capability I ( A ⋆ , A π ) I(A^{\star};A_{\pi}) and robustness I ( A π , A ~ π ) − I ( A π , δ ) I(A_{\pi};\tilde{A}_{\pi})-I(A_{\pi};\delta) sum to at most H ( A ⋆ ) + I ( X , X ~ ) H(A^{\star})+I(X;\tilde{X}) , the task entropy plus adversarial channel capacity. The proof reduces to two applications of the Data Processing Inequality. The pixel-level bound is loose by ∼ 10 3 \sim 10^{3} nats and serves as a ceiling guarantee; an encoder-specific corollary tightens it by over an order of magnitude, into a regime where realized capability already consumes 5 5 – 9 % 9\% of the budget. We validate Theorem 1 with zero violations across 308 308 cells: 252 252 closed-form Gaussian-VLA, 48 48 OpenVLA-7B + + LIBERO + + PGD ( 4 4 suites × \times 4 4 ε \varepsilon × \times 3 3 seeds), 4 4 Square-Attack, and 4 4 multi-step ( T = 10 T{=}10 ). A complementary measurability inequality Rob disc ≤ Cap disc \Rob_{\text{disc}}\leq\Cap_{\text{disc}} further holds across 144 144 cross-architecture cells spanning OpenVLA, OpenVLA-OFT (continuous- L 1 L_{1} ), and SmolVLA (flow-matching). The same construction yields three label-free diagnostics: a pre-flight encoder ceiling, a defense-forensics probe that localizes input-side vs. language-model intervention, and a head-agnostic robustness ratio comparable across discrete-token, L 1 L_{1} -regression, and flow-matching policies. Together these provide the cross-setting axis defense and architecture comparisons currently lack. 1 Introduction Vision-Language-Action (VLA) models, large multimodal policies that map an image and a natural-language instruction directly to a robot action, account for much of the past two years’ progress in generalist manipulation and are now beginning to operate alongside humans on real hardware. OpenVLA-7B ( 15 ) reaches 95.4\% success on LIBERO-Spatial; RT-2 ( 4 ) generalizes to unseen object-verb compositions; \pi_{0} ( 3 ) scales to dexterous bimanual tasks. Clean-input success rates have climbed steadily year over year. Yet each prediction is a physical action, which turns visual fragility from an accuracy issue into a safety one. Under attack the picture shifts. Recent empirical studies ( 29 ; 32 ; 13 ) report a consistent pattern: a 16/255 PGD perturbation imperceptible to humans drops OpenVLA’s task success on LIBERO from 95\% to under 5\% . Defenses recover only part of the loss. Adversarial fine-tuning typically restores 10 – 50\% of the lost robustness at a cost of 5 – 15\% in clean accuracy, and the resulting Pareto frontier is uneven across datasets and architectures. The prior question is whether the trade-off has a theoretical floor at all, or whether better training could deliver clean accuracy and adversarial invariance together without limit. 27 settled the analogous question for binary classifiers under specific data distributions; the corresponding statement for action-generating policies has, to our knowledge, never been written down. This paper writes it down. For any VLA policy \pi producing action A_{\pi} from observation X , with oracle action A^{\star} and adversarial perturbation \delta such that \tilde{X}=X+\delta and \tilde{A}_{\pi}=\pi(\tilde{X}) : \underbrace{I(A^{\star};A_{\pi})}_{\text{Capability}}+\underbrace{I(A_{\pi};\tilde{A}_{\pi})-I(A_{\pi};\delta)}_{\text{Robustness}}\leq\underbrace{H(A^{\star})+I(X;\tilde{X})}_{\text{Budget}}. (1) The proof reduces to two applications of the Data Processing Inequality plus standard non-negativity facts (Theorem 1 ). The right-hand side depends only on the task and the attacker, so any architectural change must trade capability against robustness within a fixed budget. On current models the bound is loose (slack \sim 10^{3} nats, dominated by the gap between image-dimensional channel capacity and 7-D action geometry), so it functions as a ceiling guarantee rather than a tight predictor of achievable performance. The bound is non-constructive : it asserts \Cap+\Rob\leq\text{Budget} without prescribing a \pi that attains equality. We propose the slack S(\pi,\varepsilon)=H(A^{\star})+I(X;\tilde{X})-\Cap(\pi)-\Rob(\pi)\geq 0 as a comparable cross-paper metric, allowing a defense paper to report “we closed 60\% of the slack at \varepsilon{=}4/255 ” rather than absolute robustness numbers that fail to transfer across settings. Our MI estimators are biased; Sec. 4 catalogs the direction. The bias does not threaten the inequality, since estimator error shrinks the LHS faster than the RHS in our regime, widening the slack rather than producing spurious violations. The bound also serves as more than a verification target. The same calculation yields three quantities that practitioners can read directly: a \sim 5 -minute pre-flight encoder ceiling that audits the worst-case channel capacity of a candidate (\pi,\text{defense},\varepsilon) deployment without running an attack, a defense-forensics shift signature that identifies whether a defense intervenes input-side or LLM-side, and a head-agnostic \Rob_{\text{disc}}/\Cap_{\text{disc}} ratio that places discrete-token, L_{1} -regression, and flow-matching action heads on a common axis. Each is computable from \leq 200 samples, requires no ground-truth labels, and is comparable across policies, defenses, and architectures. The contributions of this paper are summarized as follows. 1. An information-theoretic ceiling for VLA capability and robustness (Sec. 3 ). We prove that for any VLA policy \pi , capability (mutual information between policy action and oracle action) and robustness (mutual information preserved under attack, net of trivial channel leakage) sum to at most the task entropy plus the attack channel capacity (Theorem 1 ). The proof reduces to two applications of the Data Processing Inequality and MI non-negativity. Because the budget depends only on the task and the attack, gains in one term cost either the other term or the slack, regardless of policy class. The universal bound is substitutable across defenses but loose by \sim 10^{3} nats on current models, since image-dimensional channel capacity dwarfs the 7 -D action geometry. An encoder-specific corollary (Cor. 5 ) tightens it by 28 – 68\times at the cost of becoming policy- and defense-specific (it depends on the realized \sigma^{2}_{\delta,\phi} ). Together they separate a universal ceiling from a tight per-experiment diagnostic that underpins the practical tools in Contribution 3. 2. Empirical validation across 308 Theorem-1 cells with zero violations (Secs. 4 , 5 ). Theorem 1 is verified on 252 closed-form Gaussian-VLA cells; 48 OpenVLA-7B + LIBERO PGD cells ( 4 suites \times 4 \varepsilon \times 3 seeds, pixel-PCA RHS); 4 Square-Attack cells (one per LIBERO suite at \varepsilon{=}8/255 , 200 queries) that rule out a PGD-specific artifact; and 4 multi-step DPI cells ( T{=}10 , 30 trajectories per suite) confirming cumulative slack scales as T\cdot S_{1} . A complementary discrete inequality \Rob_{\text{disc}}\leq\Cap_{\text{disc}} further holds across 144 cross-architecture cells ( 3 architectures \times 4 LIBERO suites \times 4 perturbation budgets \times 3 seeds) spanning OpenVLA, OpenVLA-OFT (continuous- L_{1} ), and SmolVLA (flow-matching). The bound holds in every cell, and the encoder-tightened RHS keeps realized capability well within the budget, showing that the constraint is informative at policy-relevant scale. 3. A deployment-ready diagnostic toolkit derived from the bound (Secs. 5.6 , 5.7 ). The same calculation yields three diagnostics, each computable from \leq 200 samples on a single GPU without ground-truth labels (Table 12 ). A defense-forensics shift signature tells