AttenA+: Rectifying Action Inequality in Robotic Foundation Models
Daojie Peng, Fulong Ma, Jiahang Cao, Qiang Zhang, Xupeng Xie, Jian Guo Ping Luo Andrew F. Luo Boyu Zhou Jun Ma · 2026
Read AttenA+: Rectifying Action Inequality in Robotic Foundation Models by Daojie Peng, Fulong Ma, Jiahang Cao, Qiang Zhang, Xupeng Xie, Jian Guo Ping Luo Andrew F. Luo Boyu Zhou Jun Ma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13548.txt.
Introduction
Daojie Peng and nine colleagues introduce AttenA+, a framework that rectifies action inequality in robotic foundation models. AttenA+ prioritises critical segments through speed-based action focus, reweighting training by the inverse speed field. As a plug-and-play add-on, it integrates into existing backbones without design changes or added parameters. It lifts OpenVLA-OFT to 98.6 percent on Libero and FastWAM to 92.4 percent on RoboTwin 2.0, with real-world validation on a Franka manipulator.
Catalog record
| CREATOR | Daojie Peng, Fulong Ma, Jiahang Cao, Qiang Zhang, Xupeng Xie, Jian Guo Ping Luo Andrew F. Luo Boyu Zhou Jun Ma |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51768 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13548
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AttenA+: Rectifying Action Inequality in Robotic Foundation Models Daojie Peng, Fulong Ma, Jiahang Cao, Qiang Zhang, Xupeng Xie, Jian Guo Ping Luo Andrew F. Luo Boyu Zhou Jun Ma Abstract Existing robotic foundation models, while powerful, are predicated on an implicit assumption of temporal homogeneity : treating all actions as equally informative during optimization. This "flat" training paradigm, inherited from language modeling, remains indifferent to the underlying physical hierarchy of manipulation. In reality, robot trajectories are fundamentally heterogeneous, where low-velocity segments often dictate task success through precision-demanding interactions, while high-velocity motions serve as error-tolerant transitions. Such a misalignment between uniform loss weighting and physical criticality fundamentally limits the performance of current Vision-Language-Action (VLA) models and World-Action Models (WAM) in complex, long-horizon tasks. To rectify this, we introduce AttenA+ , an architecture-agnostic framework that prioritizes kinematically critical segments via velocity-driven action attention. By reweighting the training objective based on the inverse velocity field, AttenA+ naturally aligns the model’s learning capacity with the physical demands of manipulation. As a plug-and-play enhancement, AttenA+ can be integrated into existing backbones without structural modifications or additional parameters. Extensive experiments demonstrate that AttenA+ significantly elevates the ceilings of current state-of-the-art models. Specifically, it improves OpenVLA-OFT to 98.6% (+1.5%) on the Libero benchmark and pushes FastWAM to 92.4% (+0.6%) on RoboTwin 2.0. Real-world validation on a Franka manipulator further showcases its robustness and cross-task generalization. Our work suggests that mining the intrinsic structural priors of action sequences offers a highly efficient, physics-aware complement to standard scaling laws, paving a new path for general-purpose robotic control. The code is available at: https://github.com/DaojiePENG/AttenA-Plus . 1 Introduction Vision-Language-Action (VLA) and World-Action Models (WAM) have recently emerged as a powerful paradigm for end-to-end robotic control, enabling robots to interpret multimodal instructions and execute complex physical tasks 18 ; 2 ; 28 . However, this success masks a fundamental misalignment: while all linguistic tokens are assumed to be equally informative in standard NLP training, robotic actions are inherently heterogeneous in their physical significance. In a typical manipulation trajectory, not all action steps are created equal. Consider the task of picking up a fragile object: the rapid motion of the arm toward the object is transitional and error-tolerant, whereas the final, slow-speed adjustment of the gripper is precision-demanding and task-critical. Currently, dominant training frameworks adopt a "flat" optimization objective, assigning identical learning weights to every timestep regardless of its physical role 3 ; 42 ; 34 . This uniform treatment forces models to waste representational capacity on trivial transitional segments, while under-optimizing the slow, high-precision actions that actually determine task success 18 ; 4 ; 2 ; 7 ; 27 ; 15 ; 5 . Consequently, even the most advanced VLA models often struggle with last-centimeter precision in complex robotics tasks 12 ; 1 ; 19 . To bridge this gap, we argue that the physical properties of an action, specifically its velocity, should dictate its importance during training. We propose AttenA+ , a universal framework that introduces velocity-driven action attention to reweight trajectory learning. Our key insight is simple yet effective: the end-effector’s velocity serves as a natural inverse proxy for precision demand. By assigning different optimization priorities to different actions, AttenA+ aligns model training with the intrinsic physics of manipulation. As an architecture-agnostic enhancement, AttenA+ can be seamlessly plugged into any existing robotic backbone without structural modifications or additional parameters. Our contributions are summarized as follows: 1) We identify and formalize the action inequality inherent in robotic trajectories, exposing a fundamental bias in current foundation models where the uniform treatment of all actions leads to suboptimal optimization of physically critical steps. 2) We introduce AttenA+ , a plug-and-play optimization framework that utilizes the inverse velocity field as a physical prior to reweight trajectory learning, effectively aligning the model’s focus with kinematically demanding manipulation phases. 3) Extensive evaluations on Libero and RoboTwin benchmarks show that AttenA+ significantly elevates the performance ceilings of current state-of-the-art models. Furthermore, real-world experiments on a Franka manipulator demonstrate that our method provides superior robustness and success rates specifically during precision-critical motions where standard baselines frequently fail. Figure 1: Overview of AttenA+ . AttenA+ is a paradigm-agnostic enhancement framework for action robotic foundation models, introducing velocity-field-based action attention to prioritize slow, critical manipulation steps. It seamlessly plugs into mainstream discriminative (e.g., OpenVLA-OFT) and generative ( \pi_{0} , \pi_{0.5} , Diffusion Policy) architectures, as well as emerging World-Action Models (WAM). Without modifying core backbones or relying on data/model scaling, AttenA+ generalizes across diverse robotic datasets including Libero 22 and RoboTwin 9 , and consistently improves task success rates over state-of-the-art baselines. 2 Related Works 2.1 Robotic Foundation Models Vision-Language-Action (VLA) and World-Action Models (WAM) enable end-to-end robotic manipulation by grounding language in visual observations to generate continuous action sequences. A wide range of VLA frameworks have been proposed to advance robotic manipulation performance, including foundational models and their variants, as well as specialized optimizations. OpenVLA 18 serves as a core foundational framework unifying visual perception, language understanding, and action generation, with its variant OpenVLA-OFT 17 further optimizing via orthogonal fine-tuning to push state-of-the-art (SOTA) performance on Libero tasks. The \pi model series, including \pi_{0} 2 , \pi_{0} + FAST 29 , and \pi_{0.5} 15 , advances generative VLA capabilities through flow matching for strong generalization. Other representative VLA models and optimizations include UniVLA 4 , VLA-ADP 25 , CogACT 20 , SmolVLA 30 , NORA and NORA-Long 14 , WorldVLA and WorldVLA* 7 , SP-VLA 21 , FlashVLA 32 , VLA-Cache 36 , FastV and FastV(+OFT) 8 , SparseVLM 39 , and CSP 26 . Parallel efforts emerging as WAMs include Motus 1 , LingBot-VA 19 , and Fast-WAM 37 . Despite consistent progress across benchmarks, nearly all existing action models share a core limitation: treating all action timesteps equally during training, neglecting the intrinsic physical hierarchy and heterogeneous importance of different motion phases. 2.2 Action Sequence Modeling for Robotics Modeling sequential robotic actions is a core research direction, with early efforts focusing on trajectory optimization and inverse reinforcement learning (IRL). Recent data-driven approaches include Action Chunking with Transformers (ACT) 40 , which uses transformers to model temporal dependencies in action sequences, and Diffusion Policy 10 , which leverages diffusion models for smooth, feasible trajectory generation—though these prioritize action quality over critical action prioritization based on physical characteristics (e.g., velocity). Prior works have explored importance weighting for imitation learning: some weight entire trajectories by demonstration quality 16 ; 33 , while others focus on per-timestep weighting (e.g., IRIS 24 for informative offline data, uncertainty-based weighting for critical states 35 ). However, these are limited to single-task learning or require extra overhead, unlike our velocity-based approach that needs no additional training and is compatible with arbitrary VLA frameworks. A small number of VLA works explore action weighting (e.g., VLA-ADP 25 prunes redundant fast actions for efficiency), but none explicitly link velocity to learning priority. Different from all prior arts, AttenA+ introduces a plug-and-play velocity-field weighting principle that emphasizes learning on critical action phases, requiring no extra supervision and universally compatible with mainstream robotic foundation models. 2.3 Attention Mechanisms in Robotic Learning Attention has become a standard component in modern robotic foundation models, yet its usage remains largely confined to input