PRTS: A Primitive Reasoning and Tasking System via Contrastive Representations
Yang Zhang, Jiangyuan Zhao, Chenyou Fan, Fangzheng Yan, Tian Li, Haitong Tang, Sen Fu, Xuan’er Wu, Qizhen Weng, Weinan Zhang, Xiu Li, Chi Zhang, Chenjia Bai, Xuelong Li · 2026
Read PRTS: A Primitive Reasoning and Tasking System via Contrastive Representations by Yang Zhang, Jiangyuan Zhao, Chenyou Fan, Fangzheng Yan, Tian Li, Haitong Tang, Sen Fu, Xuan’er Wu, Qizhen Weng, Weinan Zhang, Xiu Li, Chi Zhang, Chenjia Bai, Xuelong Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-27472.txt.
Introduction
Zhang and thirteen colleagues present PRTS, a robot foundation model that reframes pretraining as goal-reaching rather than behaviour cloning. Treating instructions as goals, it learns a shared space where state-action and goal embeddings predict goal likelihood from the state and action, judging feasibility beyond semantic matching. That supervision comes from offline trajectories without reward labels, folded into the backbone with a role-aware causal mask at negligible cost over behaviour cloning. Pretrained on 167 billion tokens, PRTS leads on LIBERO benchmarks, on SimplerEnv, and across a 14-task suite.
Catalog record
| CREATOR | Yang Zhang, Jiangyuan Zhao, Chenyou Fan, Fangzheng Yan, Tian Li, Haitong Tang, Sen Fu, Xuan’er Wu, Qizhen Weng, Weinan Zhang, Xiu Li, Chi Zhang, Chenjia Bai, Xuelong Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106562 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.27472
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PRTS: A Primitive Reasoning and Tasking System via Contrastive Representations Yang Zhang, Jiangyuan Zhao, Chenyou Fan, Fangzheng Yan, Tian Li, Haitong Tang, Sen Fu, Xuan’er Wu, Qizhen Weng, Weinan Zhang, Xiu Li, Chi Zhang, Chenjia Bai, Xuelong Li Abstract Vision-Language-Action (VLA) models advance robotic control via strong visual-linguistic priors. However, existing VLAs predominantly frame pretraining as supervised behavior cloning, overlooking the fundamental nature of robot learning as a goal-reaching process that requires understanding temporal task progress. We present PRTS ( P rimitive R easoning and T asking S ystem), a VLA foundation model that reformulates pretraining through Goal-Conditioned Reinforcement Learning. By treating language instructions as goals and employing contrastive reinforcement learning, PRTS learns a unified embedding space where the inner product of state-action and goal embeddings approximates the log-discounted goal occupancy, the probability of reaching the language-specified goal from the current state-action, quantitatively assessing physical feasibility beyond static semantic matching. PRTS draws this dense goal-reachability supervision directly from offline trajectories without reward annotations, and folds it into the VLM backbone via a role-aware causal mask, incurring negligible overhead over vanilla behavior cloning. This paradigm endows the high-level reasoning system with intrinsic goal reachability awareness, bridging semantic reasoning and temporal task progress, and further benefits goal-conditioned action prediction. Pretrained on 167B tokens of diverse manipulation and embodied-reasoning data, PRTS reaches state-of-the-art performance on LIBERO, LIBERO-Pro, LIBERO-Plus, SimplerEnv, and a real-world suite of 14 complex tasks, with particularly substantial gains on long-horizon, contact-rich, and zero-shot novel-instruction settings, confirming that injecting goal-reachability awareness significantly improves both execution success and long-horizon planning of general-purpose robotic foundation policies. † † affiliation: Institute of Artificial Intelligence (TeleAI), China Telecom † † affiliation: Tsinghua University † † affiliation: Shanghai Jiao Tong University † † affiliation: Fudan University † † contribution: \dagger Project Lead \ddagger Equal Contributions * Corresponding Authors † † date: April, 2026 † † \metaicon{1.05em}{assets/house-logo.png}Project: https://rhodes-team-prts.github.io/ † † \metaicon{1.25em}{assets/github-log.png}Code: https://github.com/TeleHuman/PRTS † † \metaicon{1.25em}{assets/hf-logo.png}Model: https://huggingface.co/TeleEmbodied/PRTS-4B † † Correspondence to: Yang Zhang ( [email protected] ) and Chenjia Bai ( [email protected] ) 1 Introduction Representation learning lies at the heart of robot learning, where the core challenge centers on extracting actionable knowledge from high-dimensional sensory inputs to enable goal-conditioned decision making. Vision-Language-Action (VLA) models have made remarkable strides by leveraging Vision-Language Models (VLMs) as powerful perceptual backbones, adopting a dual-system —or Mixture-of-Transformers (MoT)—architecture: System 2 (the VLM) handles high-level semantic understanding and task reasoning, while System 1 (the action expert) executes low-level continuous control ( 5 ; 4 ; 3 ) . However, this paradigm overlooks a fundamental characteristic of embodied interaction: robotic trajectory is inherently a goal-reaching process over time . This requires the representations inside a general-purpose robotic policy to not only encode static visual-linguistic semantic correlations, but also encapsulate the underlying temporal progress toward ultimate goal —specifically, how close it is to achieving the goal at the current state. While VLMs excel at encoding static semantic similarities between scenes and concepts ( 24 ; 31 ) , they intrinsically lack any notion of goal reachability —a quantitative estimate of how likely a given state-action pair is to eventually achieve the language-specified objective. Existing VLAs learn visuomotor priors almost exclusively through behavior cloning during pretraining ( 27 ; 73 ; 5 ; 4 ; 3 ; 65 ; 50 ; 60 ) . Although some works ( 4 ; 65 ) additionally incorporate VQA data to preserve semantic reasoning capabilities, these approaches still focus on static understanding and immediate action prediction, without explicitly injecting temporal awareness of goal reachability into the pretrained VLA. Consequently, System 2 operates with only qualitative semantic reasoning capabilities (determining “ what to do ”) but without the quantitative awareness of goal reachability needed to evaluate execution difficulty or to distinguish difficult-yet-reachable states from easy-yet-erroneous ones. To address this deficiency, we reformulate VLA pretraining through the lens of Goal-Conditioned Reinforcement Learning . In particular, we adopt Contrastive Reinforcement Learning (CRL) ( 19 ) , recently shown to scale to over 1000-layer deep networks ( 58 ) , which learns paired state-action and goal representations whose similarity approximates the reachability of goals under given state-action pairs. This formulation naturally equips the VLM backbone with temporal awareness of goal reachability, directly within its representation space. In this paper, we present PRTS ( P rimitive R easoning and T asking S ystem), a novel VLA foundation model that leverages Goal-Conditional RL for representations learning in VLA pre-training phase. Our approach introduces three key technical designs. (i) Language-conditioned contrastive RL for representation learning. Unlike prior VLAs ( 5 ; 4 ; 3 ; 50 ; 60 ) that pre-train the policy purely by behavior cloning, PRTS reformulates policy learning as a goal-conditioned representation learning problem with language instructions as goals. Specifically, we construct positive pairs using state-action pairs from trajectories paired with their corresponding text instructions, and negative pairs using text goals from different tasks. However, in contrast to standard CRL where future goals are sampled from a geometric distribution within the same episode, the goal is a language instruction shared across all timesteps in language-conditioned manipulation setup. To bridge this gap, we transform the geometric distribution sampling into a temporal weighting scheme over state-action pairs. This formulation drives the model to learn a representation space where the similarity between state-action embeddings and goal embeddings encodes the discounted goal occupancy measure, thereby capturing the temporal structure of goal-reaching behavior. (ii) Implicit dense goal-reachability supervision. The contrastive objective is built upon a goal-reaching reward assumption where the reward is defined as the transition probability of reaching the goal from the current timestep ( 19 ) . This enables the model to extract dense supervision and acquire a dense goal-conditioned action-value function directly from trajectory structure without manual reward annotations, quantifying the long-term utility of state-action pairs in purely offline pretraining. (iii) Single-forward-pass design at negligible cost. Adding two contrastive heads to a VLM typically requires a second forward pass or a separately trained value network ( 23 ) . PRTS instead appends two small token blocks, <CRL_action> and <CRL_goal>, to the standard input sequence and enforces information isolation through a role-aware causal mask integrated into a custom FlashAttention kernel ( 64 ) . The autoregressive action tokens retain standard causal attention, ensuring that the behavior-cloning loss remains identical with or without the CRL tokens. Meanwhile, the CRL tokens extract state-action embeddings and goal embeddings from isolated information streams within the same forward pass. As a result, end-to-end pretraining incurs negligible additional cost compared to vanilla behavior cloning on the same backbone. Notably, PRTS unifies semantic reasoning, discrete action prediction, and goal-conditioned representation learning within a single VLM architecture, enjoying joint optimization and shared vision-language representations. It equips the VLM with a quantitative notion of goal reachability that goes well beyond static semantic understanding. Learning to estimate goal reachability requires the backbone to acquire task-relevant vision-language representations that encode the functional affordances required for task completion. Built upon this architecture, we construct a large-scale pre-training dataset comprising diverse robotic trajectories with language annotations. We train the PRTS foundation model on over 167B tokens, employing infrastructure optimizations including a custom CuTe-FlashAttention kernel and sequence packing to achieve high-throughput training on 64 H100 GPUs for one week. We subsequently fine-tune