TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulation

Sizhe Zhao, Shengping Zhang, Shuo Yang, Weiyu Zhao, Shuigen Wang, Xiangyang Ji · 2026

Read TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulation by Sizhe Zhao, Shengping Zhang, Shuo Yang, Weiyu Zhao, Shuigen Wang, Xiangyang Ji (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25547.txt.

Introduction

Sizhe Zhao and colleagues improve robot control at run time instead of retraining the policy. Generative policies usually act once, so a single weak action stands. TapSampling draws many candidate actions from a compressed latent space built by an Action-VAE, then picks with a verifier trained to predict task progress. The verifier learns from step order in robot data. The plug-and-play scheme lifts several generalist policies in simulated and real settings without further tuning.

Catalog record

CREATORSizhe Zhao, Shengping Zhang, Shuo Yang, Weiyu Zhao, Shuigen Wang, Xiangyang Ji
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44240
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25547

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulation Sizhe Zhao, Shengping Zhang, Shuo Yang, Weiyu Zhao, Shuigen Wang, Xiangyang Ji Abstract Existing embodied control research demonstrates remarkable performance improvements by scaling training data and model size. We instead explore inference-time strategy as an alternative axis. Non-deterministic generative models, such as diffusion and autoregressive models, have been widely adopted in the field of embodied control. However, the single-shot inference paradigm limits their performance. In this paper, we propose TapSampling , a plug-and-play framework for inference-time sampling. First, we introduce an Action-VAE that represents actions in a low-dimensional latent space by mapping policy-generated initial actions into a compressed posterior distribution, from which any number of latent samples can be drawn and decoded into candidate actions that approximate the true action distribution. Second, we formulate action verification as task-progress outcome prediction, using the intrinsic sequential structure of robotic datasets to train a semantically grounded verifier for interpretable action selection. Furthermore, TapSampling is a policy-agnostic framework. Extensive experiments in both simulated and real-world environments demonstrate that our method substantially improves multiple generalist policies without further policy finetuning. Code and models are available at the project page . 1 Introduction Figure 1 : TapSampling , an inference-time sampling framework, extends the typical single-shot inference pipeline through multi-sample generation and task-progress-guided verification. Recently, non-deterministic approaches such as diffusion models and auto-regressive Large Language Models (LLMs) have demonstrated remarkable capabilities in perceiving, understanding, and generating multimodal information ( 7 ; 46 ) . Capitalizing on these remarkable advancements, there is a burgeoning initiative to harness pretrained foundation models , such as Video Diffusion Models (VDMs) ( 5 ; 45 ) and Vision-Language Models (VLMs) ( 16 ; 2 ; 1 ) , as the backbone, and adapt them for robotic manipulation by expanding action vocabularies or incorporating additional action heads ( 18 ; 4 ; 39 ; 23 ) . Driven by the accumulation of large-scale data and advances in model architectures, policy models have demonstrated remarkable capabilities ( 30 ; 17 ) . Nevertheless, many policies exhibit considerable instability due to the non-deterministic characteristic of diffusion and next-token-prediction paradigms as shown in the Appendix A , succeeding in some cases and failing in others under identical environment conditions. Therefore, their performance is fundamentally limited due to the single-shot inference paradigm. Due to the stochastic characteristics of diffusion and next-token-prediction paradigms, the inference-time strategy has emerged as a prominent research focus. Experiments indicate that sampling repeatedly from LLMs and diffusion models effectively improves the performance ( 49 ; 31 ; 27 ) . In light of these advances and the observed instability of policies across stochastic conditions, we aim to achieve meaningful performance gains by allocating inference-time computation. The inference-time sampling framework as shown in Figure 1 mainly contains two key components. (1) Candidate Sampling: strategy for generating multiple candidates, and (2) Candidate Verification: method for constructing a verifier that evaluates candidate actions. High-quality candidate sampling is necessary to ensure that plausible actions are available, while effective candidate verification is essential to select a reliable action among them. For candidate sampling, existing methods mainly perform action sampling from policy models ( 29 ; 44 ) , which increases the computational cost by an order of magnitude. While sampling from a Gaussian distribution ( 19 ) is efficient, it neglects inter-dimensional correlations of action chunks and therefore yields candidates that deviate from the true action distribution. For candidate verification, the absence of off-the-shelf models capable of understanding and interpreting low-level actions poses a critical challenge. In this paper, we propose a plug-and-play inference-time sampling framework for generalist robotic policies, named TapSampling. For action sampling, we employ an Action-VAE to model the intra-chunk correlations among action dimensions, which encodes initial actions into a compressed posterior distribution over latent, from which additional latent samples are drawn and decoded into action candidates. Benefiting from the learned low-dimensional posterior, the generated actions remain closer to the true action distribution. For action verification, we introduce a verifier that interprets low-level actions by predicting their impact on task progress. The verifier is trained with the intrinsic sequential characteristic of the robotic trajectory, without an additional data synthesis procedure. Furthermore, the predicted values with explicit semantics enable interpretable action selection. The contributions are summarized as follows: • Policy-agnostic inference-time framework: We propose a plug-and-play framework to improve the performance of pretrained generalist policies without further fine-tuning them. • Action sampling with learned posterior: We introduce an Action-VAE that encodes actions into a compressed distribution, from which more action candidates in proper modes can be sampled efficiently. • Action selection via task progress verification: We introduce a task-progress-understanding verifier that assigns values with explicit semantics for query actions, enabling interpretable action selection. • Experiments demonstrate that TapSampling enhances the manipulation capabilities of diverse representative policies in both simulated and real-world settings. 2 Related Works 2.1 Generalist Robotic Policy Developing generalist robotic policies that can execute a wide variety of tasks following different instructions is an important research direction of embodied control. The recent success of video foundation models ( 5 ; 45 ) and VLMs ( 16 ; 2 ) has spurred a flurry of interest in building generalist robotic policies based on pretrained foundation models. They typically extend the vocabulary of VLMs and generate actions through next-token prediction ( 18 ) , or take the generated tokens, images, videos, or immediate features of foundation models as the conditioning signal, and generate actions through action expert modules ( 4 ; 6 ; 42 ; 14 ; 34 ) . As data and model sizes scale up, policy models demonstrate excellent performance. Despite these advances, current policies typically commit to a single action at each decision step (single-shot inference), resulting in no mechanism to correct failures caused by stochastic variance and potentially producing unstable behavior at deployment ( 44 ) . In this paper, we investigate inference-time sampling as a complementary axis to improve performance without additional policy fine-tuning. Figure 2 : TapSampling overview . For action sampling, a small set of actions is sampled from the policy, encoded and mixed into a compressed latent distribution by the Action-VAE encoder. Multiple latent samples are then drawn from the learned posterior and decoded into diverse, high-quality action candidates efficiently. For action verification, positive and negative training examples are constructed automatically from expert trajectories using their intrinsic sequential information, and a verifier is trained to predict task-progress changes, which enables interpretable action selection. 2.2 Inference-Time Sampling Inference-Time Sampling for LLMs and Diffusion Models. LLMs have achieved remarkable success in producing diverse, high-quality answers to the same question with the autoregressive next-token prediction paradigm. In addition to scaling training data and model size, inference-time sampling has emerged as a prominent research focus ( 49 ) . Recent works have demonstrated that repeated or structured inference—e.g., chain-of-thought prompting ( 41 ; 22 ) , multiple-sample self-consistency ( 38 ; 37 ) , and verifier-guided selection ( 21 ; 51 ) —can improve output quality for high-level, semantic tasks. In parallel, diffusion models on the vision side are sensitive to initial noise and have benefited from techniques that optimize or search initial noises ( 52 ; 35 ; 13 )

Read the complete text