Denoising Tells When to Replan: Denoising-Variance Adaptive Chunking for Flow-Based Robot Policies

Xiangdong Feng, Yuxuan Cheng, Chen Shi, Boyao Han, Yuxuan Yan, Yitong Hong, Zhuotao Tian, Li Jiang, Beijing Institute of Technology · 2026

Read Denoising Tells When to Replan: Denoising-Variance Adaptive Chunking for Flow-Based Robot Policies by Xiangdong Feng, Yuxuan Cheng, Chen Shi, Boyao Han, Yuxuan Yan, Yitong Hong, Zhuotao Tian, Li Jiang, Beijing Institute of Technology (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-03847.txt.

Introduction

Feng and co-authors let a robot policy decide when to replan by watching its own denoising noise. Action chunking makes flow-based policies smoother over multi-step spans. The execution horizon is usually fixed by hand. Free-space motion and contact-rich phases, though, need different replan rates. Denoising itself carries a phase signal, the team shows.

Clean-action estimates stay stable in predictable phases. They fluctuate near contact and precision work. DVAC reads the variance of those estimates over the final denoising steps. It runs the stable low-variance prefix, then replans before shaky actions commit. A rolling calibration keeps the threshold portable across tasks. On LIBERO, success rises from about 95 to 98 percent while replans drop by 43 percent. Gains also appear on RoboTwin, CALVIN, and real hardware. Robot teams get adaptive chunking with no retraining.

Catalog record

CREATORXiangdong Feng, Yuxuan Cheng, Chen Shi, Boyao Han, Yuxuan Yan, Yitong Hong, Zhuotao Tian, Li Jiang, Beijing Institute of Technology
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.03847

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Denoising Tells When to Replan: Denoising-Variance Adaptive Chunking for Flow-Based Robot Policies Xiangdong Feng, Yuxuan Cheng, Chen Shi, Boyao Han, Yuxuan Yan, Yitong Hong, Zhuotao Tian, Li Jiang, Beijing Institute of Technology Abstract Action chunking has become a common inference strategy for flow-based robot policies, improving action coherence by modeling multi-step temporal dependencies in demonstrations. However, the execution horizon is still typically set as an empirical fixed value, overlooking that predictable free-space motions and precision-critical interaction phases often require different replanning frequencies. In this work, we first show that the denoising process of flow-based policies contains an intrinsic signal of task phases: clean-action estimates remain stable during predictable motion phases, but fluctuate more strongly around contact-rich or precision-sensitive operations. Motivated by this observation, we propose DVAC (Denoising-Variance Adaptive Chunking) , a test-time method that adaptively determines how many actions to execute from each predicted chunk. DVAC measures the variance of clean-action estimates over the final denoising steps, executes the stable low-variance prefix, and replans before high-variance future actions are committed. To transfer across tasks and rollouts, DVAC further calibrates the threshold with a rolling estimate of the local variance scale. Experiments on LIBERO, RoboTwin, CALVIN, and real-world manipulation show that DVAC improves task success while reducing replanning frequency. With a π 0.5 \pi_{0.5} -based policy, DVAC improves LIBERO success from 94.75% to 98.00% and reduces replanning by 43.0%, while also yielding aggregate gains on RoboTwin and CALVIN and improving real-world execution efficiency. † † footnotemark: † † footnotetext: ∗ These authors contributed equally. † Correspondence to: [email protected] . Keywords: Flow-based robot policy, Action chunking, Denoising variance, Robot manipulation 1 Introduction Modern robot policies are increasingly built as large-scale visuomotor or vision-language-action models trained on diverse robotic data [ 4 , 41 , 9 , 28 , 27 , 16 , 2 , 15 ] . In these systems, chunked policy has become a common interface, which predicts a short sequence of future actions and executes all or part of the sequence before replanning [ 40 , 8 , 27 , 2 , 15 ] . This design improves temporal coherence across consecutive actions, and amortizes expensive policy inference over multiple control steps. Yet action chunking introduces a central deployment question: how long should a predicted future be trusted before replanning? Most existing chunked policies instead execute a fixed number of actions from each predicted chunk [ 40 , 8 , 2 , 15 ] , which implicitly assumes that the trustworthy horizon is constant across tasks, states, and task phases. This creates an inherent trade-off between dynamic responsiveness and inference efficiency during deployment. Recent studies further show that the choice of action-chunk execution length can substantially affect task success [ 23 , 14 , 18 ] . A natural solution is adaptive execution, where the policy replans when the remaining predicted future becomes unreliable. This consistency–reactivity trade-off has been studied through guided decoding [ 24 ] , similarity-based updates [ 31 ] , learned chunk selectors [ 12 ] , or entropy-based selection [ 19 ] . While improving execution adaptivity, they often require extra candidate chunks, additional selection heuristics, or task-specific training, which motivates a simpler question: can the policy’s own inference process tell us when to stop executing a predicted chunk and replan? Figure 1: Denoising variance varies across manipulation phases. (a) Representative LIBERO rollout: denoising variance remains low during moving phases and rises around contact-rich operation phases. (b) Phase statistics across LIBERO tasks: operation phases exhibit higher mean denoising variance than moving phases. Detailed experimental settings are provided in Appendix 7.3 . Our key insight is that, for flow-based robot policies, the denoising process already contains such a signal. During flow matching inference, the full future action chunk is progressively refined through an iterative denoising process, and each step produces an intermediate clean-action estimate \hat{x}_{0} . The fluctuation of these estimates across denoising steps reveals how stable each individual future action prediction is. To verify this idea, we analyze denoising variance on LIBERO rollouts [ 21 ] . Figure 1 shows that denoising variance is highly non-uniform within an episode and closely aligns with different task phases, which remain low during relatively simple arm-moving intervals but increase sharply around operation phases. Across all four LIBERO suites, operating phases consistently exhibit higher average denoising variance than moving phases (Figure 1 ). These observations suggest that denoising dynamics can provide a useful cue for selecting a execution length before replanning. Motivated by this idea, we propose Denoising-Variance Adaptive Chunking (DVAC) , a training-free inference-time framework for adaptive action execution in flow-based robot policies. Concretely, DVAC uses the variance of final denoising estimates to identify the stable prefix of each predicted action chunk. Moreover, since the absolute variance scale varies across tasks and rollouts, DVAC sets the threshold relative to a rolling estimate of the local variance distribution, enabling adaptation without task-specific tuning. Evaluated on LIBERO, RoboTwin [ 26 ] , and CALVIN [ 25 ] with a \pi_{0.5} -based policy, DVAC improves LIBERO success rate from 94.75% to 98.00% while reducing replanning frequency by 43.0%. In summary, this work makes three contributions. (1) We identify denoising convergence stability as an intrinsic inference-time signal for adaptive execution in flow-based robot policies, and connect it to contact-rich and precision-sensitive phases. (2) We propose Denoising-Variance Adaptive Chunking (DVAC) , a training-free test-time framework that adapts execution horizons with denoising variance and an online scale-adaptive threshold. (3) We validate DVAC across LIBERO, RoboTwin, CALVIN, multiple flow-based backbones, and real-world manipulation, demonstrating higher task success and lower replanning cost. 2 Related Work Flow-Based Robot Policies. Diffusion and flow-based models have become effective generators for continuous robot actions. Diffusion models sample through iterative denoising [ 13 , 32 ] , while flow matching and rectified flow learn velocity fields that transport noise to data [ 20 , 22 ] . In robotics, Diffusion Policy formulates visuomotor control as conditional denoising over action sequences [ 8 ] , and recent vision-language-action policies such as \pi_{0} and \pi_{0.5} use flow matching to generate action chunks [ 2 , 30 ] . Although these policies expose intermediate denoising states and clean-action estimates during inference, existing deployments typically use only the final chunk. DVAC instead reuses this denoising trajectory to decide how many actions to execute. Action Chunking. Action chunking predicts a sequence of future actions and executes a prefix before replanning, thereby amortizing policy inference and improving temporal consistency. It has been adopted in ACT for fine-grained bimanual manipulation [ 40 ] , in Diffusion Policy via receding-horizon execution [ 8 ] , and in recent robot foundation models with extended action outputs [ 4 , 41 , 28 , 27 , 2 , 30 ] . Most chunked policies use a fixed execution horizon, creating a trade-off between feedback frequency and open-loop efficiency. Recent work addresses this trade-off via guided test-time sampling [ 23 ] , asynchronous inference and action inpainting [ 3 ] , attention-based horizon estimation [ 35 ] , entropy-based adaptation [ 18 ] , or uncertainty-aware confidence estimation [ 17 ] . In contrast, DVAC adapts execution using denoising variance from a single inference. Figure 2: Method overview of DVAC. The final denoising

Read the complete text