Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Control
Zhuoqun Chen [email protected] San Diego, Xiu Yuan [email protected] San Diego Tongzhou Mu [email protected] San Diego Hao Su [email protected] San Diego · 2025
Read Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Control by Zhuoqun Chen [email protected] San Diego, Xiu Yuan [email protected] San Diego Tongzhou Mu [email protected] San Diego Hao Su [email protected] San Diego (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12724.txt.
Introduction
Zhuoqun Chen, Xiu Yuan, Tongzhou Mu, and Hao Su wrote this paper in two thousand twenty-five. It speeds up diffusion policies, a way to teach robots by copying shown moves, which can be slow to react since they act on stale plans.
Their method keeps a buffer of actions at rising noise levels and cleans them one step at a time, in sequence. The head of the line is always a fresh, clean action based on the newest view, while new noisy actions join the tail. This keeps motion smooth yet quick to respond. Tests on fast-response tasks show a clear gain in success rate over the standard policy. On plain tasks it also beats the best known speedup trick.
Catalog record
| CREATOR | Zhuoqun Chen [email protected] San Diego, Xiu Yuan [email protected] San Diego Tongzhou Mu [email protected] San Diego Hao Su [email protected] San Diego |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-12724
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Responsive Noise-Relaying Diffusion Policy: Responsive and Efficient Visuomotor Control Zhuoqun Chen [email protected] San Diego, Xiu Yuan [email protected] San Diego Tongzhou Mu [email protected] San Diego Hao Su [email protected] San Diego Abstract Imitation learning is an efficient method for teaching robots a variety of tasks. Diffusion Policy, which uses a conditional denoising diffusion process to generate actions, has demonstrated superior performance, particularly in learning from multi-modal demonstrates. However, it relies on executing multiple actions to retain performance and prevent mode bouncing, which limits its responsiveness, as actions are not conditioned on the most recent observations. To address this, we introduce Responsive Noise-Relaying Diffusion Policy (RNR-DP), which maintains a noise-relaying buffer with progressively increasing noise levels and employs a sequential denoising mechanism that generates immediate, noise-free actions at the head of the sequence, while appending noisy actions at the tail. This ensures that actions are responsive and conditioned on the latest observations, while maintaining motion consistency through the noise-relaying buffer. This design enables the handling of tasks requiring responsive control, and accelerates action generation by reusing denoising steps. Experiments on response-sensitive tasks demonstrate that, compared to Diffusion Policy, ours achieves 18% improvement in success rate. Further evaluation on regular tasks demonstrates that RNR-DP also exceeds the best acceleration method by 6.9%, highlighting its computational efficiency advantage in scenarios where responsiveness is less critical. 1 Introduction Imitation learning is a powerful approach for training robots to perform complex tasks, including grasping ( Johns 2021 ; Xie et al. 2020 ; Stepputtis et al. 2020 ) , legged locomotion ( Ratliff et al. 2007 ; Al-Hafez et al. 2023 ; Yang et al. 2023b ) , dexterous manipulation ( Qin et al. 2022 ; Radosavovic et al. 2021 ) , and mobile manipulation ( Wong et al. 2022 ; Du et al. 2022 ) . Advances in computer vision and natural language processing have led to increasingly sophisticated imitation learning frameworks, achieving impressive success across diverse tasks ( Chen et al. 2021 ; Abramson 1970 ; Florence et al. 2022 ; Shafiullah et al. 2022 ) . A notable breakthrough, Diffusion Policy ( Chi et al. 2023 ) , models robot action sequences through a conditional denoising diffusion process, setting new benchmarks over traditional imitation learning techniques. Consequently, Diffusion Policy has rapidly gained traction and is now widely adopted as a foundational framework in both research and real-world applications. Figure 1: Our RNR-DP consistently delivers responsive and efficient control. However, Diffusion Policy faces significant limitations. As shown in Chi et al. 2023 , its performance heavily depends on having a relatively large action horizon, T_{a} , which corresponds to executing multiple actions in the environment. The policy widely achieves optimal performance at T_{a}=8 but suffers substantial degradation when T_{a}=1 , where only a single action is executed per inference. We attribute this to the nature of modeling multi-modal data: each inference independently samples actions aligned with a specific mode. Consequently, a larger action horizon is essential to ensure a sequence of actions adheres to the same mode, maintaining consistency. Conversely, using T_{a}=1 leads to severe mode bouncing, causing significant performance drops. However, employing a large action horizon (e.g., T_{a}=8 ) also introduces drawbacks, as most actions are not conditioned on the latest observations, thereby reducing responsiveness and adaptability to environmental changes. Empirically, we observe that Diffusion Policy struggles particularly with tasks requiring responsive control, such as handling dynamic objects. To address these issues, we propose the Responsive Noise-Relaying Diffusion Policy (RNR-DP). This approach fundamentally relies on a noise-relaying buffer that contains increasing noise levels and implements a sequential denoising mechanism. After each denoising step, conditioned on the most recent observations, the model executes an immediate noise-free action at the buffer’s head and appends fully noisy actions at the buffer’s tail. The noise-relaying buffer, combined with the sequential denoising mechanism, not only reuses denoising steps from previous outputs—allowing one denoising step to generate one action—but also ensures active control based on the most recent observations and prevents frequent mode bouncing, maintaining action consistency throughout the entire process. We name it Responsive Noise-Relaying Diffusion Policy because it employs a noise-relaying buffer at its core and has the ability to respond quickly and actively to the environment . We evaluate our approach across a range of benchmarks, focusing on 9 tasks from three well-established datasets: ManiSkill2 ( Gu et al. 2023 ) , ManiSkill3 ( Tao et al. 2024 ) , and Adroit ( Rajeswaran et al. 2017 ) . Our primary evaluation targets 5 tasks involving dynamic object manipulation that demand responsive control. Empirical results show that RNR-DP significantly outperforms Diffusion Policy, delivering much more responsive control. Additionally, we extend our evaluation to tasks that do not require responsive control. The results indicate that, even on these simpler tasks, RNR-DP functions as a superior acceleration method compared to popular alternatives such as DDIM ( Song et al. 2020 ) and Consistency Policy ( Song et al. 2023 ; Prasad et al. 2024 ) . Overall, our evaluations systematically demonstrate that RNR-DP provides both highly responsive and efficient control. To summarize, our contributions are as follows: • We identify a key limitation of Diffusion Policy: its reliance on a relatively large action horizon T_{a} , which compromises its responsiveness and adaptability to environmental changes. • We propose Noise-Relaying Diffusion Policy (RNR-DP) which maintains a noise-relaying buffer with progressively increasing noise levels and employs a sequential denoising mechanism. • We conduct extensive experiments on 5 tasks involving dynamic object manipulation and 4 simpler tasks that do not demand responsive control. The results consistently demonstrate that RNR-DP delivers both highly responsive and efficient control. 2 Related Work Diffusion Model Acceleration Techniques Diffusion models ( Ho et al. 2020 ) have garnered significant attention for their capacity to model complex distributions. However, their iterative sampling processes can be computationally expensive due to the large number of diffusion steps required. One approach to address the low inference speed of diffusion models is by reducing the number of denoising steps needed, as seen in works like ( Song et al. 2020 ) and ( Karras et al. 2022 ) . Another line of research employs distillation-based techniques, which begin with a pretrained teacher model and train a new student model to take larger steps over the ODE trajectories that the teacher has already learned to map, as demonstrated in ( Song et al. 2023 ) , ( Liu et al. 2023 ) , and ( Salimans & Ho 2022 ) . Among the most commonly used acceleration techniques in the robotics community are DDIM ( Song et al. 2020 ) and Consistency Models ( Song et al. 2023 ) , which are particularly effective for speeding up the diffusion policy process. Diffusion Model for Motion Synthesis Diffusion Model, renowned for its strong representational capabilities, has been widely applied to motion synthesis tasks ( Shafir et al. 2023 ) . Building on this foundation, Zhang et al. 2024 proposed an innovative framework that incorporates temporally varying denoising and maintains a motion buffer comprising progressively noised poses, enabling long-term motion synthesis. Inspired by TEDi, we develop a noise-relaying buffer with incrementally increasing noise levels and implement a sequential denoising mechanism to enhance Diffusion Policy, ensuring