Surface Constraint Policy for Learning Surface-Constrained and Dynamically Feasible Robot Skills
Shuai Ke, Jiexin Zhang, Huan Zhao, Zhiao Wei, Yikun Guo, Jie Pan · 2026
Read Surface Constraint Policy for Learning Surface-Constrained and Dynamically Feasible Robot Skills by Shuai Ke, Jiexin Zhang, Huan Zhao, Zhiao Wei, Yikun Guo, Jie Pan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31321.txt.
Introduction
Ke and colleagues teach robots surface-bound skills with a surface constraint policy. Diffusion-based copying struggles where free-form surface limits demand clear shape and doable motion. It gives shaky fit and unstable contact. Their policy encodes surface shape with a weighted Gaussian kernel from demos. It infers action aims from visual and state inputs, then maps them into surface-bound dynamic movement primitives. Tests on multiple surface handling tasks show better success rates and contact grip over older methods.
Catalog record
| CREATOR | Shuai Ke, Jiexin Zhang, Huan Zhao, Zhiao Wei, Yikun Guo, Jie Pan |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52140 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.31321
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Surface Constraint Policy for Learning Surface-Constrained and Dynamically Feasible Robot Skills Thanks: This work was supported by the National Natural Science Foundation of China under Grants U24A20130, 52505016, and 52188102. (Corresponding author: Jiexin Zhang.) Thanks: The authors are with the State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan 430074, China.(e-mail: [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected]; [email protected].) Shuai Ke, Jiexin Zhang, Huan Zhao, Zhiao Wei, Yikun Guo, Jie Pan Abstract Diffusion-based imitation learning methods have driven rapid progress in robot dexterous manipulation tasks. However, they have limitations when applied to tasks that involve complex free-form surface constraints because of their lack of explicit surface geometry constraint modeling and the dynamic feasibility issue, resulting in stochastic action generation that fails to achieve reliable surface alignment and maintain stable contact. To address these limitations, we propose a novel surface constraint policy (SCP) for generating robot actions that satisfy free-form surface constraints on the basis of human demonstrations and real-time visual observations. First, the surface geometry constraint is encoded using a two-dimensional weighted Gaussian kernel function that is derived from demonstrations. Building on the encoded surface geometry constraints, the diffusion-based policy is used to infer task-level action intentions from multimodal sensory inputs, including visual observations and robot state feedback. These intentions are further transformed into surface-constrained dynamic movement primitives (DMPs) through a similarity-based action mapping method, thereby enabling smooth and compliant motion execution. The SCP achieves generation of structured surface geometric intent and dynamically admissible actions. The proposed method is validated on multiple surface manipulation tasks and compared with existing techniques. The experimental results demonstrate superior task success rates and contact stability under surface constraints. I Introduction Imitation learning for robots has rapidly advanced in recent years. Early approaches relied primarily on explicit modeling of demonstration trajectories [ 1 , 2 ] , such as Gaussian mixture models (GMMs) [ 3 ] , hidden Markov models (HMMs) [ 4 ] , and kernelized movement primitives (KMPs), which reproduce demonstrated behaviors by fitting trajectory distributions in structured spaces. Inverse reinforcement learning (IRL) [ 5 , 6 ] was subsequently developed to infer latent reward functions from demonstrations, thereby reducing the dependence on manually designed and structured state–action mappings [ 7 ] . While these approaches have alleviated the dependence on explicitly designed structured state–action mappings, their performance remains constrained when handling rich multimodal sensory inputs and achieving robust generalization in complex robotic manipulation tasks [ 8 , 9 ] . Generative-model-based imitation learning approaches have attracted increasing attention and are emerging as a key direction for enhancing robot skill generalization and task adaptability. For example, generative adversarial networks [ 10 ] , action chunking with transformers (ACT) [ 11 ] , and diffusion-based approaches [ 8 , 12 , 14 ] involve attempting to directly map sensory inputs to complete action trajectories in an end-to-end fashion. These approaches demonstrate strong robustness and diversity [ 12 ] and achieve improved policy stability and generalization across task variations and environmental perturbations while avoiding the need for complex reward functions or handcrafted features. They have achieved notable success in tasks such as deformable object manipulation [ 15 ] , pouring [ 16 , 18 ] , and assembly [ 17 ] . Fig. 1: Example of a surface-constrained robotic task: Aircraft windscreen cleaning. The robot is required to grasp a cleaning tool and perform wiping along the glass surface while maintaining stable contact at the correct angle to remove surface stains. Areas with contact gaps that are caused by incorrect tool angles or unstable contact may lead to residual stains. However, generative-model-based imitation learning approaches still face challenges in handling tasks that involve geometric constraints on complex surfaces, such as wiping [ 19 ] , polishing [ 20 ] , and ultrasound scanning [ 21 , 22 ] . Fig. 1 illustrates a typical surface-constrained task. These tasks impose dual requirements on the robot, namely, that its contact posture must follow the geometric variations of the target surface, while the contact process must remain continuous and stable [ 25 ] . Current mainstream approaches focus primarily on global motion planning or coarse-grained task-level control [ 12 , 16 ] , while lacking explicit surface geometry constraint modeling and dynamic feasibility considerations. The lack of explicit surface geometry constraint modeling leads to increased surface-alignment errors, while insufficient consideration of dynamic feasibility results in large motion accelerations and irregular trajectory curvature. In this work, dynamic feasibility refers to the smooth and stable executability of the generated trajectories on a real robot. The combined effects of these issues often cause loss of contact or surface damage during task execution, ultimately degrading task completion efficiency and reducing success rates. In various studies, constraints have been introduced during training [ 26 , 27 , 28 , 29 ] ; however, effective generalization to freeform surface tasks remains challenging. In robot manipulation tasks involving surface geometry constraints, existing methods still face challenges in fine-grained geometric action intent generation and dynamically feasible execution. I-A Related Work To comprehensively understand the capabilities and limitations of existing methods in these aspects, we further review imitation learning approaches involving geometric constraints before presenting our proposed method and contributions. The related work is analyzed from the perspectives of precision action intent generation and dynamic behavior execution. I-A 1 Precision Action Intent Generation Currently, action generation strategies that are based on generative models struggle to directly infer robot behaviors subject to surface geometry constraints. In one line of research, researchers have sought to improve the granularity and accuracy of inferred action intent by enhancing visual input quality. For instance, Ze et al. [ 17 ] proposed a 3D diffusion policy to incorporate 3D point cloud information for fine-grained behavior generation, thereby significantly improving manipulation performance. Similarly, Chi et al. [ 30 ] developed a handheld gripper that records pose data and improves monocular vision with mirror extensions during demonstrations to support precise manipulation learning. Despite these advances, owing to the absence of explicit constraints on the generated output actions, ensuring geometric consistency remains challenging. To address this, in various works, researchers have attempted to introduce constraints directly into generative models. Bastek et al. [ 27 ] proposed physics-informed diffusion models, which apply physics-based loss functions to encourage physically plausible samples. Nevertheless, such methods cannot strictly enforce constraint satisfaction. Giannone et al. [ 28 ] further introduced diffusion optimization models and incorporated a trajectory-alignment mechanism to optimize behavior during sampling. However, this approach fails to account for data uncertainty during optimization, thus often resulting in behavior that significantly deviates from the original data distribution. Other studies have ensured interaction with manipulated objects by reasoning about contact forces. Notably, Aburub et al. proposed the DIPCOM [ 13 ] , a diffusion-based policy learning approach designed for compliant, contact-rich manipulation. Distinct from traditional methods that solely plan trajectories or forces, DIPCOM leverages the powerful multi-modal distribution modeling capabilities of diffusion models to simultaneously predict end-effector poses and dynamically adjust arm stiffness. This enables the implicit learning of adaptive compliance strategies directly from expert demonstrations. In contrast, Hou et al. introduced the adaptive compliance policy (ACP) [ 31 ] , which jointly predicts trajectories and