Robotic Paper Wrapping by Learning Force Control

Hiroki Hanai, Takuya Kiyokawa, Weiwei Wan, Kensuke Harada · 2025

Read Robotic Paper Wrapping by Learning Force Control by Hiroki Hanai, Takuya Kiyokawa, Weiwei Wan, Kensuke Harada (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-15685.txt.

Introduction

Hanai and co-authors teach in 2025 a robot to wrap objects in paper by learning force control. Paper deforms in complex ways, and small path or force errors tear or wrinkle it. Material traits vary too, which breaks fixed programs.

Their framework joins imitation learning with reinforcement learning for each wrapping step. The robot follows rough tool paths from human demos while tuning force settings to avoid tears and wrinkles. Ablation tests showed high task success with far fewer defects. The force strategy adapted across paper types and stayed robust when the target object changed size, which matters for real packaging work.

Catalog record

CREATORHiroki Hanai, Takuya Kiyokawa, Weiwei Wan, Kensuke Harada
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-15685

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robotic Paper Wrapping by Learning Force Control Hiroki Hanai, Takuya Kiyokawa, Weiwei Wan, Kensuke Harada Abstract Robotic packaging using wrapping paper poses significant challenges due to the material’s complex deformation properties. The packaging process itself involves multiple steps, primarily categorized as folding the paper or creating creases. Small deviations in the robot’s arm trajectory or force vector can lead to tearing or wrinkling of the paper, exacerbated by the variability in material properties. This study introduces a novel framework that combines imitation learning and reinforcement learning to enable a robot to perform each step of the packaging process efficiently. The framework allows the robot to follow approximate trajectories of the tool-center point (TCP) based on human demonstrations while optimizing force control parameters to prevent tearing or wrinkling, even with variable wrapping paper materials. The proposed method was validated through ablation studies, which demonstrated successful task completion with a significant reduction in tear and wrinkle rates. Furthermore, the force control strategy proved to be adaptable across different wrapping paper materials and robust against variations in the size of the target object. I Introduction Automation in product packaging is increasingly in demand as the final stage in the manufacturing process. However, robotic wrapping using wrapping paper remains an unresolved challenge, despite its potential benefits. Consider the task of wrapping a box-shaped object. As observed in human wrapping tasks (illustrated in Fig. 1 ), this process consists of three main sub-tasks: folding the paper along the box’s edges, labeled as the folding task (FT); pressing the paper onto the surface to create creases, labeled as the creasing task 1 (CT1); and creasing the paper’s mountain folds without contacting the box, labeled as the creasing task 2 (CT2). For successful automation, a robot must be capable of handling diverse paper materials with varying degrees of tearability and susceptibility to wrinkling. Even small deviations in the robot’s end-effector trajectory or contact force during folding or creasing can result in tears or wrinkles, making precise force control a critical factor. These control parameters must be dynamically adjusted to account for the properties of the paper material, which makes this task both complex and non-trivial. (a) Human demonstration (b) Trajectory learning in simulation (c) Force learning in real-world Fig. 1 : Wrapping actions addressed in our learning framework To address this problem, we propose a learning framework for autonomous wrapping that integrates imitation learning (IL) [ 1 ] and reinforcement learning (RL) [ 2 ] . In this framework, IL allows the robot to learn approximate trajectories of the tool-center point (TCP) from human demonstrations, resulting in smooth and stable motion. Although force control is effective in wrapping tasks to prevent the paper from tearing and wrinkling, the force control policies obtained through IL may not be directly transferred to a robotic system due to differences in the dynamic characteristics between humans and robots. RL, on the other hand, enables the robot to acquire appropriate trajectories and force control parameters stably interacting with the environment. Despite its advantages, RL may result in paper tearing and wrinkling due to inefficient policy sampling during learning and repeated trial and error. To overcome these limitations, we propose a hybrid approach that combines the strengths of IL and RL. By using IL to constrain the search space of RL with pre-learned trajectories, we mitigate the inefficiencies inherent in RL’s exploration. Simultaneously, RL refines force control parameters, complementing the limitations of IL. In our approach, IL first identifies task phases and extracts target trajectories from human wrapping demonstrations. Subsequently, RL learns the appropriate force control strategies, generating appropriate force vectors tailored to the material properties of the wrapping paper. This integrated learning framework enables the robot to acquire both trajectory and force control parameters, facilitating the precise application of force in the right amount and direction for different paper materials. As a result, our method offers a robust and efficient solution for performing reliable wrapping operations across a wide range of materials. This paper is organized as follows: after introducing related works in Section 2, the problem setting is explained in Section 3. The proposed method is explained in Section 4. Finally, we show the experimental results to confirm the effectiveness of the proposed method in Section 5. II Related Works For the research on deformable object manipulation, much research on cloth manipulation has been done so far. The research includes online cloth folding with shape estimation [ 3 ] , estimation of the tensile vector for stretching cloth [ 4 ] , simulation-based state estimation [ 5 ] , predicting the cloth state using graph neural networks [ 6 ] , and predicting the trajectory of cloth using reinforcement learning [ 7 ] . However, these methods do not take into account the stiffness of the material and are not suitable for folding or creating creases in paper since we cannot prevent paper from tearing or wrinkling. The research on rope manipulation includes the prediction model from image-based demonstration data [ 8 ] , estimation of physical parameters [ 9 ] , and realization of tying task by using the image-based imitation learning [ 10 ] . In addition, some research on paper manipulation has been done, including paper folding by predicting the force generated on paper [ 11 ] , continuous valley folding of origami with a multi-fingered [ 12 ] , and vision-based paper folding by predicting paper deformation [ 13 ] . However, there is no research on the full automation of the packaging operation without the use of a specialized hand for paper folding. For the research on RL of deformation-adaptive controllers, Zhao et al. [ 14 ] introduced a framework that combines offline meta-RL and online fine-tuning to achieve various shapes of peg insertion tasks with high success rates with fixed material and friction. Similarly, Pong et al. [ 15 ] proposed a learning framework that combines offline meta-RL and estimation of the reward function with online fine-tuning. For the research on few-shot IL from demonstrations, Du et al. [ 16 ] presented a state and action retrieval IL approach to estimate current state and action strategies from a large unlabeled dataset. Jang et al. [ 17 ] proposed a method to acquire action strategies, such as trajectory and gripper opening/closing, of a robot to perform tasks in zero-shot by combining a large multi-task dataset in image format, a video of a human demonstration, and natural language vectors. However, it is unclear whether the framework can be adapted to flexible object manipulation, which needs careful adjustment of force control parameters. For the research on combining RL and IL, Wang et al. [ 18 ] used IL to acquire trajectories from human demonstrations and RL to learn force control strategies that adapt to the trajectories obtained through IL. However, the aforementioned approach cannot be implemented to the wrapping task. On the other hand, this is the first trial on realizing the wrapping task needs careful adjustment of force control parameters comprising both folding and creating creases. Recently, some vision-based imitation learning like Diffusion Policy [ 19 ] and Action Chunking Transformer [ 20 ] has been proposed and is widely used. Although we do not use such

Read the complete text