A Dataset and Benchmark for Robotic Cloth Unfolding Grasp Selection: The ICRA 2024 Cloth Competition

Victor-Louis De Gusseme, Thomas Lips, Remko Proesmans, Julius Hietala, Giwan Lee, Jiyoung Choi, Jeongil Choi, Geon Kim, Phayuth Yonrith, Domen Tabernik, Andrej Gams, Peter Nimac, Matej Urbas, Jon Muhovič, Danijel Skočaj, Matija Mavsar, Hyojeong Yu, Minseo Kwon, Young J. Kim, Yang Cong, Ronghan Chen, · 2025

Read A Dataset and Benchmark for Robotic Cloth Unfolding Grasp Selection: The ICRA 2024 Cloth Competition by Victor-Louis De Gusseme, Thomas Lips, Remko Proesmans, Julius Hietala, Giwan Lee, Jiyoung Choi, Jeongil Choi, Geon Kim, Phayuth Yonrith, Domen Tabernik, Andrej Gams, Peter Nimac, Matej Urbas, Jon Muhovič, Danijel Skočaj, Matija Mavsar, Hyojeong Yu, Minseo Kwon, Young J. Kim, Yang Cong, Ronghan Chen, (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-16749.txt.

Introduction

Victor-Louis De Gusseme led a large team reporting a robot cloth competition in a 2025 paper. Robots struggle with cloth, and the field lacked shared benchmarks to compare methods fairly. Their contest, run at a major robotics meeting, focused on one task: choosing where to grasp cloth so a robot can unfold it in the air. Eleven teams took part with varied methods.

The public dataset holds hundreds of real unfolding attempts across dozens of garments, including the contest trials. Hand-built methods did surprisingly well, and there was a clear trade-off between grasp success and coverage. Contest results also differed sharply from earlier lab reports, stressing outside testing.

Catalog record

CREATORVictor-Louis De Gusseme, Thomas Lips, Remko Proesmans, Julius Hietala, Giwan Lee, Jiyoung Choi, Jeongil Choi, Geon Kim, Phayuth Yonrith, Domen Tabernik, Andrej Gams, Peter Nimac, Matej Urbas, Jon Muhovič, Danijel Skočaj, Matija Mavsar, Hyojeong Yu, Minseo Kwon, Young J. Kim, Yang Cong, Ronghan Chen,
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-16749

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Dataset and Benchmark for Robotic Cloth Unfolding Grasp Selection: The ICRA 2024 Cloth Competition Victor-Louis De Gusseme, Thomas Lips, Remko Proesmans, Julius Hietala, Giwan Lee, Jiyoung Choi, Jeongil Choi, Geon Kim, Phayuth Yonrith, Domen Tabernik, Andrej Gams, Peter Nimac, Matej Urbas, Jon Muhovič, Danijel Skočaj, Matija Mavsar, Hyojeong Yu, Minseo Kwon, Young J. Kim, Yang Cong, Ronghan Chen, Yu Ren, Supeng Diao, Jiawei Weng, Jiayue Liu, Haoran Sun, Linhan Yang, Zeqing Zhang, Ning Guo, Lei Yang, Fang Wan, Chaoyang Song, Jia Pan, Yixiang Jin, Yong A, Jun Shi, Dingzhe Li, Yong Yang, Kakeru Yamasaki, Takumi Kajiwara, Yuki Nakadera, Krati Saxena, Tomohiro Shibata, Chongkun Xia, Kai Mo, Yanzhao Yu, Qihao Lin, Binqiang Ma, Uihun Sagong, JungHyun Choi, JeongHyun Park, Dongwoo Lee, Yeongmin Kim, Myun Joong Hwang Yusuke Kuribayashi, Naoki Hiratsuka, Daisuke Tanaka, Solvi Arnold, Kimitoshi Yamazaki, Carlos Mateo-Agullo, Andreas Verleysen, Francis wyffels Abstract Robotic cloth manipulation suffers from a lack of standardized benchmarks and shared datasets for evaluating and comparing different approaches. To address this, we created a benchmark and organized the ICRA 2024 Cloth Competition, a unique head-to-head evaluation focused on grasp pose selection for in-air robotic cloth unfolding. Eleven diverse teams participated in the competition, utilizing our publicly released dataset of real-world robotic cloth unfolding attempts and a variety of methods to design their unfolding approaches. Afterwards, we also expanded our dataset with 176 competition evaluation trials, resulting in a dataset of 679 unfolding demonstrations across 34 garments. Analysis of the competition results revealed insights about the trade-off between grasp success and coverage, the surprisingly strong achievements of hand-engineered methods and a significant discrepancy between competition performance and prior work, underscoring the importance of independent, out-of-the-lab evaluation in robotic cloth manipulation. The associated dataset is a valuable resource for developing and evaluating grasp selection methods, particularly for learning-based approaches. We hope that our benchmark, dataset and competition results can serve as a foundation for future benchmarks and drive further progress in data-driven robotic cloth manipulation. keywords benchmarking, datasets, cloth manipulation, unfolding, robotics competition † † runninghead: De Gusseme et al. † † corresponding: Francis wyffels, AI and Robotics Lab (IDLab-AIRO), Ghent University - imec, Ghent, Belgium. 1 Introduction Figure 1: Impression of the ICRA 2024 Cloth Competition on in-air unfolding. The dual-arm robotic setup, surrounded by participants and spectators, executes the final stretching motion to achieve a nearly perfectly unfolded T-shirt. All competition evaluations were conducted on-site at the conference in Yokohama, Japan, using this standardized, shared setup. Datasets and benchmarks play a crucial role in the field of robotics, providing the means for objective evaluation, tracking progress through time, and ensuring reproducibility ( Calli et al. 2015 ) . They facilitate a shared understanding of the state-of-the-art, allow for analyzing remaining challenges and provide a means of interaction between individual laboratories. Significant progress has been made in benchmarking rigid object manipulation ( Kimble et al. 2020 ; Cruciani et al. 2020 ) , particularly in grasping and pick-and-place tasks ( Correll et al. 2018 ; D’Avella et al. 2023 ) . However, the challenges inherent to deformable object manipulation ( Sanchez et al. 2018 ; Yin et al. 2021 ; Kadi and Terzić 2023 ) , especially with cloth ( Longhini et al. 2024 ) , have led to a comparative lack of shared datasets and standardized benchmarks ( Garcia-Camacho et al. 2020 ) . The deformability of cloth poses unique challenges for reproducibility, necessitating dedicated efforts in this domain. Building on previous work on benchmarking cloth manipulation ( García-Camacho et al. 2022 ) , we present the IEEE International Conference on Robotics and Automation (ICRA) 2024 Cloth Competition and its associated dataset and benchmark. The benchmark and competition focus on grasp selection algorithms for in-air robotic cloth unfolding, and the format was streamlined to focus the participant’s efforts on grasp selection. Rigorous evaluation was prioritized by testing generalization to different cloth items, using objective and automated evaluation, and performing on-site, live evaluations on a shared robot platform. The competition ultimately conducted 176 evaluations across 11 diverse teams. This effort resulted in a comprehensive dataset of 679 real-world robotic cloth unfolding attempts across 34 diverse garments, making it one of the largest and most diverse datasets in this domain. The competition and the dataset enjoy a symbiotic relationship, with the competition illustrating the dataset’s utility and actively contributing to the dataset’s enhancement: The dataset enables the competition by providing training data, while the competition enriches the dataset with new unfolding attempts and diverse grasp strategies, creating a cycle of mutual improvement. This highlights the benefits of combining benchmarks with curated datasets to drive progress in robotic manipulation. In this paper, we present the benchmark for in-air robotic unfolding, the associated dataset and the outcomes of our cloth competition, which was held live at ICRA 2024 in Yokohama, Japan, as part of the 9th edition of the Robotic Grasping and Manipulation Competitions ( Sun et al. 2022 ; Sun et al. 2024 ) (Figure 1 provides an impression of the live trials). We discuss insights gained into the current state-of-the-art in cloth unfolding, including the surprising effectiveness of hand-engineered, traditional geometric methods and the impact of the competition’s design choices, such as the focus on single-attempt grasp selection. The winning team’s promising 0.60 average coverage serves to ground other unfolding methods, but also underscores that robotic cloth unfolding remains an open challenge. In summary, this paper’s three contributions are: 1. A Novel Benchmark for Robotic Cloth Unfolding : A standardized benchmark focused on objectively evaluating grasp selection strategies for unfolding garments. 2. The ICRA 2024 Cloth Competition : A unique head-to-head competition based on the proposed benchmark, involving 11 diverse teams and resulting in valuable insights into the state-of-the-art in robotic cloth manipulation. 3. A Large Dataset of Cloth Unfolding Attempts : A diverse dataset of 679 real-world robotic cloth unfolding attempts, used by the participants to prepare for the competition and extended with the data collected during the live evaluation trials of the participants’ developed algorithms. The dataset and benchmarking code are available at https://airo.ugent.be/cloth_competition/ . 2 Related Work 2.1 Cloth Unfolding 2.1.1 Overview of Cloth Unfolding Strategies Cloth unfolding is a critical prerequisite for various downstream cloth manipulation tasks such as folding, hanging, ironing, and assisted dressing. Researchers have explored various unfolding strategies, with computer vision often playing an important role. For a general introduction to using computer vision for cloth manipulation, we refer the reader to the surveys by Jiménez 2017 and Jiménez and Torras 2020 . The strategy evaluated in our benchmark and competition aligns with what Jimenez identifies as Grasp Point Localisation , one of three key visual tasks he proposes as fundamental to cloth manipulation, alongside classification and state estimation. Grasp point localisation is deemed fundamental because, as Jiménez 2017 aptly states: “Any manipulative action requires instructing the robot where to grasp.” Combining well-placed grasps with open-loop motions can be sufficient for completing many manipulation tasks. For instance, unfolding might be achieved with a predetermined stretch motion after determining two appropriate grasp poses on the cloth. Jimenez further classifies grasp points into generic and specific categories. Generic points, such as the highest and lowest points grasped when lifting crumpled garments, are typically

Read the complete text