ROG-Grasp: Root-Oriented Geometry for Robotic Grasping and Placement

Zijian An, Augustus Sroka, Ran Yang, Bill Cai, Satoru Eto, Brian Poon, Kelvin Cai, Shijie Geng, Feng Liu, Yiming Feng, Lifeng Zhou · 2026

Read ROG-Grasp: Root-Oriented Geometry for Robotic Grasping and Placement by Zijian An, Augustus Sroka, Ran Yang, Bill Cai, Satoru Eto, Brian Poon, Kelvin Cai, Shijie Geng, Feng Liu, Yiming Feng, Lifeng Zhou (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-00449.txt.

Introduction

An and co-authors guide farm bots to grip and place crops by the root's lean. Post-harvest work needs fruit set down in matched poses. ROG-Grasp reads pose from the root zone's own shape. It uses depth-cam views of each crop piece to do so.

A YOLO tool spots the root, and plane fits give its lean line. That line seeds a firm grip pose for the arm. Path plans hold the pose as the arm moves the piece. Tests run on tomatoes and onions in lone and packed scenes. Win rates stay high and run times stay firm in both. Next to sight-word-act plans, this shape-led route ends more grips true. It also runs them fast in the tests.

Catalog record

CREATORZijian An, Augustus Sroka, Ran Yang, Bill Cai, Satoru Eto, Brian Poon, Kelvin Cai, Shijie Geng, Feng Liu, Yiming Feng, Lifeng Zhou
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.00449

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ROG-Grasp: Root-Oriented Geometry for Robotic Grasping and Placement Zijian An, Augustus Sroka, Ran Yang, Bill Cai, Satoru Eto, Brian Poon, Kelvin Cai, Shijie Geng, Feng Liu, Yiming Feng, Lifeng Zhou Abstract Orientation-aware manipulation is essential in post-harvest agricultural processing, where produce must be grasped and placed in consistent configurations. This paper presents ROG-Grasp, a geometry-based robotic grasping and placement framework that estimates the produce orientation from root surface geometry using RGB-D perception. A YOLO-based root detector and point cloud plane fitting are used to infer the root normal, enabling stable grasp pose generation and orientation-constrained Cartesian motion planning. Experiments on tomatoes and onions demonstrate high success rates and stable execution time in both isolated and cluttered scenarios. Compared with vision–language–action (VLA) policies, the proposed method achieves more reliable and accurate grasp completion with faster execution. These results highlight the effectiveness of geometry-driven perception for practical orientation-controlled manipulation tasks. A video of our paper is available online. I Introduction Automation in agricultural production and post-harvest processing has attracted increasing attention due to rising labor costs and the demand for higher productivity. Robotic systems have therefore been widely investigated for tasks such as produce harvesting, sorting, and packaging in modern agricultural supply chains. Vision-based perception, robotic manipulation, and end-effector design are considered key enabling technologies for intelligent agricultural robots [ 25 , 11 , 19 ] . In particular, vision-guided robotic manipulators have been extensively studied for automated fruit harvesting and handling, where perception systems detect target produce and robotic arms perform grasping and transfer operations [ 26 , 20 , 9 ] . For example, strawberry harvesting robots equipped with machine vision and robotic grippers have been developed to autonomously detect and pick ripe strawberries in greenhouse environments [ 23 , 22 ] . Similarly, robotic harvesting systems for apples integrate vision modules with industrial manipulators and vacuum grippers to locate and pick fruits in orchard settings [ 13 ] . Recent work has also explored robotic manipulation strategies for tomatoes using vision-based detection and adaptive grippers designed for handling soft agricultural products [ 2 ] . These studies demonstrate the feasibility of robotic perception and grasping for agricultural products. Fig. 1: Overview of the proposed ROG-Grasp framework. The pipeline consists of two main modules: vision perception and motion execution. In the perception stage, a YOLO-based detector identifies the root region and a plane-fitting procedure estimates the produce orientation from the extracted point cloud. In the execution stage, the robot follows a sequence of intermediate waypoints to safely perform grasping and upright placement while avoiding collisions. However, beyond harvesting, post-harvest processing and packaging introduce additional requirements on manipulation accuracy and object orientation. In modern packhouses, fruits and vegetables must be sorted, transferred, and packed into trays or containers before transportation and retail [ 15 , 8 ] . Robotic systems have therefore been explored for automated fruit packing and handling in industrial environments, where robots detect produce and place them into packaging boxes or containers [ 27 ] . In some packaging lines, robotic manipulators are capable of arranging fruits in containers while maintaining consistent orientation or layout for efficient packing and improved product presentation [ 16 ] . Such orientation-aware placement is particularly relevant for high-value produce, where visually organized arrangements can enhance protection and commercial appearance. Despite these advances, most existing agricultural robotic systems primarily focus on fruit detection and grasping, while the problem of pose-controlled placement remains relatively underexplored [ 17 , 3 ] . Many harvesting robots simply pick fruits and deposit them into containers without explicitly controlling the final orientation of the object [ 21 , 7 ] . However, in practical agricultural and packaging scenarios, produce often need to be placed in specific orientations to satisfy the requirements of downstream processing, inspection, or packaging operations. For example, certain produce such as garlic, onions, and hawthorn may need to be positioned consistently during packaging or processing workflows [ 6 , 5 , 10 , 14 ] . Existing grasp planning methods frequently rely on generic grasp detection or bounding box information, which makes it difficult to infer the intrinsic orientation of irregular agricultural products. Recent studies have explored the use of vision–language–action (VLA) models to address robotic manipulation problems, demonstrating promising levels of generalization and decision-making capability in complex engineering scenarios [ 1 , 24 , 28 , 29 ] . Motivated by these advances, we also investigated the use of VLA-based policies for orientation-aware grasping of agricultural products. However, our preliminary experiments indicate that such models often struggle to reliably identify the root region of produce. As a result, end-to-end learning approaches may have difficulty achieving the orientation estimation accuracy required for stable grasping and controlled placement. To address this limitation, this paper proposes a robotic grasping method based on root surface geometry for orientation-aware manipulation of agricultural products, as shown in Figure 1 . The key observation is that many agricultural products, such as tomatoes, kiwifruits, garlic, and onions, contain a root or stem surface that exhibits approximately planar geometry with relatively small curvature. By detecting the root region and extracting its point cloud from RGB-D observations, a plane fitting method can be applied to estimate the produce orientation from the root surface. The estimated root normal provides a reliable cue for determining object orientation and generating a stable grasp pose for robotic manipulation. The proposed method enables accurate orientation-aware grasping and placement of produce, providing a practical solution for robotic agricultural manipulation tasks that require controlled placement orientation. The primary contributions of this paper are as follows: • A geometry-based method that uses root surface information to estimate the orientation of agricultural products from RGB-D observations, enabling orientation-aware robotic grasping. • A vision-guided grasp pose generation strategy that integrates YOLO root segmentation with 3D point cloud plane fitting to infer object orientation and compute stable grasp poses. • Experimental validation on multiple agricultural products, including tomato and onion, demonstrating reliable orientation-aware grasping and placement, and improved robustness compared with VLA-based policies in root localization and pose-controlled manipulation. II Related work YOLO . Deep learning–based object detection has become a standard perception approach in robotics. Among existing detectors, the YOLO (You Only Look Once) family is widely adopted due to its ability to achieve real-time performance with high detection accuracy using single-stage inference [ 12 ] . YOLO-based models have been extensively applied in agricultural vision tasks such as fruit detection, produce monitoring, and robotic harvesting, where fast and reliable perception is essential for manipulation in complex outdoor environments [ 18 ] . In this work, a YOLO-based segmentation model is employed to detect the root region of agricultural products. The detected region is then converted into a 3D point cloud from RGB-D observations, enabling geometric orientation estimation and grasp pose generation. Robot Motion Control . Industrial manipulators typically support both joint-space and Cartesian motion commands. Joint-space motion specifies target joint configurations directly, enabling fast repositioning. Cartesian motion commands specify a desired robot flange pose in task space SE(3) , which is commonly parameterized by position \mathbf{p}\in\mathbb{R}^{3} and orientation \mathbf{R}\in\mathbb{R}^{3\times 3} , requiring inverse kinematics (IK) to compute the corresponding joint trajectories. For a typical 6-DoF manipulator, the IK problem may admit multiple feasible

Read the complete text