Accurate 3D Grapevine Structure Extraction from High-Resolution Point Clouds

Harry Dobbs 1 , Casey Peat 1 , Oliver Batchelor 2 , James Atlas 2 , Richard Green 2 · 2025

Read Accurate 3D Grapevine Structure Extraction from High-Resolution Point Clouds by Harry Dobbs 1 , Casey Peat 1 , Oliver Batchelor 2 , James Atlas 2 , Richard Green 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20417.txt.

Introduction

Harry Dobbs and co-authors build a method that extracts the 3D structure of grapevines from laser scans, in a 2025 paper. Growers prune vines by hand, and good pruning needs a clear map of each cane. Point clouds from scanners hold that detail, but vine shapes tangle easily and defeat standard skeleton tools. The team adapted an existing tree algorithm, Smart-Tree, to the vine's special form.

A graph-based step untangles which skeleton lines belong to which cane. That split matters, since pruning choices are made cane by cane. Tests on annotated scans of real vines showed the score for correct extraction rose by about sixteen percent over the base algorithm. The authors say better vine models can support automated care and pruning. Gains in sustainability and profit for grape production are the longer aim.

Catalog record

CREATORHarry Dobbs 1 , Casey Peat 1 , Oliver Batchelor 2 , James Atlas 2 , Richard Green 2
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-20417

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Accurate 3D Grapevine Structure Extraction from High-Resolution Point Clouds Harry Dobbs 1 , Casey Peat 1 , Oliver Batchelor 2 , James Atlas 2 , Richard Green 2 Abstract Accurate 3D modelling of grapevines is crucial for precision viticulture, particularly for informed pruning decisions and automated management techniques. However, the intricate structure of grapevines poses significant challenges for traditional skeletonization algorithms. This paper presents an adaptation of the Smart-Tree algorithm for 3D grapevine modelling, addressing the unique characteristics of grapevine structures. We introduce a graph-based method for disambiguating skeletonization. Our method delineates individual cane skeletons, which are crucial for precise analysis and management. We validate our approach using annotated real-world grapevine point clouds, demonstrating an improvement of 15.8% in the F1 score compared to the original Smart-Tree algorithm. This research contributes to advancing 3D grapevine modelling techniques, potentially enhancing both the sustainability and profitability of grape production through more precise and automated viticulture practices. PubID: pubid: 979-8-3315-1877-6/24/$31.00 ©2024 IEEE Figure 1 : Left to right: Input grapevine point cloud, segmented vine point cloud, and final 3D structure. I Introduction Crucial to the agricultural industry, grapevines require precise management for optimal growth, health, and yield. Pruning is a critical tool for manipulating vine structure, regulating crop load, and maintaining balance [ 1 ] . It serves three primary purposes: shaping vines to conform with trellis systems and facilitate vineyard operations; removing old wood and retaining fruiting canes or spurs for current and future seasons; and selecting fruiting wood that balances vine growth and capacity. Improper pruning can have severe consequences, including disrupted sap flows, increased disease susceptibility, yield reduction, and premature plant death [ 2 ] . Accurate 3D models of grapevines are essential for informed pruning decisions and optimised vineyard management. Precision agriculture techniques rely heavily on these models [ 3 ] , but grapevines’ intricate branching patterns and thin stems present significant challenges for traditional skeletonization algorithms. I-A Motivation While our previously introduced Smart-Tree [ 4 ] point cloud skeletonization algorithm has shown promise for various tree species, its direct application to grapevines is suboptimal. The dense, intricate structure of grapevines, with numerous canes growing nearby and often intertwining, poses unique challenges. This complexity can lead to frequent failure cases (detailed in Section III ) where multiple canes are incorrectly merged or branching topology is misinterpreted, significantly impacting subsequent analyses. This paper presents a comprehensive study on adapting Smart-Tree for 3D grapevine modelling. We discuss specific algorithm modifications, including integrating prior knowledge and refining processing techniques. We validate our adapted approach using annotated real-world grapevine point cloud data, demonstrating improved accuracy and robustness in handling grapevine structures. The main contributions of this paper are: 1. Adaptation of the Smart-Tree algorithm to grapevine-specific characteristics and requirements. 2. Incorporation of domain-specific knowledge to enhance accuracy and robustness. 3. Development of methods to delineate individual cane skeletons for precise analysis and management. 4. Validation of the adapted approach using real-world grapevine point cloud data. This research advances 3D grapevine modelling, enabling precise viticulture techniques. Our tailored skeletonization method contributes to innovative vineyard management tools, aiming to enhance grape production’s sustainability and profitability. II Related Work Recent advancements in agricultural robotics have focused on automating tasks such as harvesting, yield estimation, and pruning. This section reviews relevant work in vineyard automation and 3D plant modelling. II-A Agricultural Robotics and Image Analysis Robotic systems for fruit harvesting have been developed for crops like apples, and kiwifruit [ 5 , 6 ] , demonstrating the potential for agricultural automation. Yield estimation techniques have progressed from seasonal model-based predictions [ 7 ] to direct fruit counting using deep learning [ 8 ] . II-B Grapevine modelling and Pruning Several approaches have been proposed for grapevine modelling and automated pruning: • Botterill et al. [ 9 ] developed a pruning robot using a trinocular camera system for 3D reconstruction but faced challenges with occlusion and lighting control. • Gentilhomme et al. [ 2 ] used an hourglass CNN to identify nodes and reveal skeletal structure but struggled with occlusions and erroneous connections. • Silwal et al. [ 10 ] proposed the Bumblebee system for spur pruning, achieving 87% pruning accuracy, but with limited evaluation of the 3D modelling performance. • Williams et al. [ 3 ] presented a vision system for autonomous cane pruning, generating 3D models with skeletonized cane structures. Their system modelled 51.45% of canes entirely, with an additional 35.51% II-C Limitations in Current Approaches Despite these advancements, most existing approaches rely on 2D image processing, limited 3D reconstruction from stereo vision, or simplified 3D models. Using high-resolution point clouds for detailed grapevine structure modelling remains largely unexplored. This gap is significant as high-resolution point cloud models can provide more accurate and comprehensive representations of grapevine structures, potentially improving performance in pruning, yield estimation, and overall vine management tasks. Our work addresses this gap by adapting the Smart-Tree algorithm to work with high-resolution 3D point cloud data of grapevines, aiming to advance precision viticulture techniques. III Challenges in Grapevine Skeletonization Skeletonization algorithms face significant challenges when applied to grapevines’ complex structures. We identify three primary failure cases: broken canes, cane jumping, and incorrect cane correspondence. These issues are particularly prevalent in methods utilizing shortest-path algorithms, which are prevalent in the field. III-A Cane Jumping Cane jumping is widespread in skeletonization algorithms that rely on shortest-path computations. This phenomenon occurs when the algorithm incorrectly ”jumps” from one cane to another where they grow close together or cross. The cane jumping error typically occurs when the algorithm correctly traces the first cane (C1) from its base to its tip. Still, when tracing the second cane (C2), continuing along C1 provides a shorter route to the termination points. As a result, C2 erroneously terminates where it meets C1, and the algorithm generates an additional, incorrect cane (C3) to account for the remaining untraced points. This error leads to prematurely terminated canes and the generation of erroneous additional canes, significantly distorting the vine’s structure (Fig. 2 ). C1 C3 C2 C1 C2 Figure 2 : Cane Jumping: Left: Incorrect output showing C2 terminating at C1 and formation of erroneous C3. Right: Target output with correctly separated canes. III-B Incorrect Cane Correspondence Incorrect cane correspondence occurs when the algorithm erroneously merges multiple distinct canes into a single skeletal structure. This issue arises when tracing a path that inadvertently incorporates portions of numerous canes. Fig. 3 illustrates this problem: the left image shows two distinct canes incorrectly labelled as C1 (red and blue) merged at their intersection. This results in merged canes that should be separate, prematurely terminated canes where they intersect with previously traced paths and a misrepresentation of the vine’s true topology. The right image displays the correct output, where the red cane remains C1, and the blue cane is properly identified as C2. C1 C2 C1 C2 Figure 3 : Cane Correspondence: Left: Incorrect output showing merged canes both labelled C1. Right: Correct output with properly separated canes C1 and C2. III-C Broken Canes Broken canes stem from gaps in point cloud data or segmentation inaccuracies, resulting in disconnected components in the initial data. The main challenge lies in correctly identifying and connecting these components. Failure to do

Read the complete text