Can 3D point cloud data improve automated body condition score prediction in dairy cattle?

Zhou Tang, Jin Wang, Angelo De Castro, Yuxi Zhang, Victoria Bastos Primo, Ana Beatriz Montevecchio Bernardino, Gota Morota, Xu Wang, Ricardo C Chebel, Haipeng Yu · 2026

Read Can 3D point cloud data improve automated body condition score prediction in dairy cattle? by Zhou Tang, Jin Wang, Angelo De Castro, Yuxi Zhang, Victoria Bastos Primo, Ana Beatriz Montevecchio Bernardino, Gota Morota, Xu Wang, Ricardo C Chebel, Haipeng Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22522.txt.

Introduction

Zhou Tang and a large team test whether 3D point clouds can grade a dairy cow's body condition on their own. Body condition scores track a cow's fat and health, and guide feeding. Their 2026 preprint asks if depth-based shape data beat flat images for auto scoring.

Point clouds hold the true curve of the back and hips, where fat shows. A sound auto score saves labor and catches health slips early. The team weigh the added worth of the depth data. The work fits precision farming, where each cow's state counts. It is a clear, practical test.

Catalog record

CREATORZhou Tang, Jin Wang, Angelo De Castro, Yuxi Zhang, Victoria Bastos Primo, Ana Beatriz Montevecchio Bernardino, Gota Morota, Xu Wang, Ricardo C Chebel, Haipeng Yu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22522

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Can 3D point cloud data improve automated body condition score prediction in dairy cattle? Zhou Tang, Jin Wang, Angelo De Castro, Yuxi Zhang, Victoria Bastos Primo, Ana Beatriz Montevecchio Bernardino, Gota Morota, Xu Wang, Ricardo C Chebel, Haipeng Yu Abstract ∗ Corresponding author: [email protected] Running title: Point clouds for BCS prediction Keywords: computer vision, deep learning, depth image, keypoint detection ORCID: 0000-0003-0111-2568 (ZT), 0009-0001-4389-4396 (JW), 0000-0002-8712-6153 (AD), 0009-0007-7519-3512 (YZ), 0009-0005-8731-3935 (VP), 0000-0003-1255-9066 (AB), 0000-0002-3567-6911 (GM), 0000-0002-7144-6865 (XW), 0000-0002-9700-8089 (RCC), and 0000-0002-8923-9733 (HY) Email address: [email protected] (ZT), [email protected] (JW), [email protected] (AD), [email protected] (YZ), [email protected] (VP), [email protected] (AB), [email protected] (GM), [email protected] (XW), [email protected] (RCC), and [email protected] (HY) Abstract Body condition score (BCS) is a widely used indicator of body energy status and is closely associated with metabolic status, reproductive performance, and health in dairy cattle; however, conventional visual scoring is subjective and labor-intensive. Computer vision approaches have been applied to BCS prediction, with depth images widely used because they capture geometric information independent of coat color and texture. More recently, three-dimensional point cloud data have attracted increasing interest due to their ability to represent richer geometric characteristics of animal morphology, but direct head-to-head comparisons with depth image–based approaches remain limited. In this study, we compared top-view depth image and point cloud data for BCS prediction under four settings: 1) unsegmented raw data, 2) segmented full-body data, 3) segmented hindquarter data, and 4) handcrafted feature data. Prediction models were evaluated using data from 1,020 dairy cows collected on a commercial farm, with cow-level cross-validation to prevent data leakage. Depth image–based models consistently achieved higher accuracy than point cloud–based models when unsegmented raw data and segmented full-body data were used, whereas comparable performance was observed when segmented hindquarter data were used. Both depth image and point cloud approaches showed reduced accuracy when handcrafted feature data were employed compared with the other settings. Overall, point cloud–based predictions were more sensitive to noise and model architecture than depth image–based predictions. Taken together, these results indicate that three-dimensional point clouds do not provide a consistent advantage over depth images for BCS prediction in dairy cattle under the evaluated conditions. Introduction Body condition score (BCS) is a widely used indicator of body fat accumulation, reflecting nutritional status, health, fertility, and milk yield in dairy cattle ( 34 ; 12 ; 31 ; 9 ) . Routine monitoring of BCS is therefore essential for timely farm management decisions and animal welfare support. However, traditional visual scoring performed by trained experts is subjective, labor-intensive, and often inconsistent across assessors ( 32 ) . With continued global population growth, increasing milk production per cow is required to meet rising nutritional demands ( 7 ) , placing greater pressure on the need for efficient and scalable farm management practices. An automated digital BCS system that provides objective, repeatable, and scalable measurements therefore has strong potential to support these management goals. Early automated BCS assessment using computer vision primarily relied on red, green, and blue (RGB) images, often extracting handcrafted contour-based features from the hindquarter region ( 4 ; 2 ; 3 ) . These approaches typically require manual annotation of anatomical keypoints, which limits scalability. The emergence of deep learning enabled end-to-end solutions by allowing neural networks to automatically learn relevant patterns from images, thereby eliminating the need for explicit feature design ( 16 ) . Various neural network architectures trained on RGB images have demonstrated improved BCS prediction accuracy compared with handcrafted features, including convolutional neural networks ( 17 ; 10 ; 28 ) and transformers ( 46 ) . Low-cost RGB sensor data have also been explored using lightweight neural network models ( 38 ; 22 ) . Nevertheless, RGB-based approaches remain sensitive to environmental illumination, background clutter, and camera viewpoint, which can limit robustness across farms. Moreover, the absence of explicit geometric information can bias predictions due to variations in coat color and texture. Depth sensors provide complementary geometric information, including body shape, contour, and volume, offering improved consistency across animals with different coat colors ( 47 ; 5 ) . Handcrafted features derived from depth data have commonly relied on anatomical keypoints, such as relative height differences ( 40 ; 53 ) and distances between keypoints ( 21 ; 23 ) . Three-dimensional depth information has further enabled the extraction of features based on regression parameters from fitted two-dimensional contours ( 39 ) and three-dimensional surface models ( 50 ) . Convex hull areas ( 50 ) and volumetric measurements ( 24 ; 53 ) extracted from regions of interest have also been explored. Depth sensors are substantially less sensitive to illumination changes and shadows. Converting depth data into grayscale images—either using raw depth values ( 48 ; 45 ) or segmented body regions such as hindquarters ( 14 ; 35 ) —enables the application of convolutional neural networks for BCS prediction while minimizing the influence of coat texture. Several studies have investigated converting depth data into explicit three-dimensional representations, which can theoretically capture richer geometric characteristics of animal morphology. From three-dimensional point cloud reconstructions, geometric features, including distance, area-based, and volumetric measurements, extracted from lateral and dorsal views ( 26 ) or from the rump region alone ( 20 ) have been used to predict BCS. Three-dimensional point clouds have also been converted into two-dimensional convex hull distance maps for convolutional neural network–based modeling ( 51 ) . More recently, deep learning architectures designed specifically for point clouds, such as PointNet ( 11 ) and DGCNN ( 44 ) , have been applied to livestock data ( 37 ) . Point clouds can additionally support mesh reconstruction to quantify shape differences among individual animals ( 49 ) . Despite these potential advantages, the benefits of point cloud–based approaches relative to depth image data alone remain unclear. Therefore, the current study investigated whether three-dimensional point cloud representations can enhance BCS prediction in dairy cattle. We systematically compared depth image–based and point cloud–based approaches under four settings: 1) unsegmented raw data, 2) segmented full-body data, 3) segmented hindquarter data, and 4) handcrafted feature data. All settings employed cow-level data partitioning, ensuring that evaluations were conducted using identical train–validation–test splits and preventing data leakage. This work provides both methodological insights and practical guidance for deploying automated digital BCS systems in commercial farm settings. Materials and Methods Animal image acquisition The data used in this study were collected from a commercial dairy farm in central Georgia, USA. Dairy cows were imaged in November 2024 and February 2025 using a depth-sensing image acquisition system equipped with a RealSense D455 camera (Intel Corp., Santa Clara, CA, USA). The camera was installed 2515 mm above the ground in a chute system at the exit of the milking parlor, enabling fully automated image acquisition as cows returned to the pen after milking. Each cow was independently scored by two trained evaluators using a five-point BCS scale with 0.25 point increments ( 13 ) . Only cows with exact agreement between the two scorers were retained for modeling. In total, 1,020 dairy cows, comprising 10,228 depth CSV files and corresponding RGB images, were included in the study. These cows ranged in age from 3 to 10 years and had BCS values from 2.0 to 4.25. All

Read the complete text