Learning to Predict Contact Force Distributions from Vision Leveraging Object Geometry Priors

Ryo Hanai a , Yukiyasu Domae a , Ixchel G. Ramirez-Alpizar b , Abdullah Mustafa a , Floris Erich a and Tetsuya Ogata a,c · 2026

Read Learning to Predict Contact Force Distributions from Vision Leveraging Object Geometry Priors by Ryo Hanai a , Yukiyasu Domae a , Ixchel G. Ramirez-Alpizar b , Abdullah Mustafa a , Floris Erich a and Tetsuya Ogata a,c (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2608-00464.txt.

Description

Hanai and co-authors teach robots to predict contact force distributions from vision. Humans forecast forces roughly from sight and past experience, then adjust handling. Their data pairs come from a rigid-body simulator used in robotics. Simulators output noisy point forces, unlike consistent human prediction. They hypothesize that smooth force distributions are the better target.

Their model predicts 3D force distributions from one RGB image of piled daily objects. Targets come from statistical smoothing of simulator point forces. Object geometry guides that smoothing to handle varied contact states. Tests run in both simulation and real settings. Prediction accuracy and downstream task performance both improve with smoothing. Geometry-guided smoothing adds further gains. The model generalizes to real scenes despite simulation-only training.

Catalog record

CREATORRyo Hanai a , Yukiyasu Domae a , Ixchel G. Ramirez-Alpizar b , Abdullah Mustafa a , Floris Erich a and Tetsuya Ogata a,c
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2608.00464

Browse the full library · About the Tower of Babel