Learning to Predict Contact Force Distributions from Vision Leveraging Object Geometry Priors
Ryo Hanai a , Yukiyasu Domae a , Ixchel G. Ramirez-Alpizar b , Abdullah Mustafa a , Floris Erich a and Tetsuya Ogata a,c · 2026
Read Learning to Predict Contact Force Distributions from Vision Leveraging Object Geometry Priors by Ryo Hanai a , Yukiyasu Domae a , Ixchel G. Ramirez-Alpizar b , Abdullah Mustafa a , Floris Erich a and Tetsuya Ogata a,c (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2608-00464.txt.
Description
Hanai and co-authors teach robots to predict contact force distributions from vision. Humans forecast forces roughly from sight and past experience, then adjust handling. Their data pairs come from a rigid-body simulator used in robotics. Simulators output noisy point forces, unlike consistent human prediction. They hypothesize that smooth force distributions are the better target.
Their model predicts 3D force distributions from one RGB image of piled daily objects. Targets come from statistical smoothing of simulator point forces. Object geometry guides that smoothing to handle varied contact states. Tests run in both simulation and real settings. Prediction accuracy and downstream task performance both improve with smoothing. Geometry-guided smoothing adds further gains. The model generalizes to real scenes despite simulation-only training.
Catalog record
| CREATOR | Ryo Hanai a , Yukiyasu Domae a , Ixchel G. Ramirez-Alpizar b , Abdullah Mustafa a , Floris Erich a and Tetsuya Ogata a,c |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2608.00464