DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction

Mayank Patel, Rahul Jain, Asim Unmesh, Karthik Ramani · 2025

Read DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction by Mayank Patel, Rahul Jain, Asim Unmesh, Karthik Ramani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-12430.txt.

Introduction

Gears move because their teeth mesh, not because a designer pinned a joint, and that coupling defeats most motion prediction tools. Mayank Patel and three co-authors tackle gear assemblies in 2025 with a new benchmark and a dependency-aware learning model called DYNAMO.

The benchmark, MechBench, holds nearly seven hundred synthetic gear assemblies with exact part motion recorded. Given only a segmented point cloud of a CAD model, DYNAMO predicts each part's full rigid motion through time, reasoning about which parts drive which. It beats strong baselines on varied gear layouts, keeping predictions accurate and steady over time.

Catalog record

CREATORMayank Patel, Rahul Jain, Asim Unmesh, Karthik Ramani
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-12430

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

DYNAMO: Dependency-Aware Deep Learning Framework for Articulated Assembly Motion Prediction Mayank Patel, Rahul Jain, Asim Unmesh, Karthik Ramani Abstract Understanding the motion of articulated mechanical assemblies from static geometry remains a core challenge in 3D perception and design automation. Prior work on everyday articulated objects such as doors and laptops typically assumes simplified kinematic structures or relies on joint annotations. However, in mechanical assemblies like gears, motion arises from geometric coupling, through meshing teeth or aligned axes, making it difficult for existing methods to reason about relational motion from geometry alone. To address this gap, we introduce MechBench , a benchmark dataset of 693 diverse synthetic gear assemblies with part-wise ground-truth motion trajectories. MechBench provides a structured setting to study coupled motion, where part dynamics are induced by contact and transmission rather than predefined joints. Building on this, we propose DYNAMO , a dependency-aware neural model that predicts per-part SE ⁡ ( 3 ) \mathrm{SE}(3) motion trajectories directly from segmented CAD point clouds. Experiments show that DYNAMO outperforms strong baselines, achieving accurate and temporally consistent predictions across varied gear configurations. Together, MechBench and DYNAMO establish a novel systematic framework for data-driven learning of coupled mechanical motion in CAD assemblies. Project Page I Introduction Articulated mechanical assemblies ranging from gear trains and linkages to cabinets are ubiquitous in engineered systems and everyday devices. For robots to interact with, manipulate, or even design such systems, it is crucial to understand how their constituent parts move. While modern CAD tools (e.g., SOLIDWORKS, Autodesk Fusion 360, Siemens NX) provide detailed 3D geometry, they rarely include executable motion specifications, limiting their utility for robotics applications [ 1 ] such as assembly automation, motion planning [ 2 , 3 , 4 ] , and simulation [ 5 , 6 ] . Bridging this gap requires methods that can infer physically valid part motions directly from static geometry. To infer how parts move, a wide range of methods have been proposed that operate on inputs such as RGB-D images [ 7 , 8 , 9 ] , 3D meshes [ 10 , 11 , 12 ] , or point clouds [ 13 , 14 , 15 ] . These methods span supervised [ 16 , 8 ] , self-supervised [ 17 , 15 ] , and generative paradigms [ 18 , 19 , 20 ] , and typically aim to predict either the mobility of individual parts [ 21 ] or the motion fields of articulated objects [ 22 , 4 , 16 ] . A wide range of methods have been proposed that rely on synthetic datasets with clean segmentation masks and joint information [ 12 ] , while other methods operate on real-world scans [ 23 , 24 ] to predict mobility, which is then used to derive motion. Broadly, these works estimates parts mobility parameters such as part axis, joint type, motion type, joint limits, learning deformation fields, or segmenting objects into movable components. While prior works have explored various aspects of articulated object manipulation and motion understanding, most methods model kinematics by estimating the mobility of individual parts and then applying a fixed set of equations for motion generation [ 14 , 5 ] . These approaches are effective when the motions of different parts are independent, where modelling individual mobilities often yields accurate predictions. However, in mechanical assemblies, part motions are inherently interdependent, and motion propagates from one component to another through complex coupling. Capturing this propagation is a fundamental yet underexplored aspect of articulated objects, and it is especially critical for accurately modelling and generating motions in mechanical assemblies. To explore the problem of motion prediction under coupling in articulated assemblies, we focus on gear-based mechanisms such as rack-and-pinion systems and worm drives, which present unique challenges due to their interdependent part motions. In these systems, motion propagates through contact, meshing, and transmission, making it difficult for traditional models to reason about relational motion from geometry alone. Previous dataset have touched on coupling only in simple objects, as the construction of articulated CAD assemblies is labor intensive and requires detailed part modeling and articulation definitions [ 25 ] . To address this gap, we introduce the MechBench, a novel dataset consisting of 693 synthetic gear assemblies with diverse configurations, providing a structured benchmark for predicting rigid-body motion in complex assemblies. Beyond the dataset, we propose DYNAMO , a dependency-aware neural model designed to address the coupling problem by predicting per-part SE(3) trajectories using 6D Lie algebra vectors. DYNAMO learns motion patterns directly from static, segmented CAD geometry, without relying on joint annotations or predefined kinematic structures, and integrates PointNet++ for part-level feature extraction, a graph neural network for modeling inter-part relationships, and a temporal decoder for trajectory prediction, enabling end-to-end learning of coupled rigid-body motion. Our key contributions are: • We introduce MechBench, a novel benchmark dataset of 693 diverse synthetic gear assemblies with part-wise ground-truth motion labels, enabling systematic evaluation of coupled mechanical motion prediction. • We present DYNAMO, a dependency-aware neural model that jointly reasons over inter-part relationships to predict per-part SE(3) motion trajectories from static CAD geometry. • We compare against baselines and conduct ablation studies, demonstrating that DYNAMO achieves accurate and temporally consistent motion predictions on MechBench across multiple evaluations. II Related Work Research on articulated object motion prediction has largely focused on everyday objects, aiming to infer part mobility or deformation fields from static geometry. Early works such as Shape2Motion [ 21 ] proposed joint discovery frameworks, while later methods explored supervised [ 16 , 5 ] , weakly-supervised [ 14 ] , and self-supervised paradigms [ 15 , 26 ] . Other approaches model point-wise motion fields [ 4 , 22 ] , or track part poses given temporal cues [ 27 ] . These methods have driven progress but generally treat parts independently, assuming simple kinematic structures or relying on ground-truth joints. To support these tasks, several synthetic datasets have been introduced. Early efforts such as Hu et al. [ 12 ] and RPM-Net [ 4 ] provided motion annotations at limited scale, while Shape2Motion [ 21 ] and PartNet-Mobility [ 28 ] expanded to thousands of objects across diverse categories. More recent datasets such as OPDSynth [ 29 ] and ACD [ 30 ] target more realistic variations. However, these resources primarily capture independent part mobility and rarely include coupled motion. Table I compares representative datasets, showing that MechBench is comparable in scale while uniquely addressing motion prediction under inter-part coupling in gear assemblies. TABLE I: Comparison of synthetic articulated object datasets. Dataset #Objects #Mov. Parts #Categories Coupling Hu et al. [ 12 ] 368 368 – – RPM-Net [ 4 ] 969 1420 43 Few Shape2Motion [ 21 ] 2440 6762 45 – RBO [ 31 ] 14 21 14 – PartNet-Mobility [ 28 ] 2440 6762 45 – OPDSynth [ 29 ] 683 1343 11 – ACD [ 30 ] 354 1350 21 – MechBench (Ours) 693 2445 13 Yes Mechanical assemblies present additional challenges beyond everyday articulated objects. Traditional kinematic modeling frameworks such as Mujoco [ 32 ] and Bullet [ 33 ] assume known joints, while analysis methods [ 2 , 10 ] attempt to infer mobility from contact.

Read the complete text