ARMO: Autoregressive Rigging for Multi-Category Objects

2025

Read ARMO: Autoregressive Rigging for Multi-Category Objects (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20663.txt.

Introduction

A drawn beast is still until a rigger gives it bones and skin weights, slow hand work that games and films eat by the hour. A 2025 team builds the first large school for that craft: a set of 79,499 meshes, each with its bones and skinning spelled out. Poses and kinds run wild in the set — no forced standard stance.

Their rigger then reads a new mesh joint by joint, in sequence, naming each joint's place and its links as it goes, like a sentence. One pass yields the whole skeleton. Past rig sets were small and stiff-posed, so riggers learned narrow tricks. A wide school plus a sequence reader could rig a menagerie in minutes.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-20663

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ARMO: Autoregressive Rigging for Multi-Category Objects Abstract Recent advancements in large-scale generative models have significantly improved the quality and diversity of 3D shape generation. However, most existing methods focus primarily on generating static 3D models, overlooking the potential dynamic nature of certain shapes, such as humanoids, animals, and insects. To address this gap, we focus on rigging, a fundamental task in animation that establishes skeletal structures and skinning for 3D models. In this paper, we introduce OmniRig , the first large-scale rigging dataset, comprising 79,499 meshes with detailed skeleton and skinning information. Unlike traditional benchmarks that rely on predefined standard poses (e.g., A-pose, T-pose), our dataset embraces diverse shape categories, styles, and poses. Leveraging this rich dataset, we propose ARMO , a novel rigging framework that utilizes an autoregressive model to predict both joint positions and connectivity relationships in a unified manner. By treating the skeletal structure as a complete graph and discretizing it into tokens, we encode the joints using an auto-encoder to obtain a latent embedding and an autoregressive model to predict the tokens A mesh-conditioned latent diffusion model is used to predict the latent embedding for conditional skeleton generation. Our method addresses the limitations of regression-based approaches, which often suffer from error accumulation and suboptimal connectivity estimation. Through extensive experiments on the OmniRig dataset, our approach achieves state-of-the-art performance in skeleton prediction, demonstrating improved generalization across diverse object categories. The code and dataset will be made public for academic use upon acceptance. Mingze Sun 1 * Shiwei Mao 1 * Keyi Chen 1 Yurun Chen 1 Shunlin Lu 2 Jingbo Wang 3 Junting Dong 3 † Ruqi Huang 1 † 1 Tsinghua Shenzhen International Graduate School, China 2 The Chinese University of Hong Kong, Shenzhen 3 Shanghai AI Laboratory, China Figure 1 : We propose ARMO , a pipeline that generates accurate skeleton results from mesh inputs, enabling precise control over the mesh to generate realistic and accurately driven results. † † footnotetext: * Indicates Equal Contribution. † Indicates Corresponding Author. 1 Introduction Recently, large-scale generative models have achieved impressive advancement on generating 3D shapes of high quality and great diversity through multi-modal hints, such as text [ 35 , 18 ] , images [ 37 , 46 , 19 ] , or point clouds [ 4 , 5 ] . However, the majority of efforts in this field focuses on delivering static digitizations, to some extent overlooking the potential dynamic nature of the shapes of interest ( e.g., humanoids, animals, insects). To alleviate this discrepancy, we resort to rigging, a long-standing task from animation research, which creates a skeletal structure for a 3D shape and further relates shape to the simplified skeleton. High-quality rigging allows for driving shapes through skeletal motions crafted by artists and, hopefully, more and more advanced automatic algorithms [ 10 ] . In this paper, we propose a novel rigging framework, ARMO , for rigging 3D shapes, which can manifest significant diversity in style, pose, and category . The first challenge that arose in our study is the lack of large-scale dataset with high-quality rigging annotations. In fact, though automatic rigging algorithms [ 39 , 6 , 11 ] have long been studied, the regarding dataset construction like Modelresource [ 39 ] and Mixamo [ 1 ] is lagged. To this end, we have dedicated to constructing, to the best of our knowledge, the first large-scale rigging dataset, OmniRig , which consists of 79,499 meshes with detailed skeleton and skinning information. We conducted extensive data cleaning from ObjaverseXL and publicly available websites, followed by manual annotation of the data categories. The second challenge then follows close on the establishment of OmniRig , namely, how can we fully exploit the potential of the large-scale data? RigNet [ 39 ] and TARig [ 20 ] use mesh as input and design regression networks to predict the rigging results. Regression-based methods directly predict the full set of joint coordinates and the corresponding probability matrix for connectivity. Though these prior works have greatly advanced rigging performance in the past decades, even with extensive training on large datasets, such designs often struggle to generalize well in scenarios involving significant data variability and diverse object categories, making it challenging for them to achieve satisfactory results on our proposed rigging dataset OmniRig , which includes a diverse range of shape categories. However, the autoregressive model adopts a next-token prediction strategy, which effectively leverages both the given conditions and previously predicted results for iterative prediction. Moreover, autoregressive models have been extensively validated in other domains, demonstrating strong generalization capabilities when trained on large-scale datasets [ 26 , 4 , 5 ] . To address the problem above, we propose a novel approach focused on accurate skeleton estimation that models the skeletal structure as a complete graph and employs an autoregressive model to learn both the joint positions and their corresponding parent joint positions. Additionally, these prior works all follow a multi-stage design ( e.g., formulating independent modules for joint prediction, bone connection, and skinning), which significantly limits their utility in our dataset. These approaches are prone to error accumulation, and using greedy algorithms for bone connectivity estimation often leads to suboptimal results. Errors in bone connectivity can significantly impact both skinning estimation and motion control. Our proposed approach, which employs an autoregressive model, offers a more structured way to learn the skeleton. By predicting each joint position along with its corresponding parent joint position, our method directly infers bone connectivity, effectively reducing error propagation and improving overall prediction accuracy. Specifically, we first represent the skeleton as a tree structure, where each joint is associated with the position of its parent joint. We then discretize this tree structure into tokens. The joints are first encoded using an autoregressive auto-encoder, which produces a latent embedding. This embedding is subsequently processed by an autoregressive model to predict the skeletal structure tokens. Previous studies have shown that directly applying a conditioned autoregressive model can lead to confusion between the conditioning input and the output [ 32 ] , resulting in degraded prediction performance. Building on this, we further train a mesh-conditioned latent diffusion model to predict the latent embedding, enabling accurate conditioned skeleton generation. Our key contributions are threefold: 1) We introduce OmniRig , the first large-scale rigging dataset, which covers diverse object categories with detailed rigging annotations. 2) We propose, for the first time, an autoregressive model that simultaneously predicts both joint positions and connectivity relationships. 3) We conduct extensive experiments on the OmniRig dataset, achieving state-of-the-art performance in skeleton prediction. 2 Related Works 2.1 3D Autoregressive Models Autoregressive models, which are first designed for natural language processing [ 34 , 25 ] , have recently gained rapid development in 2D image processing [ 31 , 15 , 33 ] and 3D generative models. The main idea is to automatically predict the next component in a sequence by taking measurements from previous input. MeshGPT [ 26 ] represents meshes as latent embeddings through geometry and topology and proposes a sequence-based method to autoregressively generate meshes as a series of triangles. In contrast, MeshXL [ 3 ] explores the neural coordinate field to construct an explicit representation for 3D meshes and formulate several base

Read the complete text