Geometry in Style: 3D Stylization via Surface Normal Deformation
Nam Anh Dinh, Itai Lang, Hyunwoo Kim, Oded Stein, Rana Hanocka · 2025
Read Geometry in Style: 3D Stylization via Surface Normal Deformation by Nam Anh Dinh, Itai Lang, Hyunwoo Kim, Oded Stein, Rana Hanocka (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-23241.txt.
Introduction
Nam Anh Dinh and four co-authors present Geometry in Style, a 2025 method for restyling 3D meshes without losing the shape's identity. Older methods either cling too tightly to the original, like bump maps, or deform so freely they introduce artifacts and change what the object is. The new method describes a deformation as a target normal direction at each vertex neighborhood, expressive enough for detail yet tight enough to preserve identity.
A new differentiable layer, dARAP, solves for the rotations and vertex positions that realize those normals. Paired with a visual loss from a text-to-image model, it steers the mesh toward style prompts. The authors show detailed stylizations that keep the source recognizable. The layer is designed to drop into neural pipelines, making mesh style a trainable operation.
Catalog record
| CREATOR | Nam Anh Dinh, Itai Lang, Hyunwoo Kim, Oded Stein, Rana Hanocka |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-23241
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Geometry in Style: 3D Stylization via Surface Normal Deformation Nam Anh Dinh, Itai Lang, Hyunwoo Kim, Oded Stein, Rana Hanocka Abstract We present Geometry in Style , a new method for identity-preserving mesh stylization. Existing techniques either adhere to the original shape through overly restrictive deformations such as bump maps or significantly modify the input shape using expressive deformations that may introduce artifacts or alter the identity of the source shape. In contrast, we represent a deformation of a triangle mesh as a target normal vector for each vertex neighborhood. The deformations we recover from target normals are expressive enough to enable detailed stylizations yet restrictive enough to preserve the shape’s identity. We achieve such deformations using our novel differentiable As-Rigid-As-Possible (dARAP) layer, a neural-network-ready adaptation of the classical ARAP algorithm which we use to solve for per-vertex rotations and deformed vertices. As a differentiable layer, dARAP is paired with a visual loss from a text-to-image model to drive deformations toward style prompts, altogether giving us Geometry in Style. Our project page is at https://threedle.github.io/geometry-in-style . Figure 1 : Our method deforms a source shape (gray) into a text-specified semantic style (blue). While the deformations are expressive, they preserve the identity of the original shape. 1 Introduction Semantically deforming triangle meshes is a basic task in 3D surface modeling. A common paradigm for shape creation is to take a base 3D object and deform it to sculpt a desired shape. For example, a human artist creates an intricate surface by starting with a simple generic version of an object (from a shape library, or quickly sketched), and successively deforms parts of the object like a sculptor modeling clay. Recently, machine learning pipelines have adopted deformations as a strategy for neural shape manipulation Jakab et al. 2020 ; Aigerman et al. 2022 ; Shechter et al. 2022 . However, existing learning-based methods do not always fully mimic the classical approach: they either make small, surface-level changes for simple stylization Michel et al. 2022 ; Hertz et al. 2020 , or they generate large deformations that destroy the identity of the base object Gao et al. 2023 ; Kim et al. 2024 . Our method, Geometry in Style , uses text prompts to generate large deformations that create unique shapes while preserving the identity of the base shape (see Fig. 1 ) – much like a human sculptor would. Figure 2 : Style diversity. Our method is capable of deforming various input meshes towards a variety of text-specified styles. The style can be manifested as fine geometric details, like in the ornate art deco column , or as low-frequency deformations, such as the joints of the cybernetic glove . Our method retains the structural features of the input shape, such as a flat arm on the antique sofa . Moreover, the resultant stylizations are in accordance with prompt semantics and part-aware semantics: the folds in the tropical chair are on the seat and backrest as opposed to the legs, the head of the penguin becomes like the top of a fire hydrant, and the racer bunny’s thigh turns into the shape of a wheel. We posit that existing learning methods’ failure to generate the kinds of large, identity-preserving deformations that a human artist would is due to not employing the right representation for the space of deformations. Existing methods either (a) adhere to the original shape through overly restrictive deformations, such as bump maps Michel et al. 2022 ; Hertz et al. 2020 ; or they (b) significantly modify the input shape using expressive deformations based on gradient fields that may introduce artifacts or destroy the identity of the original shape Gao et al. 2023 ; Kim et al. 2024 . In this work, a deformation of a triangle mesh is represented by target normals for vertex neighborhoods. We recover a deformation from this representation using our differentiable As-Rigid-As-Possible method (dARAP), whose formulation optimizing for local rigidity yields detailed and salient deformations that are nonetheless restrictive enough to preserve the identity of the base shape. dARAP locally rotates each vertex neighborhood individually to fit its normal to a desired target normal, and follows this local rotation with a global step that finds a global deformation that best fits all individual rotated neighborhoods. Crucially, dARAP is differentiable, and can be used as a layer in a neural network. This is achieved by replacing classical ARAP’s iteration of local and global steps until convergence (impractical to backpropagate through) with dARAP’s easily differentiable use of a single local and global step. Where classical ARAP needs many iterations to converge in deformation tasks with fixed target vertex positions, dARAP’s use with target normals inside the Geometry in Style method (where dARAP is run once per iteration of a larger gradient descent optimization problem) achieves high-quality deformations from only a single iteration. We use dARAP together with a visual loss from a text-to-image model (T2I) which drives our deformation to arrive at Geometry in Style . Our visual loss leverages a cascaded T2I model to achieve high-fidelity deformations Decatur et al. 2024 , allowing the use of a user-specified text prompt to deform any base shape into a stylized object without any dedicated 3D supervision data. As such, our method allows the application of a wide variety of styles, indicated intuitively by text prompts, to a wide variety of shapes ( Figs. 1 and 2 ). Our stylization can manifest as different types of geometric manipulation, such as local surface texture, as well as global low-frequency deformations. Additionally, we show that our method offers control over the deformation result, where the user can easily change the strength of the stylization effect even after optimization. We contrast our method with recent deformation techniques and find that it can better achieve the target style with a lower surface distortion. In this work, we present: • dARAP , a differentiable neural network layer that deforms a triangle mesh to specified target normals; and • Geometry in Style , an identity-preserving shape deformation method from user text input using target normals as a representation of the space of deformations; We achieve high-quality stylization of shapes through deformation that is faithful to the identity of the input shape with a simple and easy-to-implement framework. 2 Related work Figure 3 : Overview of our stylization pipeline. Geometry in Style optimizes vertex normals to deform the mesh surface, subject to a stylization text prompt. Using the normals undergoing optimization as a target for our differentiable As-Rigid-As-Possible method (dARAP), the dARAP local step computes a rotation matrix per vertex; we then obtain the deformed surface via our dARAP global solve. Then, we utilize a differentiable renderer and a diffusion model-based semantic loss to guide the normals being optimized towards a deformation matching the desired style prompt. 2.1 Classical Deformation Representations Our deformation technique builds on the extensive literature on variational surface deformation and mapping methods Botsch and Sorkine 2008 . Methods in this family commonly compute a local differential deformation quantity, such as a per-element rotation, normal, jacobian matrix, or differential coordinates, subject to modeling constraints such as handles or cages. The vertex positions are then recovered using a global linear solve, usually derived from