LL3M: Large Language 3D Modelers

Sining Lu, Guan Chen, Nam Anh Dinh, Itai Lang, Ari Holtzman, Rana Hanocka · 2025

Read LL3M: Large Language 3D Modelers by Sining Lu, Guan Chen, Nam Anh Dinh, Itai Lang, Ari Holtzman, Rana Hanocka (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-08228.txt.

Introduction

Sining Lu and five co-workers wrote a 2025 paper on a team of language model agents that build 3D assets by writing Blender code. Most generators learn shapes from banks of 3D data. Code, by contrast, stays readable, editable and open to tweaks. Given a text prompt, agents plan, fetch examples, write, debug and polish scripts.

A shared code context keeps the agents aware of past tries. A retrieval base built from Blender's own docs supplies correct calls. Agents critique their work from code and renders; users steer with plain instructions. Tests spanned many shape types, style edits and guided refinements.

Catalog record

CREATORSining Lu, Guan Chen, Nam Anh Dinh, Itai Lang, Ari Holtzman, Rana Hanocka
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-08228

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LL3M: Large Language 3D Modelers Sining Lu, Guan Chen, Nam Anh Dinh, Itai Lang, Ari Holtzman, Rana Hanocka Abstract We present LL3M, a multi-agent system that leverages pretrained large language models (LLMs) to generate 3D assets by writing interpretable Python code in Blender. We break away from the typical generative approach that learns from a collection of 3D data. Instead, we reformulate shape generation as a code-writing task, enabling greater modularity, editability, and integration with artist workflows. Given a text prompt, LL3M coordinates a team of specialized LLM agents to plan, retrieve, write, debug, and refine Blender scripts that generate and edit geometry and appearance. The generated code works as a high-level, interpretable, human-readable, well-documented representation of scenes and objects, making full use of sophisticated Blender constructs (e.g. B-meshes, geometry modifiers, shader nodes) for diverse, unconstrained shapes, materials, and scenes. This code presents many avenues for further agent and human editing and experimentation via code tweaks or procedural parameters. This medium naturally enables a co-creative loop in our system: agents can automatically self-critique using code and visuals, while iterative user instructions provide an intuitive way to refine assets. A shared code context across agents enables awareness of previous attempts, and a retrieval-augmented generation knowledge base built from Blender API documentation, BlenderRAG, equips agents with examples, types, and functions empowering advanced modeling operations and code correctness. We demonstrate the effectiveness of LL3M across diverse shape categories, style and material edits, and user-driven refinements. Our experiments showcase the power of code as a generative and interpretable medium for 3D asset creation. Our project page is at https://threedle.github.io/ll3m . Figure 1 : LL3M leverages a team of large language models to write Python code that creates and edits 3D assets in Blender. The agents are capable of creating expressive shapes from scratch and realizing complex, precise geometric manipulations as intuitive code edits. In this example, LL3M interactively creates and edits 3D assets entirely from user-provided text prompts (see horizontally centered quotes), which can include both creative direction and precise instruction. The agent-generated code is clearly structured and well-documented, making it easy and intuitive for anyone to make changes (see rightmost column, user updates parameter in code to modify object size). 1 Introduction The ability to generate editable 3D geometry at scale is becoming increasingly practical in computer graphics and vision. Recent work has explored using various geometric representations for training generative models on large collections of 3D shapes [ 49 , 17 , 56 ] . Figure 2 : Reusable code structure enables generalization. Despite visual differences, shapes often share high-level code patterns (such as loops, modifiers, and node setups) that recur across categories. This shared structure allows the model to transfer knowledge and generate diverse, editable, and modular code from a wide range of prompts. We opt to break away from conventional representation-centric generative modeling and ask the question: Are pretrained large language models (LLMs) capable of generating 3D assets? A straightforward use of LLMs for mesh generation is to output a list of vertices and faces directly [ 51 , 57 ] . However, this low-level representation of unordered mesh elements does not effectively capture the high-level structure shared across shapes. Inspired by the success of LLMs in generating code [ 22 , 39 , 23 , 16 , 48 ] , we reformulate shape generation as a code writing task . This enables leveraging the abstraction and reusability that code naturally provides across different shapes. For instance, the function calls used to define a Bézier curve for elements like a vase handle, a lamp wire, or chair legs often share similar structure and properties (see Fig. 2 ). Existing work has made similar observations, and thus leveraged LLMs to generate Blender code: to retrieve existing assets and place them in a scene [ 68 ] , generate materials for existing 3D assets [ 19 ] , and generate parameters for predefined procedural scenes [ 10 ] . Unlike these approaches, our method uses LLMs to write Blender code that generates comprehensive, open-vocabulary 3D assets with detailed geometry and appearance attributes. We introduce LL3M, which produces complete 3D assets from text prompts without requiring specialized datasets or finetuning. A straightforward use of an LLM to write Blender scripts leads to code that produces low-quality outputs or fails to execute. To address this, we design a novel multi-agent framework in which a team of LLM agents, specializing in distinct roles, collaborate to guide the 3D generation process. These agents coordinate through structured communication and use multiple modalities and interfaces: planning how to construct the shape, retrieving relevant code snippets, debugging scripts, and rendering outputs for visual evaluation and refinement. A notable feature of our system is that it enables user-driven, iterative, co-creative 3D modeling. Instead of generating a 3D shape in a single step, our system optionally enables users to iteratively refine the output through additional follow-up prompts (see Fig. 3 ). This paradigm contrasts sharply with typical text-input systems, which often require extensive prompt engineering (regenerating the entire result from scratch with each revision). In LL3M, follow-up prompts target only the relevant part of the shape, preserving the rest of the asset and avoiding the cost of full regeneration. This is possible because we operate on modular, human-readable code and update the existing script rather than rewriting it, enabling an ongoing, collaborative feedback loop between the user and the system. Users can modify the code underlying a system-generated 3D asset, as illustrated in Fig. 1 , right. Our system writes interpretable, modular code with tunable parameters ( e.g . knobs and sliders), enabling users to make fine-grained adjustments to the generated shapes with precise control. For example, a user can easily adjust procedural material parameters such as albedo colors, texture, and patterns, or lengths and heights for parametric surfaces in Fig. 10 . Figure 3 : Iterative creation. LL3M enables multiple successive edits of the same 3D asset. The modifications are faithful to the user’s instructions, editing only the specified element while preserving the character’s identity. A crucial design choice we make is to use retrieval augmented generation (RAG) [ 33 ] to inject information about writing correct, efficient code for building high-quality 3D shapes. Specifically, we build a database containing Blender documentation, referred to as BlenderRAG. BlenderRAG significantly enhances the capabilities of our system without compromising the ability to produce executable code: it enables the LLMs to generate more sophisticated and expressive code by retrieving concrete examples and documentation for advanced operations. Figure 4 : Gallery of results. LL3M is capable of diverse shape generation. The results showcase detailed parts ( e.g . tassels on the bottom of the lantern, architectural features of the windmill) in intricate arrangements ( e.g . grouping and spacing of keys on the piano), and rich appearance ( e.g . gradient color on the skateboard) and material properties ( e.g . the glossy lamp base). A notable feature of our approach is that each mesh is generated through interpretable, editable Blender code. We design a system for generating high-quality 3D assets in three phases, each leveraging multiple specialized agents working in collaboration. In the initial creation phase, we devise a planner agent to decompose the

Read the complete text