Instructive3D: Editing Large Reconstruction Models with Text Instructions
Kunal Kathare, Ankit DhimanK Vikas GowdaSiddharth AravindanShubham MongaBasavaraja Shanthappa VandrottiLokesh R BoregowdaSamsung R&D Institute India - Bangalore · 2025
Read Instructive3D: Editing Large Reconstruction Models with Text Instructions by Kunal Kathare, Ankit DhimanK Vikas GowdaSiddharth AravindanShubham MongaBasavaraja Shanthappa VandrottiLokesh R BoregowdaSamsung R&D Institute India - Bangalore (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-04374.txt.
Description
Large reconstruction models can spin a single photo into a detailed 3D object, but they cannot edit what they make. Kathare and six co-authors present Instructive3D, which adds text-guided editing to such a model. A user can type an instruction, such as changing a color or adding a design pattern, and the model applies it to the 3D object. The editing runs through an adapter that diffuses changes inside the model's triplane representation of the object.
Because edits happen in that inner representation, they stay consistent across the object's geometry. The method also avoids the costly step of building edited image and object pairs for training. Against a baseline that builds the object first and edits it afterward, Instructive3D produced objects that matched the edit prompts better. The authors target uses in augmented reality, animation, and games.
Catalog record
| CREATOR | Kunal Kathare, Ankit DhimanK Vikas GowdaSiddharth AravindanShubham MongaBasavaraja Shanthappa VandrottiLokesh R BoregowdaSamsung R&D Institute India - Bangalore |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-04374