GAP3D: Generative Alignment of VLM Latents to Patch-Level Embeddings for 3D Generation

Polytimi Anna Gkotsi, Andrii Zadaianchuk, Mohammad Mahdi Derakhshani · 2026

Read GAP3D: Generative Alignment of VLM Latents to Patch-Level Embeddings for 3D Generation by Polytimi Anna Gkotsi, Andrii Zadaianchuk, Mohammad Mahdi Derakhshani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28995.txt.

Description

Polytimi Anna Gkotsi, Andrii Zadaianchuk, and Mohammad Mahdi Derakhshani align vision-language latents to patch-level image features for 3D asset generation. Their diffusion-based GAP3D lets a frozen generator use a vision-language model as prompt encoder while keeping spatial structure. Training mainly on general image-text pairs avoids large-scale 3D data. The method shows zero-shot skill on multimodal prompts despite text-only training, though it currently favors high-level meaning over fine detail.

Catalog record

CREATORPolytimi Anna Gkotsi, Andrii Zadaianchuk, Mohammad Mahdi Derakhshani
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47141
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28995

Browse the full library · About the Tower of Babel