GAP3D: Generative Alignment of VLM Latents to Patch-Level Embeddings for 3D Generation
Polytimi Anna Gkotsi, Andrii Zadaianchuk, Mohammad Mahdi Derakhshani · 2026
Read GAP3D: Generative Alignment of VLM Latents to Patch-Level Embeddings for 3D Generation by Polytimi Anna Gkotsi, Andrii Zadaianchuk, Mohammad Mahdi Derakhshani (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28995.txt.
Description
Polytimi Anna Gkotsi, Andrii Zadaianchuk, and Mohammad Mahdi Derakhshani align vision-language latents to patch-level image features for 3D asset generation. Their diffusion-based GAP3D lets a frozen generator use a vision-language model as prompt encoder while keeping spatial structure. Training mainly on general image-text pairs avoids large-scale 3D data. The method shows zero-shot skill on multimodal prompts despite text-only training, though it currently favors high-level meaning over fine detail.
Catalog record
| CREATOR | Polytimi Anna Gkotsi, Andrii Zadaianchuk, Mohammad Mahdi Derakhshani |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47141 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28995