Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates

Yingxuan You, Ren Li, Corentin Dumery, Cong Cao, Hao Li, Pascal Fua · 2026

Read Spatio-Temporal Garment Reconstruction Using Diffusion Mapping via Pattern Coordinates by Yingxuan You, Ren Li, Corentin Dumery, Cong Cao, Hao Li, Pascal Fua (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-24043.txt.

Description

Yingxuan You and five co-authors present a unified framework for reconstructing three-dimensional garments from single images and videos, including loose-fitting clothing. The 2026 paper notes that body recovery has advanced, but garment geometry, especially for flowing clothes, remains hard, with uses in virtual try-on, avatars, and mixed reality.

The method joins implicit sewing patterns with a generative diffusion model that learns garment shape priors in two-dimensional pattern space. A mapping model links image pixels, pattern coordinates, and three-dimensional geometry for accurate single-image reconstruction. For video, a spatio-temporal diffusion scheme with test-time guidance enforces long-range temporal consistency, while analytic projection constraints preserve visible geometry and complete occluded regions coherently. Trained only on simulated cloth, the system generalizes to real images and beats existing methods on tight and loose garments alike.

Catalog record

CREATORYingxuan You, Ren Li, Corentin Dumery, Cong Cao, Hao Li, Pascal Fua
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-24043

Browse the full library · About the Tower of Babel