FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing

Wanglong Lu, Jikai Wang, Xiaogang Jin, Xianta Jiang, Hanli Zhao * · 2024

Read FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing by Wanglong Lu, Jikai Wang, Xiaogang Jin, Xianta Jiang, Hanli Zhao * (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-19009.txt.

Description

Wanglong Lu and co-authors present a framework for editing faces in photos in a 2024 paper. Face editing tools can change a smile or an age, but most struggle with local edits guided by many kinds of input. Quality also tends to fall after several rounds of small edits, since unedited parts drift.

Their framework, FACEMUG, accepts sketches, maps, example images, text, and trait labels as guides. It joins all of them in one latent space and fuses facial features with the guides at two levels. A self taught warping step fixes misaligned features and carries the pose of the edited image. In tests against leading methods, FACEMUG gave better editing quality, flexibility, and control over meaning.

Catalog record

CREATORWanglong Lu, Jikai Wang, Xiaogang Jin, Xianta Jiang, Hanli Zhao *
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-19009

Browse the full library · About the Tower of Babel