LAV: Audio-Driven Dynamic Visual Generation with Neural Compression and StyleGAN2

Jongmin Jung, Dasaem Jeong · 2025

Read LAV: Audio-Driven Dynamic Visual Generation with Neural Compression and StyleGAN2 by Jongmin Jung, Dasaem Jeong (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-10101.txt.

Description

Jongmin Jung and Dasaem Jeong build a system that turns sound into moving visuals in a 2025 paper. Their tool, LAV, links a neural audio compressor with a famed image generator. Past tools mapped sound traits to image traits by hand, which can flatten rich meaning.

Here the compressed audio codes act as hidden seeds, fed straight into the image models style space by a simple learned map. The route keeps the semantic depth of the sound codes, yielding visuals that track the audio with nuance. The authors pitch the setup for art and creative computing, where sound-driven images can react and shift live.

Catalog record

CREATORJongmin Jung, Dasaem Jeong
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE9 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-10101

Browse the full library · About the Tower of Babel