Audio ControlNet for Fine-Grained Audio Generation and Editing
Haina Zhu, Yao Xiao, Xiquan Li, Ziyang Ma, Jianwei Yu, Bowen Zhang, Mingqi Yang, Xie Chen · 2026
Read Audio ControlNet for Fine-Grained Audio Generation and Editing by Haina Zhu, Yao Xiao, Xiquan Li, Ziyang Ma, Jianwei Yu, Bowen Zhang, Mingqi Yang, Xie Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04680.txt.
Description
Haina Zhu and 7 co-authors add fine control to text-to-audio generation in a 2026 paper. Models can already synthesize high-quality sound from descriptions, but they rarely let users set loudness, pitch, or exactly which events occur and when.
Rather than retraining a model per control type, the team trains ControlNet-style add-ons on top of pretrained audio backbones. Their adapter design proved more efficient, reaching state-of-the-art scores with a modest number of extra parameters. The framework extends to editing as well. An editor variant removes or inserts audio events at time points specified by instructions. The authors plan to release models, code, and benchmarks for later research.
Catalog record
| CREATOR | Haina Zhu, Yao Xiao, Xiquan Li, Ziyang Ma, Jianwei Yu, Bowen Zhang, Mingqi Yang, Xie Chen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04680