MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement

Nikolai Lund Kühne, Jesper Jensen, Jan Østergaard, Zheng-Hua Tan · 2025

Read MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement by Nikolai Lund Kühne, Jesper Jensen, Jan Østergaard, Zheng-Hua Tan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00966.txt.

Description

Nikolai Lund Kühne, Jesper Jensen, Jan Østergaard, and Zheng-Hua Tan hybridize two sequence model families so a speech enhancer survives noises it never trained on. Mamba models excel at audio but, like their recurrent ancestors, overfit their training sets. Adding attention rescued recurrent enhancers' generalization before. The team's MambAttention interleaves Mamba blocks with multi-head attention shared across time and frequency.

A new training set, built for harsher noises and lower signal ratios than the standard one, raises the bar. Trained on it, the hybrid beat leading discriminative systems of similar size on every reported metric across two out-of-domain test sets. It also matched or beat generative diffusion systems at generalization while staying competitive with language model baselines. Ablations credit the weight sharing between time and frequency attention. Generalization, deliberately engineered, is the paper's real result.

Catalog record

CREATORNikolai Lund Kühne, Jesper Jensen, Jan Østergaard, Zheng-Hua Tan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-00966

Browse the full library · About the Tower of Babel