MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement
Nikolai Lund Kühne, Jesper Jensen, Jan Østergaard, Zheng-Hua Tan · 2025
Read MambAttention: Mamba with Multi-Head Attention for Generalizable Single-Channel Speech Enhancement by Nikolai Lund Kühne, Jesper Jensen, Jan Østergaard, Zheng-Hua Tan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-00966.txt.
Description
Nikolai Lund Kühne, Jesper Jensen, Jan Østergaard, and Zheng-Hua Tan hybridize two sequence model families so a speech enhancer survives noises it never trained on. Mamba models excel at audio but, like their recurrent ancestors, overfit their training sets. Adding attention rescued recurrent enhancers' generalization before. The team's MambAttention interleaves Mamba blocks with multi-head attention shared across time and frequency.
A new training set, built for harsher noises and lower signal ratios than the standard one, raises the bar. Trained on it, the hybrid beat leading discriminative systems of similar size on every reported metric across two out-of-domain test sets. It also matched or beat generative diffusion systems at generalization while staying competitive with language model baselines. Ablations credit the weight sharing between time and frequency attention. Generalization, deliberately engineered, is the paper's real result.
Catalog record
| CREATOR | Nikolai Lund Kühne, Jesper Jensen, Jan Østergaard, Zheng-Hua Tan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-00966