Inverse-Hessian Regularization for Continual Learning in ASR
Steven Vander Eeckt, Hugo Van hamme · 2026
Read Inverse-Hessian Regularization for Continual Learning in ASR by Steven Vander Eeckt, Hugo Van hamme (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-14751.txt.
Description
Steven Vander Eeckt and Hugo Van hamme fight forgetting in speech models in this 2026 paper. Catastrophic forgetting remains a major challenge for continual learning in automatic speech recognition. A model must adapt to new domains without losing performance on previously learned conditions. Several past methods try to penalize changes to important weights.
The team's method uses inverse-Hessian regularization. The Hessian captures how sharply the loss curves around each weight. Its inverse marks which weights can move safely. Regularization then steers learning toward those safe directions. Readers get a continual learning scheme for speech recognizers that must pick up new accents and settings without unlearning old ones.
Catalog record
| CREATOR | Steven Vander Eeckt, Hugo Van hamme |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-14751