Progressive Alignment Objectives for Aligner-Encoder based ASR
Jaeyoung, Masato, Takafumi · 2026
Read Progressive Alignment Objectives for Aligner-Encoder based ASR by Jaeyoung, Masato, Takafumi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-24147.txt.
Description
Lee, Mimura, and Moriya help speech recognition models learn the alignment between sound and text gradually instead of all at once. Aligner-Encoder models predict each output token directly from a matching encoder position, so the encoder must internalise the alignment with no cross-attention to help. In practice that alignment snaps into place abruptly in the upper layers, making training touchy and long utterances brittle, a weakness their 2026 method, InterAligner, targets.
An intermediate aligner objective lets alignment form progressively through the network's depth, while an intermediate CTC loss steadies optimisation along the way. On LibriSpeech with a seventeen-layer Conformer, a final-only aligner trails badly, the intermediate CTC variant improves matters, and InterAligner improves further still, with the largest gains on long utterances. Lee's team, based at NTT in Japan, argues staged alignment objectives should be standard practice for this model family.
Catalog record
| CREATOR | Jaeyoung, Masato, Takafumi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21 KB |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.24147