Aligner-Encoders: Self-Attention Transformers Can Be Self-Transducers
Adam Stooke, Rohit Prabhavalkar, Khe Chai Sim, Pedro Moreno Mengibar · 2025
Read Aligner-Encoders: Self-Attention Transformers Can Be Self-Transducers by Adam Stooke, Rohit Prabhavalkar, Khe Chai Sim, Pedro Moreno Mengibar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-05232.txt.
Description
Adam Stooke and three co-authors find that the encoder of a speech network lines words up on its own, in its forward pass. Stock speech systems keep the encoder true to time and leave the lining up to the back end. Their 2025 find is that the attention-based encoder shifts time in its own flow, clear in the attention weights of one layer. A lean model, the Aligner-Encoder, builds on that gift.
Training drops the path-sum of the old way for a frame-level loss, and the back end scans frames in order with a light text loop. No cross-attention is learned. Results run near top grade, with a long-form mode in tow. Run time is twofold faster than the old transducer pair and sixteenfold faster than the attention pair.
Catalog record
| CREATOR | Adam Stooke, Rohit Prabhavalkar, Khe Chai Sim, Pedro Moreno Mengibar |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-05232