Aligner-Encoders: Self-Attention Transformers Can Be Self-Transducers

Adam Stooke, Rohit Prabhavalkar, Khe Chai Sim, Pedro Moreno Mengibar · 2025

Read Aligner-Encoders: Self-Attention Transformers Can Be Self-Transducers by Adam Stooke, Rohit Prabhavalkar, Khe Chai Sim, Pedro Moreno Mengibar (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-05232.txt.

Description

Adam Stooke and three co-authors find that the encoder of a speech network lines words up on its own, in its forward pass. Stock speech systems keep the encoder true to time and leave the lining up to the back end. Their 2025 find is that the attention-based encoder shifts time in its own flow, clear in the attention weights of one layer. A lean model, the Aligner-Encoder, builds on that gift.

Training drops the path-sum of the old way for a frame-level loss, and the back end scans frames in order with a light text loop. No cross-attention is learned. Results run near top grade, with a long-form mode in tow. Run time is twofold faster than the old transducer pair and sixteenfold faster than the attention pair.

Catalog record

CREATORAdam Stooke, Rohit Prabhavalkar, Khe Chai Sim, Pedro Moreno Mengibar
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-05232

Browse the full library · About the Tower of Babel