DOA: Training-Free Decoder-Only Attention Policy for Long-Form Simultaneous Translation with SpeechLLMs
Sara Papi, Luisa Bentivogli · 2026
Read DOA: Training-Free Decoder-Only Attention Policy for Long-Form Simultaneous Translation with SpeechLLMs by Sara Papi, Luisa Bentivogli (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31432.txt.
Description
Papi and Bentivogli propose DOA, a training-free policy for long-form simultaneous speech translation. Simultaneous translation generates text while speech unfolds, needing a read-or-write policy. Top systems use encoder-decoder models with cross-attention alignment, but decoder-only speech models rely solely on self-attention. The paper asks whether decoder self-attention holds stable alignment signals. DOA derives a proxy alignment from self-attention. Tests on Phi4-Multimodal and Qwen3-Omni show near-offline quality at low latency, without retraining.
Catalog record
| CREATOR | Sara Papi, Luisa Bentivogli |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 21369 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.31432