DOA: Training-Free Decoder-Only Attention Policy for Long-Form Simultaneous Translation with SpeechLLMs

Sara Papi, Luisa Bentivogli · 2026

Read DOA: Training-Free Decoder-Only Attention Policy for Long-Form Simultaneous Translation with SpeechLLMs by Sara Papi, Luisa Bentivogli (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31432.txt.

Description

Papi and Bentivogli propose DOA, a training-free policy for long-form simultaneous speech translation. Simultaneous translation generates text while speech unfolds, needing a read-or-write policy. Top systems use encoder-decoder models with cross-attention alignment, but decoder-only speech models rely solely on self-attention. The paper asks whether decoder self-attention holds stable alignment signals. DOA derives a proxy alignment from self-attention. Tests on Phi4-Multimodal and Qwen3-Omni show near-offline quality at low latency, without retraining.

Catalog record

CREATORSara Papi, Luisa Bentivogli
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21369
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.31432

Browse the full library · About the Tower of Babel