RelayS2S: Dual-Path Speculative Generation for Real-Time Dialogue

Long Mai · 2026

Read RelayS2S: Dual-Path Speculative Generation for Real-Time Dialogue by Long Mai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23346.txt.

Description

Mai and Liang present RelayS2S, a design that makes dialogue systems answer faster. Pure speech-to-speech models reply at once but write weaker text. Cascaded recognition plus model chains write better text, yet lag grows with model size. RelayS2S runs both paths at once when a turn starts. The fast path streams a short draft prefix to speech output. The slow path writes a stronger continuation from that prefix. A learned verifier approves the handoff or falls back. First-chunk lag drops sharply.

Catalog record

CREATORLong Mai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39499
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.23346

Browse the full library · About the Tower of Babel