RelayS2S: Dual-Path Speculative Generation for Real-Time Dialogue
Long Mai · 2026
Read RelayS2S: Dual-Path Speculative Generation for Real-Time Dialogue by Long Mai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23346.txt.
Description
Mai and Liang present RelayS2S, a design that makes dialogue systems answer faster. Pure speech-to-speech models reply at once but write weaker text. Cascaded recognition plus model chains write better text, yet lag grows with model size. RelayS2S runs both paths at once when a turn starts. The fast path streams a short draft prefix to speech output. The slow path writes a stronger continuation from that prefix. A learned verifier approves the handoff or falls back. First-chunk lag drops sharply.
Catalog record
| CREATOR | Long Mai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39499 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.23346