LTX-2 : Efficient Joint Audio-Visual Foundation Model

Yoav HaCohen Benny Brazowski Nisan Chiprut Yaki Bitterman · 2026

Read LTX-2 : Efficient Joint Audio-Visual Foundation Model by Yoav HaCohen Benny Brazowski Nisan Chiprut Yaki Bitterman (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03233.txt.

Description

Yoav HaCohen and twenty-eight co-authors introduce LTX-2, an open-source foundation model that generates video and its soundtrack together. Text-to-video diffusion models can produce striking footage but stay silent. That misses the cues that audio provides. LTX-2 uses an asymmetric dual-stream transformer. One stream, with fourteen billion parameters, handles video. A smaller stream, with five billion, handles audio.

Cross-attention layers link the two streams in both directions, with temporal position data, so sound and picture stay in sync. Shared timestep conditioning keeps the two in step. A multilingual text encoder broadens prompt understanding. A modality-aware guidance method improves alignment and control. Beyond speech, the model produces rich audio tracks that follow the characters, the setting, and the action on screen.

Catalog record

CREATORYoav HaCohen Benny Brazowski Nisan Chiprut Yaki Bitterman
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-03233

Browse the full library · About the Tower of Babel