Cascade-Free Mandarin Visual Speech Recognition via Semantic-Guided Cross-Representation Alignment Corresponding author.
Lei Yang, Yi He, Fei Wu, Shilin Wang 1 · 2026
Read Cascade-Free Mandarin Visual Speech Recognition via Semantic-Guided Cross-Representation Alignment Corresponding author. by Lei Yang, Yi He, Fei Wu, Shilin Wang 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21808.txt.
Description
Yang and co-authors read lips in Mandarin without the cascade that most Chinese systems rely on. Mandarin tones make visual speech recognition hard, so older systems pass through pinyin first. Errors then pile up between stages, and inference slows. Their design learns phoneme, viseme, and text targets jointly in one multitask setup. A semantic-guided contrastive loss aligns the feature streams over time. Features can switch on at inference as needed, trading speed for accuracy. On public datasets, the method beat prior systems, the authors report.
Catalog record
| CREATOR | Lei Yang, Yi He, Fei Wu, Shilin Wang 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25178 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.21808