Sign Language Recognition in the Age of LLMs

Václav Javorek, Jakub Honzík, Ivan Gruber, Tomáš Železný, Marek Hrúz · 2026

Read Sign Language Recognition in the Age of LLMs by Václav Javorek, Jakub Honzík, Ivan Gruber, Tomáš Železný, Marek Hrúz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11225.txt.

Description

Javorek and four colleagues ask whether general vision-language models can recognize isolated signs without task-specific training. Testing several open and proprietary models zero-shot on the WLASL300 benchmark, they find open models far behind classic supervised classifiers, though they capture partial alignment between signs and text. Larger proprietary models score much higher, pointing to scale and training diversity as decisive.

Catalog record

CREATORVáclav Javorek, Jakub Honzík, Ivan Gruber, Tomáš Železný, Marek Hrúz
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29263
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.11225

Browse the full library · About the Tower of Babel