: Beyond Only One Modality KIT’s Multimodal Multilingual Lecture Companion

Sai Koneru, Fabian Retkowski, Christian Huber, Lukas Hilgert · 2025

Read : Beyond Only One Modality KIT’s Multimodal Multilingual Lecture Companion by Sai Koneru, Fabian Retkowski, Christian Huber, Lukas Hilgert (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02817.txt.

Description

Sai Koneru and three co-authors build a lecture companion that translates teaching in every form at once. Global online learning makes localizing lectures a pressing challenge. Lecture materials mix spoken audio with visual slides, so a text only translation drops much of the lesson.

Their system preserves all modalities: readable text, slides for visual understanding, and speech for listening. Students get the full class in their own language, not a stripped summary. Tools of this kind widen access to strong teaching for students far from the lecturer's country and tongue. Full class packs in one's own tongue can close the gap for kids far from big schools with deep staff rolls.

Catalog record

CREATORSai Koneru, Fabian Retkowski, Christian Huber, Lukas Hilgert
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE25 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-02817

Browse the full library · About the Tower of Babel