Accepted to Appear in the Proceedings of 26th International Conference on Artificial Intelligence in Education 2025 Rethinking the Potential of Multimodality in Collaborative Problem Solving Diagnosis with Large Language Models

Kester Wong, Bin Wu, Sahan Bulathwela, Mutlu Cukurova · 2025

Read Accepted to Appear in the Proceedings of 26th International Conference on Artificial Intelligence in Education 2025 Rethinking the Potential of Multimodality in Collaborative Problem Solving Diagnosis with Large Language Models by Kester Wong, Bin Wu, Sahan Bulathwela, Mutlu Cukurova (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15093.txt.

Description

Judging how well students solve problems together from their clicks, words, and voices sounds promising, but Kester Wong and co-authors ask whether the extra channels actually earn their keep. Their 2025 study follows seventy-eight secondary students in real classrooms, scoring their teamwork subskills from text and audio. Transformer models beat classical ones at the diagnosis.

Adding audio to text helped only inside the transformer models, and only for the social-cognitive side of teamwork, not across the board. The authors argue the value of multimodality depends on the skill and the model, and they call for human judgment to stay in the loop.

Catalog record

CREATORKester Wong, Bin Wu, Sahan Bulathwela, Mutlu Cukurova
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-15093

Browse the full library · About the Tower of Babel