Beyond Text: Probing K-12 Educators’ Perspectives on Learning Opportunities with Multimodal Large Language Models

Tiffany Tseng, Katelyn Lam, Tiffany Lin Fu, Alekhya Maram · 2025

Read Beyond Text: Probing K-12 Educators’ Perspectives on Learning Opportunities with Multimodal Large Language Models by Tiffany Tseng, Katelyn Lam, Tiffany Lin Fu, Alekhya Maram (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-20720.txt.

Introduction

Tiffany Tseng and three co-authors ask teachers about multimodal AI in twenty twenty-five. Multimodal large language models can make and discuss images, text, speech, and video. Such powers could enrich school learning in many ways, yet how teachers imagine using them was largely unknown.

The team ran workshops with twelve K-12 educators, where the teachers dreamed up learning opportunities and voiced practical concerns. They also built trial learning applications with a current multimodal model and its artifacts feature. The study collects how teachers pictured benefits, from new interaction styles to richer materials. Classroom constraints and implementation needs surfaced with the enthusiasm. Readers in education technology get design guidance from the people who would run these tools with children.

Catalog record

CREATORTiffany Tseng, Katelyn Lam, Tiffany Lin Fu, Alekhya Maram
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-20720

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Text: Probing K-12 Educators’ Perspectives on Learning Opportunities with Multimodal Large Language Models Tiffany Tseng, Katelyn Lam, Tiffany Lin Fu, Alekhya Maram Abstract Multimodal Large Language Models (MLLMs) are beginning to enable new user experiences from generated content across a range of media, including images, text, speech, and video. These capabilities have the potential to enrich learning by enabling users to interact with information using a variety of modalities, but little is known about how educators envision how MLLMs might shape the future of learning, what challenges they encounter when using these models, and what practical needs should be considered for future implementation in educational contexts. We investigated educator perspectives through workshops with 12 K-12 educators, where participants brainstormed learning opportunities, discussed practical concerns, and prototyped MLLM learning applications using Claude 3.5 and its Artifacts feature. Through this work, we uncover how educators imagined MLLMs as a way for themselves and their students to author multimedia content, and how this could provide a pathway to support learning through iterative design. At the same time, educators anticipated challenges with younger students’ ability to evaluate and refine model output to better meet their design goals. We end with implications for designing with and for MLLMs in future learning experiences. keywords multimodal large language models ,K-12 education , † † corresponding: Corresponding author 1 Introduction The widescale release and public adoption of Large Language Model (LLM) tools like ChatGPT has the potential to enable powerful opportunities for personalized learning. Because these models have been trained on vast amounts of data, they can provide on-demand explanations across a wide range of domains, which has naturally led researchers, policymakers, and education stakeholders to consider how this technology will impact the future of education. Many AI companies have begun to preview multimodal LLMs (MLLMs), or models that can interpret and generate content across multiple modalities such as image, audio, video, and text, providing opportunities to move beyond text-based explanations. Videos demonstrating the capabilities of MLLMs showcase educational use cases such as supporting language learning (pointing a smartphone at objects and having the model verbally supply the name of items in a foreign language OpenAI (2024) ) or providing personalized feedback on hand-drawn sketches using live camera input Minutes (2024) . These corporate-driven visions of AI-supported learning accompany researcher-led position papers about how LLMs might transform education Kasneci et al. (2023) ; Küchemann et al. (2024) ; Gan et al. (2023) ; yet, a missing voice is that of educators and how they imagine ways MLLMs can be effectively and responsibly used for learning. Incorporating educator perspectives may illuminate unrealized opportunities for applying MLLMs towards enriching learning experiences, particularly for diverse learners and environments Cukurova and Luckin (2018) ; Luckin and Cukurova (2019) ; Holmes et al. (2019) ; Qin et al. (2020) . Studying educators’ approaches to actively using MLLMs may also surface usability or misalignment issues with current models, which could inform the future development of these technologies to better support educational applications Friend et al. (2022) ; Kizilcec (2024) . To understand the ideas, needs, and challenges educators anticipate around learning experiences using MLLMs, we conducted workshops with 12 K-12 educators in which they reacted to demonstration videos of unreleased MLLMs, brainstormed educational opportunities using MLLMs, and engaged in hands-on prototyping of learning activities using Claude 3.5, a multimodal model which supports text and image input and code-based interactive applications through a feature called Artifacts. Through these workshops, we examined the following research questions: • RQ1 : What ideas do K-12 educators have for learning opportunities using MLLMs? • RQ2 : What issues emerged through educators’ experiences prototyping with an MLLM, and how do these challenges shape educators’ views around anticipated student use? We found that teachers primarily imagined MLLMs being used to create multimedia simulations and demos, implement personalization and accommodations, and support student research, with a focus on multimodal output rather than input. Prototyping with Claude 3.5, teachers were able to generate code-based interactive applications enabled teachers to create experiences similar to those that they envisioned when designing with a multimodal model that could support multimedia visual output. This finding suggests that aspects of multimodal output may already be achievable through code generation, even before multimodal modalities are made widely available in commercial end-user tools. Further, we found a distinction between teachers who envisioned designing with MLLMs to build learning tools for student use, versus those who imagined students using MLLMs directly to support exploratory research. This division stemmed from concerns that younger students with varying literacy and communication skills would need substantial support to evaluate model output and persist through the iterative prompting often required to generate content aligned with their goals. Yet, for students who may interact with the model directly, teachers anticipated that the iterative process of refining and debugging generated content may provide richer opportunities for learning distinct from one-shot question-answer exchanges commonly shown in tech demo videos. Overall, we contribute a first look into end-user educator perspectives into MLLMs to inform the design of future MLLM-driven media-rich learning experiences. 2 Related Work The application of artificial intelligence to education more broadly has been explored in decades of work, historically stemming from cognitive tutors and adaptive learning systems Anderson et al. (1995) ; Marouf et al. (2024) ; Ritter et al. (2007) and more recently spurred by the introduction of commercial LLMs, particularly ChatGPT in 2022. AI Education efforts range from student- Tenório and Romeike (2024) to teacher-focused Holmes and Tuomi (2022) and include both applications of AI technologies to support end-users, along with the development of frameworks, tools, and curriculum to foster AI literacy skills Long and Magerko (2020) ; Tseng et al. (2024) ; Lee et al. (2021) . Proponents of utilizing AI technologies for education highlight potential benefits such as enabling customization and personalization for a range of student learning needs Akanzire et al. (2025) and supporting students’ problem solving abilities Guo et al. (2025) ; at the same time, there are many concerns over issues such as model bias, risk of student overreliance, and lack of effective policy and infrastructure to support equitable use Bewersdorff et al. (2025) ; Küchemann et al. (2024) ; Fütterer et al. (2023) ; Mintz et al. (2023) . Some AI companies are beginning to release analyses of how their tools are being used in educational contexts but focus specifically on higher-education, such as Anthropic’s Education Report on how college students use Claude Handa et al. (2025) and a companion report on how Claude models are being used by university professors Bent et al. (2025) . As pointed out in recent work exploring educators use of ChatGPT, K-12 teachers may have unique needs compared to university faculty because they iterate more regularly on lesson plans Keppler et al. (2025) , highlighting the importance of research studying K-12 educator use of AI technologies. As our work centers on educator ideas for learning applications of MLLMs, we focus on related work on teacher perspectives on AI and early efforts to explore the application of MLLMs for education. 2.1 Teacher Perspectives on AI Recent work soliciting teacher perspectives on AI technologies have found that educators see themselves as likely to integrate

Read the complete text