Leveraging Small LLMs for Argument Mining in Education: Argument Component Identification, Classification, and Assessment
Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver · 2025
Read Leveraging Small LLMs for Argument Mining in Education: Argument Component Identification, Classification, and Assessment by Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14389.txt.
Introduction
Lucile Favero and co-authors try small open language models as essay graders for argument skill. Their 2025 paper works on argument mining: splitting student essays into argument parts, sorting them by type, and rating their quality. Such tools can give targeted feedback that builds writing skill. Small open models also keep costs low and data private for schools.
They test few-shot prompting and fine-tuning on essays from grades six to twelve. The tuned small models beat baselines at splitting essays and naming argument types. Prompting alone matched baselines on quality rating. The authors pitch local, cheap models as a path to live personal feedback. Students could get help on their reasoning without sending work to outside servers.
Catalog record
| CREATOR | Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-14389
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Leveraging Small LLMs for Argument Mining in Education: Argument Component Identification, Classification, and Assessment Lucile Favero, Juan Antonio Pérez-Ortiz, Tanja Käser, Nuria Oliver Abstract Argument mining algorithms analyze the argumentative structure of essays, making them a valuable tool for enhancing education by providing targeted feedback on the students’ argumentation skills. While current methods often use encoder or encoder-decoder deep learning architectures, decoder-only models remain largely unexplored, offering a promising research direction. This paper proposes leveraging open-source, small Large Language Models (LLMs) for argument mining through few-shot prompting and fine-tuning. These models’ small size and open-source nature ensure accessibility, privacy, and computational efficiency, enabling schools and educators to adopt and deploy them locally. Specifically, we perform three tasks: segmentation of student essays into arguments, classification of the arguments by type, and assessment of their quality. We empirically evaluate the models on the “Feedback Prize – Predicting Effective Arguments” dataset of grade 6–12 students essays and demonstrate how fine-tuned small LLMs outperform baseline methods in segmenting the essays and determining the argument types while few-shot prompting yields comparable performance to that of the baselines in assessing quality. This work highlights the educational potential of small, open-source LLMs to provide real-time, personalized feedback, enhancing independent learning and writing skills while ensuring low computational cost and privacy. 1 Introduction Writing well-structured essays can be challenging for students, as they require not only quality argument components but also cohesive connections between them Scardamalia and Bereiter (1987) . However, many students struggle to meet these requirements, often due to a lack of clear guidance on effective argumentation. High teacher-student ratios exacerbate this issue, limiting the individualized support that teachers can provide 1 1 1 https://www.unesco.org/en/articles/global-report-teachers-what-you-need-know . To address this challenge, automatic argument mining has emerged as a promising solution, aiming to analyze the argumentative structure of essays and deliver targeted feedback to help students strengthen their arguments and overall essay structure Lawrence and Reed (2020) ; Cabrio and Villata (2018) . Figure 1: Overview of the proposed framework. Given an essay as input, the objective is to first segment it into arguments, then classify the argument types, and assess their quality using small open source LLMs —Qwen 2.5 7B, Llama 3.1 8B, and Gemma 2 9B. These tasks are performed either individually or jointly through two learning approaches: few-shot prompting or fine-tuning. Effective argument mining entails several subtasks, such as segmenting the essay into distinct argument components, classifying their type, assessing their quality and establishing relationships between them Gessler et al. (2021) . These tasks can be performed sequentially or in parallel. State-of-the-art approaches in argument mining rely on encoder or encoder-decoder deep neural network-based architectures Arora et al. (2023) . However, to date, decoder-only models remain underexplored for certain subtasks, suggesting a promising area for future exploration Wachsmuth et al. (2024) . While high-performing argument mining methods have potential, they are often difficult to access and scale, especially in educational settings Kashefi et al. (2023) . Automated Essay Scoring (AES) systems offer an alternative solution for grading essays, focusing on overall evaluation rather than on assessing individual arguments Gao et al. (2024) . However, limited research has explored the integration of argument mining with argument quality assessment. This work aims to bridge this gap by providing detailed feedback that helps students critically analyze their arguments and enhance their writing skills Ding et al. (2023) . We propose leveraging open-source 2 2 2 We use the term open-source to refer to LLMs that are freely available with at least open-weights. , small Large Language Models (LLMs) to perform a complete pipeline in argument mining (from segmenting the text in arguments to classifying their type and assessing their quality) in an educational context. By means of few-shot prompting and fine-tuning, these models can execute these tasks locally on the student’s laptop, ensuring accessibility and maintaining computational efficiency. Figure 1 depicts the proposed method’s pipeline, outlining each stage of the process. This paper is organized as follows: Section 2 reviews the most relevant literature, providing the background and context for our research. In Section 3 , we describe our methodology. Section 4 presents and analyses our experimental results. Finally, Section 5 provides a discussion of the findings, followed by a conclusion and an outline of the limitations in Section 6 Our code is available at https://anonymous.4open.science/r/ACL_2025-45CE/ . 2 Related work Argument mining Argument mining is a complex field that aims to identify, classify, and analyze argumentative structures within text Lawrence and Reed (2020) , drawing inspiration from frameworks, such as Toulmin’s model of argumentation Toulmin (2003) . Argument mining involves numerous subtasks Arora et al. (2023) , including argument detection, classification, assessment, and relation prediction, making end-to-end solutions particularly challenging Cabrio and Villata (2018) . Thus, despite its importance, few studies tackle the full argument mining pipeline due to its complexity and methodological diversity. Cao (2023) ; Bao et al. (2022) ; Morio et al. (2022) . State-of-the-art methods in argument mining typically rely on deep neural networks Arora et al. (2023) . Recently, advancements in Large Language Models (LLMs) have pushed the field forward. For instance, T5 Raffel et al. (2020) has been applied effectively to argument mining tasks Kawarada et al. (2024) , while models like Longformer Ding et al. (2023) and BERT-based approaches Kashefi et al. (2023) have demonstrated competitive performance across various subtasks. More complex systems provide end-to-end solutions by combining models like BART Lewis (2019) with prompting and graph-based approaches Sun et al. (2024b) , or by leveraging graph prefix tuning to enhance discourse-level understanding Sun et al. (2024a) . Recently, Gorur et al. (2024) demonstrates that prompt-tuned, open-source models like Llama-2 Touvron et al. (2023) and Mixtral Jiang et al. (2024) can outperform state-of-the-art RoBERTa-based baselines Ruiz-Dolz et al. (2021) in identifying agreement and disagreement relations among arguments. However, to the best of our knowledge, no research has explored to date the use of open-source, small LLMs for the combined tasks of argument classification and quality assessment. In this paper, we aim to fill this gap. Educational multi-task argument mining Educational multi-task argument mining focuses on extracting, classifying, and evaluating arguments in student essays—a challenging problem due to the noisy, resource-constrained nature of student writing Kashefi et al. (2023) . Beyond the tasks of argument segmentation and classification, assessing the quality of arguments is essential for evaluating their persuasiveness and coherence Wachsmuth et al. (2024) . Existing approaches, such as Longformer-based classification methods Ding et al. (2022) and graph-based frameworks Marro et al. (2022) , have made contributions to this area. Providing meaningful feedback from such analyses is particularly impactful in educational contexts. Actionable feedback enables students and educators to identify strengths and areas for improvement, with standardized scoring systems serving as valuable tools to guide learning and enhance outcomes Cabrio and Villata (2018) . Moreover, incorporating discourse-level features has been shown to improve performance by offering deeper insights into argument structures Deshpande et al. (2023) . Contributions In this paper, we make several contributions to this domain. First, we address the gap in leveraging small, open-source LLMs for argument mining, combining argument segmentation, type classification, and quality assessment. Second, we propose a computationally efficient and privacy-preserving approach, enabling local analysis on