Exploring the Feasibility of Employing a Hybrid Machine Learning Method to Unpack Student Reasoning Patterns in Physics Essays

Winter Allen, N. Sanjay Rebello · 2025

Read Exploring the Feasibility of Employing a Hybrid Machine Learning Method to Unpack Student Reasoning Patterns in Physics Essays by Winter Allen, N. Sanjay Rebello (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08904.txt.

Introduction

Student reasoning in physics essays is unpacked by a hybrid clustering pipeline from Winter Allen and Sanjay Rebello in a 2025 arXiv paper. Essays came from an online quiz where students also picked an answer. The pipeline weds two classic cluster methods with no labels given. Its clusters lined up well with the answers students picked. Score cards set the hybrid against each parent method on its own.

The hybrid held its own on spread and split gauges. Label-free reads of essay thought gain a new tool. Teachers could spot shared wrong turns this way.

Catalog record

CREATORWinter Allen, N. Sanjay Rebello
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-08904

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Exploring the Feasibility of Employing a Hybrid Machine Learning Method to Unpack Student Reasoning Patterns in Physics Essays Winter Allen, N. Sanjay Rebello Abstract We propose a novel clustering pipeline that combines two classic clustering algorithms to better understand student problem-solving strategies. This unsupervised machine learning method helps uncover patterns in reasoning without pre-defined labels. We applied it to essays written for an online multiple-choice quiz, the resulting clusters showed strong statistical alignment with students’ selected answers. We also report on the resulting clusters of the hybrid pipeline compared to that of K-Means [ 1 ] and Hierarchal Density-Based Spatial Clustering of Application with Noise (HDBSCAN) [ 2 ] by analyzing the Scatter Plots, Silhouette Scores [ 3 ] , and Davies Bouldin Index [ 4 ] . 1 Introduction Problem solving is a highly valued skill that is essential for STEM students entering the workforce. According to the Next Generation Science Standards (NGSS), learning to define problems and design solutions is one of the key science and engineering practices [ 5 ] . For years, studies have shown that students in introductory STEM courses tend to use ineffective problem solving strategies. [ 6 , 7 , 8 ] . When asked to describe in writing their strategy to solve a problem, students’ problem solving skills have been shown to improve [ 6 ] . Strategy writing, with appropriate scaffolds, helps students focus on the deeper structure of the problem [ 9 , 10 , 11 ] , starting with conceptual analysis [ 12 ] of the problem, and avoiding novice unproductive strategies. In Physics Education Research (PER), there are recent efforts to utilize machine learning tools in classrooms [ 13 , 14 ] . Some are focused on assessment, while others seek to extract information from student data. Martin et al. [ 13 ] use unsupervised machine learning methods to analyze emerging patterns in students’ argumentation essays. Tschisgale et al. [ 14 ] utilizes known unsupervised clustering techniques in conjunction with Computational Grounded Theory [ 15 ] to assess student problem solving strategies. There are many methods that can be used to analyze student responses, including supervised [ 16 ] , semi-supervised [ 17 ] , and unsupervised [ 18 ] machine learning. Supervised learning works by utilizing inputs to predict the outputs [ 16 ] . For this method, known, labeled data is required to train an algorithm to better predict patterns for unlabeled datasets. Semi-supervised learning works by using large amounts of unlabeled data, together with the labeled data, to build better classifiers [ 17 ] . Unsupervised learning algorithms work to infer properties or patterns of a dataset without any labeled data. [ 18 ] Unsupervised learning is a viable technique for many researchers, including ourselves, to explore large textual datasets that are not measurable using qualitative methods. The ideal way to extract student processes is to read each essay from a student and qualitatively label their response. However, time needed to read and reliably extract information form large datasets of thousands of student responses is prohibitive. Therefore, we explore other methods to analyze student essays. To investigate the problem-solving strategies described in students’ essays, researchers have been limited to qualitative analysis for small datasets (ADD CITATIONS). New machine learning methods and Large Language Models (LLMs) offer the promise of detecting the emergent themes from students’ written strategy essays. For the last couple of years, we have been exploring popular machine learning clustering methods to detect patterns in students’ essays. To investigate the emergent themes in student problem-solving strategy essays, we employ clustering – an unsupervised learning technique. There are a multitude of clustering algorithms such as: K-Means [ 1 ] , Density-based Spatial Clustering Applications with Noise (DBSCAN) [ 19 ] , Hierarchical Density-Based Spatial Clustering of Applications with Noise (HDBSCAN) [ 2 ] , and many more. We have explored HDBSCAN and K-Means individually on a variety of data with much difficulty. Though they each have their own strengths and offers different benefits, we often found they were limited in the insights they provided us. Therefore, we began exploring other methods that capture the benefits of both algorithms. In this paper, we present a novel hybrid technique from well-established clustering algorithms to assess the problem-solving performance of students from their essay responses. This method utilizes the strengths of K-Means and HDBSCAN to construct well-defined, unique clusters on physics student problem-solving strategy essays. We then compare our novel hybrid approach with two traditional clustering methods: K-Means, HDBSCAN. K-Means [ 1 ] is a tried-and-true method which most researchers are familiar with. HDBSCAN [ 20 ] is a relatively new clustering technique built to deal with noisy data. The hybrid approach we propose utilizes both strengths. Throughout our research, we have utilized both K-Means and HDBSCAN on various datasets and found that, for our work, they seemed to miss many of the patterns we expected. In an attempt to improve their performance, we have decided to combine the two and report on the resulting clusters. We will compare three methods: applying only K-Means, applying only HDBSCAN, and applying the hybrid K-Means/HDBSCAN method to the same set of data. We will report on the scatter plots, the silhouette scores [ 3 ] , the Davies-Bouldin index [ 4 ] . We will also explore how well the hybrid clusters align with student responses to a multiple choice quiz question. Finally, we will discuss the implications of our results for physics education research. 1.1 Research Questions Based on the issues stated above, our specific research questions (RQs): RQ1 : To what extent does combining K-Means and HDBSCAN into a hybrid similarity-density-based clustering method reveal more well-constructed and rich clusters than either algorithm alone? RQ2 : To what extent can we extract expected incorrect or correct strategies based upon students’ answers to a multiple choice question? 2 Background 2.1 Problem Solving Student problem solving has been a relevant and rich topic in PER for many years [ 21 , 22 , 23 ] . As researchers and educators, it is imperative to aid student understanding in solving physics problems. Students often prioritize memorizing final answers over developing a deeper understanding of the problem solving process [ 22 , 24 ] . To foster this growth, it is crucial not only to understand why students solve problems the way they do but also to help them reflect on their own problem-solving strategies, allowing them to develop as both learners and future scientists. Research has demonstrated expert-novice differences in problem solving due to differences in conceptual understanding [ 25 ] and knowledge organization [ 26 , 27 ] . Novices often lack an understanding of the underlying principles [ 6 ] , and adopt different problem solving strategies than experts [ 21 ] . In addition, unlike experts, novices rarely explain their solutions, reflect on their process, or consider alternative strategies [ 24 ] . Several research-based strategies have addressed the issues above [ 21 ] , however, systemic challenges persist. Introductory STEM courses often use end-of-chapter, well-structured problems, give all needed information, and have one solution path. It is unlikely that these kinds of problems prepare students with 21st Century

Read the complete text