Personality-Driven Student Agent-Based Modeling in Mathematics Education: How Well Do Student Agents Align with Human Learners?

Bushi Xiao, Qian Shen · 2026

Read Personality-Driven Student Agent-Based Modeling in Mathematics Education: How Well Do Student Agents Align with Human Learners? by Bushi Xiao, Qian Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-21358.txt.

Introduction

Xiao and Shen test how well personality-driven student agents match real learners in mathematics education. Real teaching experiments face ethical limits and cannot be repeated on the same student. Their agents carry Big Five personality traits and run through teacher interaction, self-study, and exams. They gathered thirteen empirical studies on traits and learning and distilled them into fourteen criteria. About seventy one percent of agent behavior aligned with human learners. The study checks agent credibility before such simulations are used at scale.

Catalog record

CREATORBushi Xiao, Qian Shen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27053
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.21358

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Personality-Driven Student Agent-Based Modeling in Mathematics Education: How Well Do Student Agents Align with Human Learners? Bushi Xiao, Qian Shen Abstract It is crucial to explore the impact of different teaching methods on student learning in educational research. However, real-person experiments face significant ethical constraints, and we cannot conduct repeated teaching experiments on the same student. LLM-based generative agents offer a promising avenue for simulating student behavior. Before large-scale experiments, a fundamental question must be addressed: are student agents truly credible, and can they faithfully simulate human learning? In this study, we built a Big Five Personality-based student agent model with a full pipeline of student-teacher interaction, self-study, and examination. To evaluate behavioral fidelity, we collected 13 empirical studies on Big Five traits and learning, and distilled them into 14 criteria. We found that the 71.4% of the student agents’ behavior was aligned with human learners. 1 Introduction and Related Work As LLMs become increasingly prevalent in education, research has shifted from simple question-answering toward complex pedagogical agent interactions ( 1 ) . Rooted in social constructivism, Scaffolding Theory holds that mentors provide temporary and targeted support to help learners traverse their Zone of Proximal Development ( 26 ; 25 ; 24 ) . More broadly, human experiments face ethical constraints and cannot expose the same student to repeated interventions, making simulation an alternative. Agent-Based Modeling (ABM) is a powerful simulation approach for complex systems. In the first work on generative agents, 20 instantiated LLM-based generative agents in an interactive sandbox environment. Building on this work, 27 demonstrated the reliability of generative ABMs in simulating social events. Research on LLM-based math instruction shows that agent personality traits significantly change learning outcomes — students favor complementary personalities ( 10 ) , while conscientious or neutral personas best promote cognitive engagement ( 13 ; 14 ) . However, these studies only use agents as teachers and humans as students; there is limited research using agents as students with a memory system. Constructing a full-pipeline teaching agent is technically challenging, yet the value of building such agents is substantial: they enable simulation of learning trajectories over time, which is a genuine gap in the literature, and allow systematic testing of how different personality types respond to different teaching styles, something nearly impossible in human-participant studies. They also offer cost-effective alternatives to human experiments and may yield unexpected findings. Nevertheless, researchers cannot directly use student agents for experiments before validating their effectiveness and fidelity. In this paper, we address this question by constructing ABMs grounded in the Big Five personality traits, evaluating their learning and exam performance across four mathematical domains: Algebra, Number Theory, Counting and Probability, and Geometry. We analyzed the results of student agents with different personalities after rounds of teacher interaction or self-study 1 1 1 Code available at: https://github.com/kitayamachingtak/bigfivestudent.git . We further collected 13 prior studies on the influence of Big Five personality traits on human students, distilled them into 14 criteria to assess how well LLM-based agents align with human learning characteristics. We found that most agents improved after learning, though over-learning tends to worsen performance. High-extraversion student agents performed best on average, while high-neuroticism student agents performed worst. Overall, student agents’ learning behavior aligned with real-world literature on 10 out of 14 criteria. Figure 1: Overview of the student-teacher ABM framework. The system classifies the NuminaMath-CoT dataset into math topics with pre-embedded question banks. In each Learning Round, the Student Agent decides among interacting with the Teacher Agent, self-studying, or resting, updating its memory accordingly. In the Exam Round, the Student Agent makes decision to retrieve memory to answer questions. 2 Pipeline NuminaMath-CoT ( 11 ) consists of 860k math problems with chain-of-thought solutions. We used the bert-finetuned-math-prob-classification model ( 3 ) 2 2 2 Model available at: https://huggingface.co/lschlessinger/bert-finetuned-math-prob-classification . to classify and select questions across four domains: Algebra, Number Theory, Counting and Probability, and Geometry. We then filtered and retained 3,044 questions with classification confidence above 0.95. To improve evaluation accuracy, we prepared two formats of answers: LaTeX and plain text. The questions are split into development and test sets, and pre-embedded to vector space for retrieval using the inf-retriever-v1-1.5b retriever ( 28 ) . All agents are based on the Large Language Model gpt-oss-120b ( 19 ) . We extracted personality descriptions of the big five personality traits from research of 4 to construct the personality basis of the student agent. All types of student agents will experience two identical stages: the learning round and the exam round. During the learning round, student agents decide among three actions: asking the teacher, self-studying, or resting. When asking the teacher, the student selects a topic of interest, and the teacher agent explains the relevant knowledge, retrieves a closely related question from the question bank, and walks through the solution. The teacher agent doesn’t have a memory system, but is informed to explain the question adaptively to the student’s personality. During self-study, the student selects a topic to review and independently retrieves a related question to study. Resting skips the round entirely. At the end of each learning round, newly acquired knowledge is encoded into memory and merged with prior memory, with all entries vectorized for retrieval. During the exam round, student agents retrieve relevant memories to inform their responses to exam questions. The entire pipeline is more like a real person than a machine learning model, where the agent decides what to learn and what to recall during the exam. Figure 2: The first row of the figure compares how agents’ F1 change across different learning rounds for each math type. The second row shows how the number of blank answers varies across different numbers of learning rounds. The third row compares the same agent’s performance across different math types. The bottom-left figure shows the probability of student agents interacting with teacher agents across multiple experimental runs. The bottom-middle figure shows the average number of timestamps during agent learning and examination. The bottom-right figure shows the average F1 score rankings of agents across multiple runs. Research Category Key Studies Score General Meta-Analyses 21 , 16 , 18 2.5/3 Mathematics-Specific Studies 22 , 17 , 8 , 2 , 12 3/5 Teacher Interaction 15 , 18 1/2 Learning Behavior 7 , 6 1.5/2 Self-Regulation 23 , 9 2/2 Table 1: We manually evaluate student agent behavior against human learner characteristics across five dimensions and 14 criteria from 13 research papers. Each criterion is scored as Accurate (1), Partial (0.5), or Not Met (0). 3 Results and Discussion We configured the teaching system to run for 10, 20, and 50 rounds, with each set of rounds run independently for 3 times. We also set up a control group without learning. Each exam is single-topic; a round consists of 100 questions. We then measured and recorded the learning outcomes of the student agents. The F1 (macro F1) results from figure 2 show that for all four math types, all agents showed improvement after some rounds of learning. However, fewer rounds of learning often outperformed 50 rounds, suggesting that exam performance tends to drop after over-learning — possibly because once memory becomes saturated, the retriever struggles to retrieve useful information to assist

Read the complete text