IntelliCode: A Multi-Agent LLM Tutoring System with Centralized Learner Modeling

Jones David, Shreya Ghosh · 2025

Read IntelliCode: A Multi-Agent LLM Tutoring System with Centralized Learner Modeling by Jones David, Shreya Ghosh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18669.txt.

Introduction

Jones David and Shreya Ghosh present an AI tutor for programming students in this 2025 paper. Most language model tutors answer one turn at a time and forget the learner. IntelliCode instead keeps a central learner state with a full edit history. It holds mastery estimates, wrong ideas, review schedules, and activity signals. A StateGraph Orchestrator runs six specialist agents. They cover skill checks, profiling, step-by-step hinting, lesson choice, spaced review, and activity tracking, all writing to the shared state under a single-writer rule.

A demo follows a learner through a data structures problem: a hint when stuck, a corrected submission, then instant mastery updates and a personal review interval. Tests with computer-made learners show stable state updates. They also show better task success with step-by-step hints, and broad topic coverage.

Catalog record

CREATORJones David, Shreya Ghosh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-18669

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

IntelliCode: A Multi-Agent LLM Tutoring System with Centralized Learner Modeling Jones David, Shreya Ghosh Abstract LLM-based tutors are typically single-turn assistants that lack persistent representations of learner knowledge, making it difficult to provide principled, transparent, and long-term pedagogical support. We introduce IntelliCode , a multi-agent LLM tutoring system built around a centralized, versioned learner state that integrates mastery estimates, misconceptions, review schedules, and engagement signals. A StateGraph Orchestrator coordinates six specialized agents: skill assessment, learner profiling, graduated hinting, curriculum selection, spaced repetition, and engagement monitoring, each operating as a pure transformation over the shared state under a single-writer policy. This architecture enables auditable mastery updates, proficiency-aware hints, dependency-aware curriculum adaptation, and safety-aligned prompting. Our demo showcases an end-to-end tutoring workflow: a learner attempts a DSA problem, receives a conceptual hint when stuck, submits a corrected solution, and immediately sees mastery updates and a personalized review interval. We report validation results with simulated learners, showing stable state updates, improved task success with graduated hints, and diverse curriculum coverage. 1 1 1 Live System : https://intellicode.redomic.in 2 2 2 Video Demo : https://youtu.be/oO8bZfeleOU 1 Introduction Large Language Models (LLMs) have rapidly expanded the possibilities of automated tutoring, yet most existing systems remain fundamentally reactive: each query is treated in isolation, with little continuity or awareness of a learner’s evolving knowledge 12 . Human tutors, in contrast, maintain rich, persistent models of student understanding that support targeted feedback, curriculum scaffolding, and long-term learning trajectories 9 . This discrepancy limits the pedagogical reliability of current LLM tutors, which often provide inconsistent hints, overlook dependencies between concepts, and fail to account for systematic misconceptions. Figure 1: Unified Learner State Schema. Recent frameworks such as GenMentor 10 and SocraticLM 3 demonstrate the promise of multi-agent orchestration and structured dialogue in stabilizing tutoring behavior. However, these systems typically rely on ephemeral or implicit memory, lacking an explicit, auditable learner model shared across agents. At the same time, decades of work on learner modeling from Bayesian Knowledge Tracing (BKT) 1 and Deep Knowledge Tracing (DKT) 6 to memory networks 13 and PFA 5 , underscore the importance of accurate mastery estimation for personalization. Yet, few LLM-based tutors integrate such formal models with generative reasoning in a persistent, updateable state. Our goal is to bridge this gap. We introduce IntelliCode , a multi-agent LLM tutoring system built around a centralized, versioned learner state that serves as the single source of truth for all pedagogical decisions. Unlike prior systems, IntelliCode enforces a single-writer policy through a StateGraph Orchestrator , ensuring that every mastery update, hint intervention, or curriculum choice results from a coherent, formally validated transformation of the learner model. This design mitigates drift, prevents conflicting agent outputs, and enables transparent, multi-turn personalization. IntelliCode integrates well-established instructional principles: mastery estimation, graduated hinting, dependency-aware curriculum planning, and spaced repetition; with modern LLM capabilities. The learner state encodes mastery vectors with uncertainty, misconceptions, review schedules, and behavioral signals. Six specialized agents (Skill Assessment, Learner Profiler, Pedagogical Feedback, Content Curator, Progress Synthesizer, and Engagement Orchestrator) each operate as pure functions over this shared state. For example, if a learner repeatedly omits a base case in recursion problems, the Profiler records a misconception, the Feedback agent adapts its hint level, and the Curator adjusts upcoming tasks accordingly. Contributions. This work makes the following contributions: (1) a centralized, versioned learner state and single-writer orchestration mechanism enabling consistent, auditable multi-turn tutoring; (2) a suite of pedagogical agents that implement mastery estimation, graduated hinting, curriculum planning, and spaced repetition as pure transformations over the shared state; and (3) a fully functional, end-to-end LLM tutoring system demonstrating stable interaction, interpretable decision-making, and robust content coverage through simulated learner studies. Figure 1 highlights the unified learner state that drives our adaptation policies. By grounding agent behavior in this structured representation while leveraging LLM reasoning for high-variance tasks such as hinting and code analysis, IntelliCode offers a transparent and pedagogically consistent alternative to memory-less conversational tutoring. 2 System Architecture We frame adaptive personalized education as a Partially Observable Markov Decision Process (POMDP). At each timestep, the learner state \mathbf{S}_{t} maintains mastery vectors, SM-2–based review schedules, engagement metrics, and metacognitive memory. Observations \mathcal{O}_{t} reflect noisy behavioral signals such as submissions, errors, and hint requests, while actions \mathcal{A}_{t} correspond to pedagogically meaningful interventions including content recommendation, graduated hinting, and schedule adjustments. The reward function R_{t} trades off mastery gains with penalties for excessive hint usage and inefficient solve times (details in Appendix B ). This formulation enables principled adaptation while supporting the modular multi-agent design showcased in the demo. Table 1: Roles and responsibilities of the six pedagogical agents. Agent Responsibility Pedagogical Feedback Provides proficiency-aware, five-level graduated hinting without solution disclosure. Content Curator Selects personalized problems based on mastery, dependencies, and the 40/50/10 curriculum policy. Engagement Orchestrator Monitors motivation, pacing, and disengagement signals to issue supportive nudges. Skill Assessment Performs hybrid evaluation using test-case execution and semantic code review. Learner Profiler Estimates mastery deltas, identifies misconceptions, and infers behavioral trends. Progress Synthesizer Schedules reviews using an enhanced SM-2 mechanism with context-aware adjustments. 2.1 Orchestrator Overview At the core of IntelliCode is the StateGraph Orchestrator , the only component permitted to write to the persistent learner record. It maintains a synchronized in-memory copy of the learner state and coordinates all interactions among the six pedagogical agents. When an event occurs, the orchestrator routes it to the appropriate agents, aggregates their outputs, validates the proposed state changes, and then commits them as an atomic update. Similar to the coordination strategy in GenMentor 10 , this mechanism prevents conflicting writes, enforces safety and schema constraints, and ensures that the system behaves predictably over multi-turn, long-term tutoring sessions. The orchestrator thus provides the reliability and auditability necessary for principled learner modeling. 2.2 Trigger Types and Routing The orchestrator reacts to pedagogically meaningful events and dispatches them to the relevant agents. These triggers operationalize the full workflow demonstrated in the system: • on_submission : A code or answer submission triggers Skill Assessment, followed by the Learner Profiler and Pedagogical Feedback. • on_hint_request : A learner request for help triggers the Pedagogical Feedback agent, informed by current proficiency and hint history. • on_session_check : A daily check-in triggers the Content Curator and Engagement Orchestrator. • on_daily_generation : The system generates the day’s personalized problem set via the Content Curator. • on_review_due : When an SM-2 review is due, the Progress Synthesizer and Content Curator are invoked. These triggers allow IntelliCode to respond adaptively to the learner’s evolving behavior, maintaining pedagogical continuity across sessions. 2.3 Overview of System Agents Each agent operates as a pure transformation over the shared learner state, producing structured outputs that the orchestrator validates and integrates. Together, the six agents support assessment, personalization, pacing, hinting, and review scheduling. Table 1 summarizes their responsibilities, and Figure 2 shows how the orchestrator mediates their communication. This design ensures that all instructional decisions are grounded in a consistent, auditable learner state and remain traceable throughout the tutoring trajectory. The overall data flow is illustrated in Figure 2 . The StateGraph Orchestrator mediates all communication between agents and the persistent learner state, ensuring that instructional decisions remain traceable and consistent across sessions. Figure 2: System Architecture: The StateGraph Orchestrator

Read the complete text