Enhancing LLM Problem Solving via Tutor–Student Multi-Agent Interaction
Nurullah Eymen Özdemir, Erhan Oztop · 2026
Read Enhancing LLM Problem Solving via Tutor–Student Multi-Agent Interaction by Nurullah Eymen Özdemir, Erhan Oztop (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-08931.txt.
Introduction
Özdemir and Oztop test whether a tutor student team creates synergy for language model problem solving, inspired by social mind growth. Two agents from the same model take uneven roles: a student builds and refines coding answers while a tutor gives ordered feedback without answer keys. Their PETITE setup draws better work from one model through matching roles rather than stronger bosses or mixed teams. On the APPS coding benchmark it matches or beats Self-Consistency, Self-Refine, Multi-Agent Debate, and Multi-Agent Review while using far fewer tokens.
Catalog record
| CREATOR | Nurullah Eymen Özdemir, Erhan Oztop |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32478 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.08931
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enhancing LLM Problem Solving via Tutor–Student Multi-Agent Interaction Nurullah Eymen Özdemir, Erhan Oztop Abstract Human cognitive development is shaped not only by individual effort but by structured social interaction, where role-based exchanges such as those between a tutor and a learner, enable solutions that neither could achieve alone. Inspired by these developmental principles, we ask the question whether a tutor-student multi-agent system can create a synergistic effect by pushing Large Language Model (LLM) beyond what it can do within existing frameworks. To test the idea, we adopt autonomous coding problem domain where two agents instantiated from the same LLM assigned asymmetric roles: a student agent generates and iteratively refines solutions, while a tutor agent provides structured evaluative feedback without access to ground-truth answers. In our proposed framework (PETITE), we aim to extract better problem-solving performance from one model by structuring its interaction through complementary roles, rather than relying on stronger supervisory models or heterogeneous ensembles. Our model is evaluated on the APPS coding benchmark against state-of-the-art approaches of Self-Consistency, Self-Refine, Multi-Agent Debate, and Multi-Agent Review. The results show that our model achieves similar or higher accuracy while consuming significantly fewer tokens. These results suggest that developmentally grounded role-differentiated interaction structures provide a principled and resource-efficient paradigm for enhancing LLM problem-solving through structured peer-like interactions. Index Terms— Peer Tutoring, Scaffolding, Large Language Models, Multi-Agent Systems, Code Generation I INTRODUCTION Fig. 1: The proposed PETITE framework and considered baseline architectures. (a) In PETITE a student (coder) generates solutions and a tutor (helper) provides feedback in an iterative loop, producing the final accepted solution. (b) MARS introduces structured roles, including coder, reviewer, and meta-reviewer agents, to perform hierarchical evaluation and refinement. (c) Self-Consistency samples multiple independent solutions and selects the most consistent one. (d) Self-Refine employs a single LLM that iteratively generates, critiques, and refines its own solution. (e) Multi-Agent Debate (MAD) enables multiple agents to iteratively exchange solutions and feedback until reaching consensus. A central principle of developmental science is that cognitive growth does not occur in isolation, but emerges through structured social interaction [ 1 , 2 ] . The concept of the zone of proximal development (ZPD) [ 1 ] captures this idea by positing that learners can exceed their independent capabilities when supported by appropriate guidance [ 3 ] . While the concept is typically framed in terms of a more knowledgeable other, peer tutoring research shows that structured role differentiation among similarly skilled learners can also produce significant learning gains, even in the absence of capability asymmetry [ 6 ] . This effect can be understood through role specialization: adopting an evaluative role promotes analytical reasoning, which in turn supports more effective solution generation. More generally, one-on-one tutoring is widely recognized as one of the most effective instructional formats [ 4 ] , largely due to the availability of continuous, structured feedback during interaction, which improves learning regardless of whether it is provided by a more knowledgeable tutor or a peer [ 5 ] . Taken together, these studies suggest that guided interaction, role differentiation, and continuous evaluation are key concepts of human learning and development. These developmental principles have inspired a growing body of work in artificial intelligence and machine learning. Developmental robotics [ 8 , 9 ] explores how artificial agents can acquire human-like learning behaviors through sensorimotor and social interaction. Similarly, cognitive apprenticeship frameworks [7] have shaped the design of AI tutoring systems that make expert reasoning explicit to support learning. Despite these connections, recent advances in Large Language Model (LLM) multi-agent systems have yet to incorporate principles from developmental learning, leaving the potential benefits of structuring interaction design based on human cognitive development largely unexplored. To investigate whether developmentally inspired interaction structures can improve LLM performance, we instantiate the approach in the context of autonomous code generation. We design a multi-agent setup in which two agents assume complementary roles: a student that generates and iteratively refines solutions, and a tutor that evaluates and provides guidance. This setup enables controlled analysis of how role differentiation and iterative feedback influence performance within an LLM-based system. While LLMs have demonstrated strong capabilities in automated code generation [ 10 , 11 ] , they still struggle to achieve consistently high accuracy on complex algorithmic problems, especially at smaller model scales. Current approaches to improving LLM performance include enhanced prompting strategies such as Chain-of-Thought reasoning [ 12 ] , sampling-based methods like Self-Consistency [ 13 ] , and iterative refinement frameworks such as Self-Refine [ 14 ] , as well as multi-agent systems including Multi-Agent Debate [ 17 , 18 ] and MARS [ 19 ] . While these methods have shown gains on several benchmarks, our experiments indicate that they can be fragile, often failing to improve performance and in some cases degrading accuracy in code generation tasks, where the solution space is open-ended and correctness admits many valid implementations. Among existing approaches, many employ symmetric or consensus-driven interaction patterns [ 17 , 18 ] that do not explicitly capture interaction dynamics inspired by human learning. MARS [ 19 ] introduces asymmetric roles but still relies on agreement among parallel reviewers, incurring substantial token overhead despite incorporating an early stopping mechanism. To our knowledge, these methods do not adopt role-differentiated, serial scaffolding structures commonly studied in human learning [ 4 , 3 , 6 ] . Beyond adherence to developmental principles, our approach is also motivated by a common observation in human problem-solving: when writing code, individuals often overlook errors in their own solutions, yet readily identify similar mistakes when evaluating others’ work. This asymmetry between generative and evaluative processes is well documented in peer tutoring research [ 6 ] . Evaluation engages analytical attention to correctness, edge cases and logical consistency, which is suppressed during the generative process of constructing a solution. We hypothesize that a similar asymmetry applies to LLMs: a single model, when prompted to evaluate code rather than generate it, may detect errors it would miss. If so, structuring the interaction between a generator and an evaluator roles could yield systematic performance without increasing model capacity. We introduce our PETITE ( Pe er T utoring I nspired T oken- E fficient) framework and instantiate it for code generation, a multi-agent system that balances performance gains with token efficiency. PETITE instantiates two functionally differentiated roles: Student/Coder Agent is responsible for generating and refining code solutions based on the problem description and received feedback while Tutor/Helper Agent evaluates the student’s solutions, identifies errors, logical gaps and edge cases, and provides structured feedback to guide improvements. A key innovation of PETITE is its serial usage of helper agent with asymmetric role assignment. Unlike traditional iterative approaches that execute a fixed number of refinement rounds, PETITE terminates when the tutor agent determines that the solution is correct. This adaptive termination naturally allocates more computational resources to harder problems while efficiently resolving simpler ones and reduces unnecessary token consumption, mirroring the differential pacing observed in human cognitive development. Our contributions are as follows: • We propose a peer tutoring inspired LLM framework (PETITE), instantiated in code generation domain, a multi-agent system that uses structured role-based interaction for iterative code refinement. • We show that asymmetric tutor–student role separation, motivated