LLM Contribution Summarization in Software Projects Equal contribution.

1 st Rafael Corsi Ferrão, 1 nd Fabio de Miranda*, 2 nd Diego Pavan Soler · 2025

Read LLM Contribution Summarization in Software Projects Equal contribution. by 1 st Rafael Corsi Ferrão, 1 nd Fabio de Miranda*, 2 nd Diego Pavan Soler (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17710.txt.

Introduction

Rafael Corsi Ferrão, Fabio de Miranda, and Diego Pavan Soler wrote a 2025 paper on a tool that summarizes the code work of each student in class team projects. A large language model holds the pen. Real industry projects teach well: the tasks are authentic and set by outside clients. But their scope varies widely, so staff cannot give fast, detailed feedback to each student.

The tool pulls the code additions of each student from the shared repository, sorts them, and structures text runs for the model. The summaries go out each week of the sprint. The test ran two semesters, in a three-week full-time sprint with over sixty students. Staff and students both found the tool useful for grading and guidance. The summaries reported real activities for the most part, though some work was missed.

Catalog record

CREATOR1 st Rafael Corsi Ferrão, 1 nd Fabio de Miranda*, 2 nd Diego Pavan Soler
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-17710

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLM Contribution Summarization in Software Projects Equal contribution. 1 st Rafael Corsi Ferrão, 1 nd Fabio de Miranda*, 2 nd Diego Pavan Soler Abstract This full paper in innovative practice provides an automated tool to summarize individual code contributions in project-based courses with external clients. Real industry projects offer valuable learning opportunities by immersing students in authentic problems defined by external clients. However, the open-ended and highly variable scope of these projects makes it challenging for instructors and teaching assistants to provide timely and detailed feedback. This paper addresses the need for an automated and objective approach to evaluate individual contributions within team projects. In this paper, we present a tool that leverages a large language model (LLM) to automatically summarize code contributions extracted from version control repositories. The tool preprocesses and structures repository data, and uses PyDriller to isolate individual contributions. Its uniqueness lies in the combination of LLM prompt engineering with automated repository analysis, thus reducing the manual grading burden while providing regular and informative updates. The tool was assessed over two semesters during a three-week, full-time software development sprint involving 65 students. Weekly summaries were provided to teams, and both student and faculty feedback indicated the tool’s overall usefulness in informing grading and guidance. The tool reports, in large proportion, activities that were in fact performed by the student, with some failure to detect students contribution. The summaries were considered by the instructors as a useful potential tool to keep up with the projects. This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible *Equal contribution between Rafael Corsi Ferrao and Fabio de Miranda I Introduction Longer undergraduate programming projects like capstones, hackathons, or sprints are often characterized by team collaboration and intense student dedication. Frequently, the client is an external entity, such as a company representative, and in these scenarios, the student team is responsible for structuring and managing the project. These types of projects can address a common deficiency in undergraduate training related to soft skills, such as communication and teamwork, often highlighted in the literature. However, the intensive nature of these projects can overload the instructor due to the amount of work involved in keeping track of multiple student groups and individuals’ work. Consequently, formative feedback may suffer, and summative feedback often relies on presentations or other superficial evidence. Large Language Models (LLMs), based on transformers, have been applied to various activities related to programming, natural language processing, and data analysis. These models combine extensive training data with a smaller context window to produce outputs that are frequently coherent. LLMs have proven potential in education [ 1 ] , for instance, in grading open-text responses [ 2 ] , and assisting students in resolving programming errors without providing direct answers [ 3 ] . This article reports on the experience of applying LLMs to monitor the progress of student teams during a course that consists of an intensive 3-week code development sprint. In this context, the requirements came from a real representative from the industry, and the design of the software was entirely up to the students. So, the instructor couldn’t impose a common structure on the projects to make monitoring or assessment more feasible. The expectation is that the LLM can be used to enable a timely and individualized summary of work accomplished on intensive, industry-oriented software projects. The summary provided to each student’s work favors the self-regulation of group work, since it was available to instructors and all the students. This tool intersects with the subjects of collaborative teamwork, technology-assisted work, and the use of AI in education. II Literature Review In recent times, there has been considerable interest in applying LLMs in education, primarily due to the impressive results demonstrated by ChatGPT, which generates responses that are consistent and systematic enough to be considered useful. Lo [ 1 ] reviewed the literature on the impact of ChatGPT in education and identified various application examples, including generating customized assessment items, feedback, and guidance for open-ended activities such as group essays [ 4 , 5 ] , simulating a peer in discussion groups [ 6 ] , and facilitating debates while providing personalized feedback. Dehbozorgi [ 7 ] applied LLMs to provide feedback on formative questions developed by students about the class content. The LLM, having access to the course materials, was able to assess the relevance and alignment of these questions with the course topics. Rudolph [ 8 ] identified that LLMs can be used to personalize student support systems through Intelligent Tutoring Systems (ITS), providing original cases for discussion tailored to each group of students. Provided that ethical issues and data privacy concerns are safeguarded, LLMs could enable adaptive personal tutors, which can consider a student’s history of actions, personal, and emotional states, thereby offering personalized feedback and suggestions. Cope [ 9 ] mentioned that one of the greatest potentials for transforming education lies in using LLMs to provide more consistent and rich formative feedback. The fields of Computing and Software Engineering have significant potential to be influenced by LLMs, particularly because the artifacts produced in these professions are digital language products, which are the niche where LLMs excel. Kirova [ 10 ] emphasized the need to rethink the teaching of Software Engineering in an LLM context, recognizing their potential for writing code, testing, and general automation, while also understanding how they work to identify risks such as intellectual property and security concerns. II-A Feedback on source code repos Projects created for the industry serve as a valuable complement to theoretical student training [ 11 , 12 ] . Teamwork is an important skill on the job market [ 13 , 14 ] . However, it is necessary to provide proper follow-up to ensure that the team work experience is both educational and productive. It is widely accepted that simply grouping students and expecting them to learn teamwork unsupervised is insufficient [ 15 ] . Monitoring and providing feedback during the development of a software project are fundamental. In the context of capstones or intensive sprints such as the one in this report, it is impractical for the professor to closely track the progress of each group. This literature review will address previous attempts to monitor academic or non-academic software projects using Git repositories. Several authors [ 11 , 12 ] point out that the ability to work in a team is one of the most important skills for the job market. Group projects are also an opportunity to develop communication, another skill commonly pointed out as deficient in engineering and computing graduates [ 13 ] . However, students often encounter negative experiences when working in teams within a school context [ 16 , 17 ] . On one hand, they dislike the uneven levels of contributions among group members; on the other hand, they tend to avoid conflicts to address this issue and are reluctant to expose peers who are not contributing effectively. It is important to note that not all group work effectively prepares students for teamwork in the professional world [ 14 ] . Group projects are intended to simulate professional teams,

Read the complete text