AI-Driven Contribution Evaluation and Conflict Resolution: A Framework & Design for Group Workload Investigation
Jakub Slapek, Mir Seyedebrahimi, Yang Jianhua · 2025
Read AI-Driven Contribution Evaluation and Conflict Resolution: A Framework & Design for Group Workload Investigation by Jakub Slapek, Mir Seyedebrahimi, Yang Jianhua (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07667.txt.
Introduction
Jakub Slapek, Mir Seyedebrahimi, and Jianhua Yang design software to judge who did what in team projects. Unequal workloads spark disputes, and manual investigation is slow and costly. Existing tools track tasks but rarely resolve conflicts or use artificial intelligence well.
Their framework gathers submissions, chats, emails, meeting logs, task records, and peer ratings into three organized evidence layers. An AI-enhanced tool then assists dispute investigation instead of leaving assessors to dig. Fairer contribution scores could calm group work in classes and workplaces. The design stresses evidence organization before automated judgment, keeping humans able to audit decisions.
Catalog record
| CREATOR | Jakub Slapek, Mir Seyedebrahimi, Yang Jianhua |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-07667
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
AI-Driven Contribution Evaluation and Conflict Resolution: A Framework & Design for Group Workload Investigation Jakub Slapek, Mir Seyedebrahimi, Yang Jianhua Abstract The equitable assessment of individual contribution in teams remains a persistent challenge, where conflict and disparity in workload can result in unfair performance evaluation, often requiring manual intervention – a costly and challenging process. We survey existing tool features and identify a gap in conflict resolution methods and AI-integration. To address this, we propose a framework and implementation design for a novel AI-enhanced tool that assists in dispute investigation. The framework organises heterogeneous artefacts – submissions (code, text, media), communications (chat, email), coordination records (meeting logs, tasks), peer assessments, and contextual information – into three dimensions with nine benchmarks: Contribution, Interaction, and Role. Objective measures are normalised, aggregated per dimension, and paired with inequality measures (Gini index) to surface conflict markers. A Large Language Model (LLM) architecture performs validated and contextual analysis over these measures to generate interpretable and transparent advisory judgments. We argue for feasibility under current statutory and institutional policy, and outline practical analytics (sentimental, task fidelity, word/line count etc.), bias safeguards, limitations, and practical challenges. Keywords: AI-assisted assessment , Conflict resolution in teams , Contribution investigation , Peer assessment , Collaborative learning , Learning analytics . [1] Introduction Collaborative tasks and teamwork are a cornerstone of contemporary higher-education pedagogy, cultivating skills that are difficult to develop in solitary coursework. However, where individual grades need to be determined and some participants contribute unevenly, disagreements may arise. Adjudicating these disputes is often challenging and time-consuming due to the quantity of evidence, relationship nuances, ambiguity, and many other factors. On top of this, the final verdict itself can be influenced by subjectivity and bias. Common practice assigns grades equally among team members, which can lead to negative reactions from students, and does not reflect the typical industry experience [ 57 ] . AutoRating systems and web-based peer-assessment platforms enable peers to report relative contributions and automate assessment based on rubrics via instruments; however, these increase administrative load, suffer from subjective popularity effects, and aid minimally in conflict resolution. Parallel work in Learning Analytics (LA) has sought objectivity via analysis of student artefacts to derive equity metrics, measures of presence, and emergent roles. Yet, current research centres on the initial stage of feedback [ 69 ] , and supports student agency mainly in theory – operational practices remain sparse [ 29 ] . AI/Generative AI (GenAI) offers a way to bridge these fields by contextualizing multiple sources of evidence and the semantics of human interaction under a “neutral” stance [ 2 ] . Existing methods and modern tools reserve AI for screening and semantic analysis unrelated to contribution evaluation, and GenAI for qualitative feedback and resource generation in manners that are invasive, unsuitable towards summative assessment, and lack transparency and explainability. Meanwhile, frameworks target ethics and allowance in peer assessment, but aside from advising to keep the “human-in-the-loop”, few discuss the evaluation process itself. Hence, there is a definitive gap in both systems that provide in-depth assistance for group workload investigation, and methodology and guidance towards advisory assessment practices. In this work, we establish a foundation for the development of a tool enhanced with AI designed to assist the investigation of disputes over individual contribution in group work. Our investigation assesses the feasibility of AI-assisted investigation in higher education under existing policy, and comprehensively surveys dispute investigation methodology and AI integration in existing tools. We propose: (1) A conflict assessment framework suggesting three dimensions ( Contribution , Interaction , and Role ), subdivided into nine benchmarks, signalling conflict based on categorised evidence; (2) An implementation plan instantiating our framework – a pipeline from evidence to AI-driven judgment – that extracts features over submissions, communications, and coordination records in the form of objective metrics, normalises and aggregates values, analyses inequality to raise conflict markers, and performs evaluative advisory judgment. [2] Background Study [2.1] Foundation [ 72 ] defines Peer Assessment (PA) as “a system in which individuals evaluate the quantity, level, value, worth, quality, or achievement of their peers’ learning products or outcomes, who share a similar status”. It has been shown that peer marks correlate strongly with instructor marks [ 18 ] , and that well-scaffolded PA cultivates students’ assessment literacy and self-regulation skills – two prerequisites for fair contribution judgements in group work [ 84 ] [ 59 ] . This is deeply entwined with the field of Collaborative & Co-operative Learning (CL) [ 63 ] [ 60 ] , whose benefits have been displayed in countless studies [ 57 ] , and whose failing mechanisms lead to an erosion of group learning and morale [ 65 ] . On the other hand, it can also be the case that assessment becomes the “Achilles heel” of learning, inhibiting the processes it is designed to enhance [ 3 ] . We discuss governing factors through the lens of computer-assisted summative assessment that facilitate CL. A major driver of unfairness is Social Loafing: "students who don’t take responsibility for their own role, even if it is the smallest role in the group" [ 37 ] , often leading to an over-reliance on stronger students [ 51 ] who resent others for gaining credit for what they perceive as their own contribution [ 3 ] . However, whilst it has been shown that normalisation is an effective fix for generosity bias and yields measurably fairer grades, a minority of students react negatively because the algorithm feels like it over-rides their personal judgements [ 66 ] . Therefore, beyond procedural fairness, tools must also earn social legitimacy to balance technocracy. Context and accuracy are major talking points from [ 19 ] . Results are reproducible from quantitative data, but more meaningful from qualitative data. The author cautions that a heavy skew in either direction can lead to test pollution (i.e., learning for the exam), and an inability to account for students’ knowledge. Increasing inter-rater reliability (that multiple markers would agree with the same evaluation) reduces instructor bias, but can be impractical due to the institutional costs of many markers. Subsequently, they suggest algorithmic co-marking and structured peer and self-assessment. [2.2] Peer Assessment Instruments Adding a qualitative dimension via structured psychometric tools demonstrates improvements in the fairness and accuracy of PA [ 62 ] , as well as inter-rater reliability [ 39 ] . Moreover, studies show rubrics enhance the quality of evaluative judgment [ 28 ] . The AutoRating System [ 5 ] derives individual marks from team marks – tackling “passenger syndrome” (unequal contribution), and promoting individual learning in team projects. Students rate their peers in qualitative categories (e.g., “Excellent”, “Unsatisfactory”), each assigned a numerical value from 0 to 100, and are “autorrated” as follows: \text{{Final Indiv. Grade}}=(\text{{Indiv. Average }}/\text{ {Team Average}})\times\text{{Team Grade}} (1) Assessment guidelines for instructors in the CL literature recommend the system [ 57 ] , and studies promote its use for decreasing administrative load and identifying dysfunctional teams and team members (“hitchhikers” and “tutors”) [ 41 ] [ 44 ] . Variants include square rooting the weight factor, and constant sum allocation with a fixed number of distributable points, to which studies report some collusion risk, but decreased