Predicting ChatGPT Use in Assignments: Implications for AI-Aware Assessment Design
Surajit Das, Aleksei Eliseev · 2025
Read Predicting ChatGPT Use in Assignments: Implications for AI-Aware Assessment Design by Surajit Das, Aleksei Eliseev (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12013.txt.
Introduction
Surajit Das and Aleksei Eliseev present a 2025 study on predicting which students use ChatGPT for their assignments. The rise of chatbots has changed how students work and raised hard questions about honest effort. Most past research was based on opinion, not on measured student behavior.
The authors surveyed 388 university students, mostly in Russia, and built a prediction model from their answers. Study habits, subject tastes, and attitudes toward AI were the strongest signals. The model sorted users from non-users with about eighty percent accuracy. A finer model of use levels reached about sixty-five percent. Students who often used the tool to learn new concepts showed signs of over-reliance, which the authors flag as a risk for schools.
Catalog record
| CREATOR | Surajit Das, Aleksei Eliseev |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-12013
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Predicting ChatGPT Use in Assignments: Implications for AI-Aware Assessment Design Surajit Das, Aleksei Eliseev Abstract The rise of generative AI tools like ChatGPT has significantly reshaped education, sparking debates about their impact on learning outcomes and academic integrity. While prior research highlights opportunities and risks, there remains a lack of quantitative analysis of student behavior when completing assignments. Understanding how these tools influence real-world academic practices, particularly assignment preparation, is a pressing and timely research priority. This study addresses this gap by analyzing survey responses from 388 university students, primarily from Russia, including a subset of international participants. Using the XGBoost algorithm, we modeled predictors of ChatGPT usage in academic assignments. Key predictive factors included learning habits, subject preferences, and student attitudes toward AI. Our binary classifier demonstrated strong predictive performance, achieving 80.1% test accuracy, with 80.2% sensitivity and 79.9% specificity. The multiclass classifier achieved 64.5% test accuracy, 64.6% weighted precision, and 64.5% recall, with similar training scores, indicating potential data scarcity challenges. The study reveals that frequent use of ChatGPT for learning new concepts correlates with potential overreliance, raising concerns about long-term academic independence. These findings suggest that while generative AI can enhance access to knowledge, unchecked reliance may erode critical thinking and originality. We propose discipline-specific guidelines and reimagined assessment strategies to balance innovation with academic rigor. These insights can guide educators and policymakers in ethically and effectively integrating AI into education. 1 Introduction The rapid emergence of generative AI tools such as ChatGPT has transformed workflows, decision-making processes, and human-machine interaction across diverse domains. Remarkably, within just two months of its release, ChatGPT amassed over 100 million users worldwide, representing the fastest adoption of any consumer application to date [ 10 ] . This unprecedented surge has also significantly impacted education, offering new possibilities for accessible knowledge generation, academic support, and personalized learning. However, it has simultaneously raised concerns about academic integrity, student engagement, and assessment practices [ 15 ] . Higher education institutions now face the dual challenge of harnessing the benefits of generative AI while preserving academic standards. Students increasingly use such tools for a variety of academic tasks, including essay writing, programming, and exam preparation. Yet, the motivations behind these behaviors and their implications for learning outcomes remain underexplored, particularly in quantitative terms. Students may leverage generative AI either to deepen understanding or as a shortcut to bypass intellectual effort—two contrasting behaviors with profoundly different implications for education policy and pedagogy. This study quantitatively investigates these motivations, contexts, and behavioral patterns, addressing questions such as: Who uses ChatGPT for academic work? What types of students are more likely to rely on it? And what patterns might signal ethical versus overreliant use? Although prior research has begun to explore the educational implications of generative AI—such as the impact on learning strategies [ 12 ] , institutional policy [ 13 ] , and meta-analyses of learning outcomes [ 14 ] —few studies provide predictive models grounded in behavioral data from real academic contexts. To address this gap, we analyze survey responses from 388 university students (predominantly Russian, including international students) and apply Extreme Gradient Boosting (XGBoost) to identify key predictors of ChatGPT usage. Our primary research question is: • What behavioral, demographic, or attitudinal factors predict student use of ChatGPT in academic assignments? By employing an interpretable machine learning model, our goal is to uncover meaningful behavioral predictors of generative AI adoption. These insights can assist educators and policymakers in designing discipline-specific guidelines and assessment strategies that balance innovation with academic integrity. 2 Related Work Generative AI’s emergence has sparked widespread educational inquiry, ranging from implementation strategies to ethical and pedagogical implications. Early reviews highlight the promise and pitfalls of large language models (LLMs) in educational settings. Tan et al. [ 4 ] emphasize the urgency of rethinking academic integrity frameworks in the era of ChatGPT, while Shailendra et al. [ 5 ] propose a structured framework for GenAI adoption that supports both personalization and accountability. Empirical insights are also growing. Zastudil et al. [ 15 ] conducted interviews with students and faculty to explore how generative AI affects productivity and critical thinking. Gutiérrez and Strachan [ 7 ] describe practical GenAI deployment strategies, while Fleury et al. [ 8 ] summarize real-world classroom adoption experiences. These works advocate for AI-literate, ethically aware curricula. T4E-specific studies further demonstrate evolving instructional practices. Khwaja et al. [ 6 ] present a case study on orchestrating active learning in hybrid classrooms using EdTech, offering practical insights into student engagement. Other T4E proceedings emphasize the importance of aligning AI tools with course outcomes and learner behaviors [ 9 ] . Despite these advances, quantitative modeling of why and when students choose to use AI—especially in real academic tasks such as assignment preparation—remains limited. Our study fills this gap by analyzing behavioral, disciplinary, and attitudinal predictors of ChatGPT usage using interpretable machine learning, offering data-driven recommendations for educators and EdTech policy designers. 3 General Discussion For the study purpose, a self reported survey was carried out amid university students to capture different types of variables pertaining to demography, daily practice, engagements, etc. which possibly shape AI engagement in academics. Several questions were setup to capture the responses which were validated by the experts and the inconstant responses were eliminated. However, we presume that the dataset is not absolute noise free. Each question was mapped to a variable, although the set up was able to detect the contradictory answers. We attached a few variables along with the short descriptions the full dataset and the questions may be delivered on request. Examples of Some Variables: We describe below a few representative variables used in this study. The corresponding survey questions of these variables are at: https://drive.google.com/drive/folders/1FdtwbJ2YR5lGpWssTX5HxvFvrSOSW0q-?usp=drive_link • Academic_Involvment : Number of participations in academic competitions and research work (3-year recall). • Non_Academic_Involvment : Number of Participation in non-academic competitions (3-year recall) • ChatGPT_Important_4_Good_Student : ChatGPT use willingness when competent in the subject (Highlights productivity-focused usage, even among confident students), Using ChatGPT is allowed unconditionally. • ChatGPT_4_Non_Performer : ChatGPT use for simple but uninteresting tasks or for underperforming subjects. Using ChatGPT is allowed unconditionally. • ChatGPT_and_useless_subject : ChatGPT use if the subject is not aligned with the professional goal – using ChatGPT is allowed provided only pass marks will be given if it is correct, irrespective of answer quality. • ChatGPT_Opposes_Learning : Perceived career constraint from permitted ChatGPT use. • ChatGPT_OR_SE : First-choice help resource when struggling (ChatGPT vs. Search). • ChatGPT_builds_Concept : Sequential chatbot interactions for conceptual understanding are better and comfortable. • ChatGPT_Better_than_SE : Preference for ChatGPT over search for generating learning examples. • ChatGPT_Explicit_learning : ChatGPT is helpful for active learning of something totally new (Suggests reliance on the tool for acquiring new knowledge). • ChatGPT_Enhancement : Need for multimodal representations in ChatGPT (e.g., graphic, video). • ChatGPT_Assignment : Frequency of ChatGPT use for assignments. • ChatGPT_Used_in_New_Learning : ChatGPT usage frequency for new topics. • ChatGPT_Helps_New_Learning : Perceived helpfulness for learning new topics • ChatGPT_Education_Integration : Support for ChatGPT integration in education Ethical Considerations: All data used in this study was anonymized and collected via voluntary online survey. No personal identifiers were included in the dataset. Participants were informed that their