Enhancing Admission Inquiry Responses with Fine-Tuned Models and Retrieval-Augmented Generation
2026
Read Enhancing Admission Inquiry Responses with Fine-Tuned Models and Retrieval-Augmented Generation (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04206.txt.
Introduction
Aram Virabyan, writing alone, builds an AI helper for university admissions offices swamped by applicant questions. Slow or wrong answers shape how future students judge a school. Virabyan joins a fine-tuned language model with retrieval-augmented generation, which fetches facts from a document store at answer time.
Retrieval alone can stumble in a narrow, rule-heavy field like admissions, where fine detail matters. Fine-tuning on a curated admissions data set teaches the model to read fetched facts correctly and answer in domain terms. The hybrid thus pairs fresh information with built-in grasp of local rules. Virabyan also tunes the generation settings to balance quality against speed. The aim is steady, accurate replies that meet the specific demands of admissions communication at high volume.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-04206
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enhancing Admission Inquiry Responses with Fine-Tuned Models and Retrieval-Augmented Generation Abstract University admissions offices face the significant challenge of managing high volumes of inquiries efficiently while maintaining response quality, which critically impacts prospective students’ perceptions. This paper addresses the issues of response time and information accuracy by proposing an AI system integrating a fine-tuned language model with Retrieval-Augmented Generation (RAG). While RAG effectively retrieves relevant information from large datasets, its performance in narrow, complex domains like university admissions can be limited without adaptation, potentially leading to contextually inadequate responses due to the intricate rules and specific details involved. To overcome this, we fine-tuned the model on a curated dataset specific to admissions processes, enhancing its ability to interpret RAG-provided data accurately and generate domain-relevant outputs. This hybrid approach leverages RAG’s ability to access up-to-date information and fine-tuning’s capacity to embed nuanced domain understanding. We further explored optimization strategies for the response generation logic, experimenting with settings to balance response quality and speed, aiming for consistently high-quality outputs that meet the specific requirements of admissions communications. Virabyan Aram 1 Introduction University admissions offices receive a vast number of inquiries from applicants daily. The quality of responses to these inquiries plays a key role in forming the first impression of the university. Responses from the admissions office are often the first interaction of a prospective student with the university. According to research [ 1 ] , customer satisfaction directly affects retention, word-of-mouth, and switching intentions. Therefore, it is essential that each response be of the highest quality and professionalism. This task is challenging initially and becomes increasingly difficult as inquiry volume grows, often forcing staff to rush and dedicate less time per response. Over the past couple of years, due to the explosion of generative artificial intelligence, more and more use cases are leaning towards large language models (LLMs). Large language models can potentially generate draft responses that admissions staff can review, edit if necessary, and send the response. While simpler rule-based chat bots and similar systems have seen application in educational contexts, they typically lack the flexibility and deep natural language understanding necessary to handle the diverse and complex inquiries common to university admissions offices. This challenge is particularly pronounced in environments like Russia, where admission rules are intricate, heavily regulated by the government, and filled with nuances that often overwhelm basic systems. Our approach, leveraging recent advancements in LLMs through the combination of retrieval-augmented generation and fine-tuning, offers a substantially more robust and scalable solution compared to these earlier methods or reliance on basic prompt engineering alone. During the admission campaign, the admissions office of the Higher School of Economics in Russia receives a large volume of inquiries - more than 2,000 per day. This volume often exceeds the capacity of the staff, resulting in a significant increase in response time. Therefore, the time available for each response is shortened, which can prevent staff from providing comprehensive and detailed answers, potentially hindering their ability to fully demonstrate institutional interest in the applicant. Large language models can help admissions offices improve the quality of responses to applicants through automation. However, a limitation of mass language models from providers such as ChatGPT, Yandex GPT, GigaChat, and others is that they are not specifically trained on university admissions policies. Consequently, these models lack a comprehensive understanding of university admissions procedures and policies characteristic of experienced admissions staff. For the model to generate high-quality responses, it must develop knowledge and analytical capabilities related to university admissions campaigns. To embed domain-specific knowledge and develop analytical skills in the context of university admissions, we propose a hybrid approach combining Retrieval-Augmented Generation (RAG) with Large Language Model (LLM) fine-tuning. While many studies show that fine-tuning alone is not sufficient for effective knowledge adoption - for example, a [ 2 ] study concludes that RAG outperforms unsupervised fine-tuning in knowledge-related tasks - RAG has a limitation. In general, RAG functions as a search engine, and its performance can be highly dependent on the specific wording of user queries. This dependency can sometimes lead to suboptimal information retrieval. 2 Related Work And Theoretical Background 2.1 Retrieval-Augmented Generation (RAG) In the context of university admissions, RAG has the potential to significantly improve response accuracy. As admissions-related inquiries are highly specific and varied, relying solely on pre-trained models can lead to vague, generalized, or even misleading responses (e.g., confusing information between universities). RAG’s ability to fetch domain-specific documents, such as admissions rules, educational program catalogs, and other relevant documents and data such as specific deadlines, enables the system to generate highly tailored responses. Given the complexity and variability of the admissions process, where details such as application deadlines, program prerequisites, and eligibility criteria are key, RAG becomes particularly effective. By drawing from these specialized documents, the model can generate answers that are not generic, but instead directly relevant to the specific needs of prospective students or applicants. This is a significant advantage in environments where precision and correctness are paramount. A recent study [ 3 ] has indicated that Retrieval-Augmented Generation (RAG) has emerged as a promising paradigm to address the aforementioned challenges. Specifically, RAG introduces an information retrieval process, which has been found to enhance the generation process by retrieving relevant information/documents from available data stores. This, in turn, has led to higher accuracy and greater robustness. While various RAG implementations exist, in general, RAG functions by retrieving relevant documents from external knowledge bases, providing accurate, real-time, domain-specific context to LLMs [ 4 ] . 2.2 Fine-Tuning in AI Models Fine-tuning has become a fundamental technique in the optimization of AI models, particularly when applying general-purpose models to domain-specific tasks. At its core, fine-tuning involves taking a pre-trained model, which has learned general patterns from large datasets, and further training it on a smaller, domain-specific dataset. Recent research [ 6 ] implies that additional training allows the model to adapt its knowledge to better handle specialized terminology, nuances, and context relevant to the specific domain, improving its performance in tasks such as generating responses to admissions inquiries. Fine-tuning is particularly beneficial in situations where a model’s pre-existing knowledge, obtained from a broad and general dataset, may not be sufficient to understand the intricacies of specialized areas. For example, in the context of university admissions, the model must understand complex terminology and procedures. These terms may not be sufficiently represented in general corpora, but they are essential for accurate and relevant responses in an admissions context. Through fine-tuning, the model can be retrained to focus on this specialized vocabulary, improving its ability to generate precise and contextually appropriate answers. Research has shown that fine-tuning can lead to substantial improvements in both accuracy and relevance. For instance, Radford et al. [ 7 ] demonstrated that fine-tuning GPT models on specialized data significantly enhanced their ability to generate relevant, domain-specific text. Similarly, studies in the medical and legal fields have shown that fine-tuned models outperform generic models in understanding and responding to specialized queries [ 2 ] . The improvements observed in these domains are directly applicable to the university admissions process, where accurate, timely, and contextually aware responses are essential. Moreover, fine-tuning is often an iterative process. It requires careful selection of