Augmented Fine-Tuned LLMs for Enhanced Recruitment Automation
Mohamed T. Younes 1 , Omar Walid 1 , Khaled Shaban 2 , Ali Hamdi 1 , Mai Hassan 1 · 2025
Read Augmented Fine-Tuned LLMs for Enhanced Recruitment Automation by Mohamed T. Younes 1 , Omar Walid 1 , Khaled Shaban 2 , Ali Hamdi 1 , Mai Hassan 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06196.txt.
Introduction
Fine-tuned language models purpose-built for hiring outperform general ones at reading resumes, report Mohamed T. Younes and four co-authors in a 2025 paper. Building on their earlier MLAR tracking system, the team trains models on recruitment data rendered in a standardized JSON format. A synthetic dataset supplies consistency, while resumes parsed by a large DeepSeek model add diversity and realism.
Experiments show clear gains over base models and other leading systems across exact match, F1, BLEU, ROUGE, and similarity scores. The fine-tuned Phi-4 model posts the highest F1, above ninety percent, signaling strong precision and recall. The authors argue such specialization can reshape recruitment workflows and candidate-job matching.
Catalog record
| CREATOR | Mohamed T. Younes 1 , Omar Walid 1 , Khaled Shaban 2 , Ali Hamdi 1 , Mai Hassan 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06196
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Augmented Fine-Tuned LLMs for Enhanced Recruitment Automation Mohamed T. Younes 1 , Omar Walid 1 , Khaled Shaban 2 , Ali Hamdi 1 , Mai Hassan 1 Abstract This paper presents a novel approach to recruitment automation. Large Language Models (LLMs) were fine-tuned to improve accuracy and efficiency. Building upon our previous work on the Multilayer Large Language Model-Based Robotic Process Automation Applicant Tracking (MLAR) system [ 1 ] . This work introduces a novel methodology. Training fine-tuned LLMs specifically tuned for recruitment tasks. The proposed framework addresses the limitations of generic LLMs by creating a synthetic dataset that uses a standardized JSON format. This helps ensure consistency and scalability. In addition to the synthetic data set, the resumes were parsed using DeepSeek, a high-parameter LLM. The resumes were parsed into the same structured JSON format and placed in the training set. This will help improve data diversity and realism. Through experimentation, we demonstrate significant improvements in performance metrics, such as exact match, F1 score, BLEU score, ROUGE score, and overall similarity compared to base models and other state-of-the-art LLMs. In particular, the fine-tuned Phi-4 model achieved the highest F1 score of 90.62%, indicating exceptional precision and recall in recruitment tasks. This study highlights the potential of fine-tuned LLMs. Furthermore, it will revolutionize recruitment workflows by providing more accurate candidate-job matching. Index Terms —Applicant Tracking System (ATS), Robotic Process Automation (RPA), Large Language Models (LLMs), Fine-Tuning. I Introduction The recruitment process is a key company task. This task faces growing challenges. It needs quick review of many applications. The process must keep high selection rules. Today’s hiring world needs better systems. These systems handle hundreds of candidates per job. They provide fair checks of applicant skills. They provide correct checks of applicant skills. Traditional Applicant Tracking Systems (ATS), despite their implementation in most organizations, continue to face limitations in meeting these demands. Their reliance on simplistic keyword matching and manual screening approaches often introduces biases, inconsistencies, and time consumptions, ultimately leading to poor hiring decisions. New advancements in artificial intelligence has changed recruitment workflows a lot. Tools like robotic process automation (RPA) and large language models (LLMs) lead this change. These tools can automate and improve talent acquisition steps. They handle everything from resume screening to full candidate reviews. But many current systems use generic language models (non finetuned LLMS). These models don’t focus on recruitment needs. They often struggle to understand the tricky language in resumes and job descriptions. Resulting in inaccurate information extraction and poor candidate-position matching. The structural complexity and variability of resume formats further worsen these challenges, as most systems struggle to consistently parse relevant information from unstructured documents. Our prior research addressed some of these limitations through the development of MLAR (Multilayer Large Language Model-Based Robotic Process Automation for Applicant Tracking) , a system that demonstrated the potential of combining RPA with LLMs for recruitment automation [ 1 ] . MLAR showed measurable improvements over conventional ATS platforms, particularly in handling diverse resume formats and reducing processing times. However, its dependence on base language models without domain-specific adaptation revealed ongoing issues in correctly understanding technical skills and job experiences tied to hiring needs. This paper presents an advance over our previous work by introducing a novel methodology to fine-tune LLMs specifically for recruitment tasks. Our approach combines several key contributions that address current limitations in the field: 1. Develop a comprehensive training corpus that merges parsed real resume data with generated synthetic examples, all standardized through a strict JSON schema. This hybrid data set ensures both the realism of actual recruitment data and the coverage of edge cases through synthetic generation. 2. Implement specialized fine-tuning of multiple state-of-the-art open-weight LLMs, including LLaMA3.1 8B, Mistral 7B, Phi-4 14B, and Gemma2 9B, using parameter-efficient adaptation techniques. 3. Establish a strong testing system that checks model performance using both standard language metrics and hiring-specific measures. Combined synthetically generated resumes and real-world examples parsed with DeepSeek in a strict JSON format. Fine-tuning of LLaMA3.1 8B, Mistral 7B, Phi-4 14B and Gemma2 9B for recruitment-specific tasks. Comprehensive evaluation using Exact Match (EM), F1 score, BLEU score, ROUGE score and overall similarity. Integration with the MLAR framework to assess real-world impact. [ 1 ] Algorithmic formalization through pseudocode for data set generation, model fine-tuning, and evaluation. This research impacts several aspects of modern recruitment systems. We developed domain-specific language models for recruitment tasks. These models improve the parsing accuracy of candidate qualifications. They also enhance the precision of candidate-job matching. Our solution addresses critical data privacy issues in human resources systems. The standardized JSON output format enables smooth integration with existing HR software frameworks. Additionally, our structured evaluation methodology offers key insights. These insights benefit researchers and professionals implementing AI-driven recruitment solutions. The remainder of this paper is organized as follows: Section II reviews related work on robotic process automation, large language models, and fine-tuning techniques for recruitment automation. Section III outlines the problem formulation, dataset creation, model fine-tuning process, and evaluation metrics used in this study. Section IV describes the experimental design, including the system workflow and benchmarking setup. Section V presents the performance comparison of fine-tuned models against base models, along with key observations. Finally, Section VI concludes the paper with insights on the effectiveness of the proposed approach and potential future research directions. Fig. 1: Flow Diagram, outlining the key steps from data preparation to model evaluation. II Related Work II-A Robotic Process Automation in Recruitment Robotic Process Automation (RPA) has emerged as a powerful tool for automating repetitive tasks in recruitment. These tasks include resume parsing, email management, and workflow coordination. Popular RPA platforms like UiPath and Automation Anywhere provide robust tools for task automation in recruitment. These platforms offer user-friendly interfaces and analytics capabilities but often require significant customization for recruitment-specific tasks. For instance, research by Balasundaram and Venkatagiri [ 2 ] illustrates how structured RPA implementations can streamline HR processes, including recruitment, by automating repetitive workflows. Similarly, Laumer et al. [ 3 ] emphasize the impact of integrating business process management with ATS to enhance recruitment efficiency, highlighting the potential of RPA in this domain. Research has also shown that integrating RPA with AI technologies can significantly enhance recruitment workflows. Studies have demonstrated how RPA combined with AI tools could automate resume parsing and categorization. This automation applies methods like Naive Bayes classifiers and Named Entity Recognition (NER) [ 4 ] . Our prior work introduced the MLAR system , which merges the RPA architecture with LLMs. [ 1 ] It improved resume parsing and reduced processing times. These results show the value of such integrations. However, these advancements often lack deeper contextual understanding, underscoring the need for smarter decision-making abilities in automated systems, which our current work addresses through fine-tuning. Fig. 2: Flow Diagram, outlining the key steps in the creation of the hybrid dataset II-B Large Language Models in Recruitment Recent advancements in Large Language Models (LLMs) have transformed text comprehension and analysis. These advancements have helped enabling more accurate interpretation of unstructured data like resumes and job descriptions. Studies introduced BERT-based frameworks and Gemini LLMs to evaluate resumes and job descriptions, calculating similarity scores to predict candidate suitability. For example, Abdollahnejad et