MSLEF: Multi-Segment LLM Ensemble Finetuning in Recruitment
Omar Walid 1 , Mohamed T. Younes 1 , Khaled Shaban 2 , Mai Hassan 1 , Ali Hamdi 1 · 2025
Read MSLEF: Multi-Segment LLM Ensemble Finetuning in Recruitment by Omar Walid 1 , Mohamed T. Younes 1 , Khaled Shaban 2 , Mai Hassan 1 , Ali Hamdi 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06200.txt.
Introduction
Parsing a resume segment by segment with a team of fine-tuned models is the design of MSLEF, a 2025 framework from Omar Walid and four co-authors. Single models stumble over the varied formats real resumes use. MSLEF instead assigns each model a resume segment, weights votes by field, and lets a strong model aggregate the hardest sections.
The ensemble combines three open models of different sizes with a Gemini model as aggregator, building on the team's earlier MLAR system. Across exact match, F1, BLEU, ROUGE, and a recruitment similarity metric, MSLEF beats the best single model, by up to about seven percent on similarity. The authors pitch segment awareness as the key to generalizing across real hiring layouts.
Catalog record
| CREATOR | Omar Walid 1 , Mohamed T. Younes 1 , Khaled Shaban 2 , Mai Hassan 1 , Ali Hamdi 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06200
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MSLEF: Multi-Segment LLM Ensemble Finetuning in Recruitment Omar Walid 1 , Mohamed T. Younes 1 , Khaled Shaban 2 , Mai Hassan 1 , Ali Hamdi 1 Abstract This paper presents MSLEF, a multi-segment ensemble framework that employs LLM fine-tuning to enhance resume parsing in recruitment automation. It integrates fine-tuned Large Language Models (LLMs) using weighted voting, with each model specializing in a specific resume segment to boost accuracy. Building on MLAR [ 1 ] , MSLEF introduces a segment-aware architecture that leverages field-specific weighting tailored to each resume part, effectively overcoming the limitations of single-model systems by adapting to diverse formats and structures. The framework incorporates Gemini-2.5-Flash LLM as a high-level aggregator for complex sections and utilizes Gemma 9B, LLaMA 3.1 8B, and Phi-4 14B. MSLEF achieves significant improvements in Exact Match (EM), F1 score, BLEU, ROUGE, and Recruitment Similarity (RS) metrics, outperforming the best single model by up to +7% in RS. Its segment-aware design enhances generalization across varied resume layouts, making it highly adaptable to real-world hiring scenarios while ensuring precise and reliable candidate representation. Keywords : Large Language Models, Recruitment Automation, Ensemble Learning, Resume Parsing, Applicant Tracking Systems I Introduction Recruitment automation has transformed hiring by enabling efficient processing of numerous applications, with resume parsing extracting structured data like experience, education, skills, and contact information. Challenges from varied layouts (e.g., plain text to multi-column designs) and complex language lower accuracy and delay candidate matching, especially as some roles attract thousands of resumes [ 2 ] , making manual screening impractical. The impact of poor resume parsing affects employers and applicants alike. Large companies may overlook top talent, leading to longer vacancies, higher costs, and reduced productivity. Strong candidates can be rejected due to confusing formats or wording, exacerbating hiring challenges as skilled worker demand grows. Past methods like rule-based extraction and NER [ 3 ] , and conditional random fields [ 4 ] , suit clean text but struggle with diverse layouts. Improved systems are essential, as poor parsing wastes talent and raises costs [ 5 ] . Biased systems harm fairness by ignoring varied layouts or styles [ 6 ] and pose legal risks. Internationally, recruitment AI is increasingly classified as “high-risk.” Under the EU AI Act (2024), any AI system used for employment, recruitment, or worker management is explicitly designated as a high-risk system requiring strict obligations, including risk management, transparency, human oversight, and robust documentation [ 7 ] . Fig. 1: MSLEF workflow for resume parsing and job matching. Multiple fine-tuned LLMs analyse distinct resume segments and are aggregated via weighted voting with Gemini-LLM for complex hierarchies. To solve these issues, we propose MSLEF, a framework that uses multi-segment LLM ensemble fine-tuning to improve parsing. Each part of the resume, the header, skills, timeline, and free text, is handled by a specific fine-tuned model. MSLEF combines the output with a field-weighted vote. Gemini LLM resolves conflicts in complex sections. It uses Gemma 9B, LLaMA 3.1 8B, and Phi-4 14B as specialised base models. MSLEF scores 92.6% F1, compared to 90.6% for the best single model, Phi-4 14B. This gain cuts residual error by about 21%. Exact match and recruitment-based metrics also improve. Error rates on unusual layouts drop by over one-third. The MSLEF design uses the strengths of the model per segment for better accuracy [ 8 ] . This method helps to handle various formats and complex wording in resumes [ 9 ] . Our contributions are: • A segment-aware, model-agnostic merging architecture that integrates heterogeneous LLMs for flexible resume parsing through multi-segment ensemble finetuning . • A field-specific weighting strategy for consensus voting that adjusts the influence of each model according to its segment proficiency. • A hybrid evaluation suite that combines standard NLP metrics with recruitment-centric criteria, together with an open benchmarking dataset and reproducible test harness. These contributions represent a significant advancement in the field of recruitment automation, offering a more robust and adaptable solution for resume parsing that can handle the complexities of modern job applications [ 10 ] . The practical implications of this work extend to improving the efficiency of hiring and the experience of candidates in diverse industries. The remainder of this paper is organised as follows. Section II surveys related work on LLMs in recruitment and ensemble NLP. Section III outlines our methodology, including task formulation and synthetic dataset creation. Section IV presents the MSLEF Framework, detailing the fine-tuning of the LLMs, ensemble architecture, and evaluation metrics. Section V describes the experimental design, Section VI reports the results and discussion, and Section VII concludes with directions for future research. II Related Work Large Language Models (LLMs) are increasingly used in recruitment tools for resume parsing and job matching. Vagale et al. [ 11 ] proposed ProspectCV, an LLM platform that compares resumes to job posts. It achieved a high level of precision in skill extraction on curated data, but struggled with real-world layout diversity. Abdollahnejad et al. [ 12 ] applied BERT for person–job fit, reporting high accuracy on structured candidate profiles yet showing limitations on mixed or unstructured resumes. Our earlier system, MLAR [ 1 ] , achieved an F1 score of 0.81 and demonstrated the value of robotic process automation in hiring. Chowdhury et al. [ 10 ] surveyed HR automation trends, noting that LLMs improve parsing accuracy compared to traditional methods and emphasizing the need for ensemble strategies. These studies collectively highlight both the promise and limitations of current approaches, motivating MSLEF’s segment-aware ensemble design for diversified resume data. Ensemble methods help NLP systems perform better on varied datasets. They support generalization across formats and tasks. Yu et al. [ 13 ] achieved 13.8% recall and 17.5% nDCG gains in resume-job matching using hypothetical resume embeddings and runner-up hard-negative mining with transformer encoders. They noted overfitting risks in iterative training. We address this with field-specific optimization. Schaudt et al. [ 14 ] combined RPA and AI, improving document classification by 9%. However, they did not use field-specific weights like MSLEF. Our method adjusts model votes based on strength per field, such as skills or education. These works prove that ensembles help in NLP. But none focus on resume parsing with multi-model voting. Other studies in ensemble methods and structured extraction guide MSLEF’s design. Romero et al. [ 15 ] used stacked and voted LLM ensembles for medication and entity extraction. They reached high precision on clinical texts. Their setup mirrors our use of segment-specific models for resumes. Jiang et al. [ 16 ] proposed LLM-Blender, which blends outputs with ranking and generation. This idea supports our weighted voting by field strength. Tekin et al. [ 17 ] created LLM-TOPLA, which improves accuracy through diverse LLMs. MSLEF follows this by mixing different models across resume parts. Furthermore, Layout-aware models like DocLLM [ 18 ] improve document understanding using layout data. These models help with visually rich documents. Their success shows that layout matters in parsing. This supports MSLEF’s focus on structured resume layouts. Iso et al. [ 6 ] studied bias in LLMs for job-resume matching. They stressed fairness in automated hiring. The importance of fairness is underscored by real-world failures, such as Amazon’s abandoned AI tool that was biased against women