Modular AI-Powered Interviewer with Dynamic Question Generation and Expertise Profiling

Aisvarya Adeseye, Jouni Isoaho, Seppo Virtanen, Mohammad Tahir · 2026

Read Modular AI-Powered Interviewer with Dynamic Question Generation and Expertise Profiling by Aisvarya Adeseye, Jouni Isoaho, Seppo Virtanen, Mohammad Tahir (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-11534.txt.

Introduction

Aisvarya Adeseye, Jouni Isoaho, Seppo Virtanen, and Mohammad Tahir build a modular AI interviewer. Their 2026 preprint adds dynamic question generation and expertise profiling. Automated interviewers are common in research, hiring, and education. Most run on fixed question lists and strict rules.

Fixed scripts make talks repeat and feel flat to users. Low engagement then hurts the data the talks collect. Complex qualitative research needs far more than scripts. It needs flexibility, context awareness, and ethical care. The team's system generates questions on the fly. It also profiles the expertise of the person interviewed. Modules can be swapped to fit new domains or goals.

Catalog record

CREATORAisvarya Adeseye, Jouni Isoaho, Seppo Virtanen, Mohammad Tahir
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-11534

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Modular AI-Powered Interviewer with Dynamic Question Generation and Expertise Profiling Aisvarya Adeseye, Jouni Isoaho, Seppo Virtanen, Mohammad Tahir Abstract Automated interviewers and chatbots are common in research, recruitment, customer service, and education. Many existing systems use fixed question lists, strict rules, and limited personalization, leading to repeated conversations that cause low engagement. Therefore, these tools are not effective for complex qualitative research, which requires flexibility, context awareness, and ethical sensitivity. Consequently, there is a need for a more adaptive and context-aware interviewing system. To address this, an AI-powered interviewer that dynamically generates questions that are contextually appropriate and expertise aligned is presented in this study. The interviewer is built on a locally hosted large language model (LLM) that generates coherent dialogue while preserving data privacy. The interviewer profiles the participants’ expertise in real time to generate knowledge-appropriate questions, well-articulated responses, and smooth transition messages similar to human-like interviews. To implement these functionalities, a modular prompt engineering pipeline was designed to ensure that the interview conversation remains scalable, adaptive, and semantically rich. To evaluate the AI-powered interviewer, it was tested with various participants, and it achieved high satisfaction (mean 4.45) and engagement (mean 4.33). The proposed interviewer is a scalable, privacy-conscious solution that advances AI-assisted qualitative data collection. 1 Introduction Artificial Intelligence (AI) plays a vital role in improving human–machine interaction in domains such as customer service, education, recruitment, and research. Chatbots [ 1 ] like like Replika [ 3 ] , Mitsuku [ 4 ] , and automated interviewers [ 2 ] are tools that help make interaction consistent, reducing human workload. Chatbots use predefined rules or intent recognition to handle simple and routine questions. They have limited flexibility, hence, they are not adaptive to the expertise level of the user. Contrariwise, automated interviewers such as HireVue [ 5 ] and Tengai [ 6 ] are early efforts to achieve automated interviews. They are designed to handle structured or semi-structured interactions in recruitment, research, or evaluation. However, they mostly rely on traditional Natural Language Processing (NLP) techniques, which limit their capacity to generate adaptive and contextually relevant follow-up questions. Although chatbots and automated interviewers are broadly adopted, they generally suffer from poor personalization, inflexible scripts that make dialogues repetitive. In the last few years, large language models (LLMs) like GPT, LLaMA, Gemini, and DeepSeek have emerged, enabling dynamic question generation, adaptive follow-ups in conversational dialogue without the need for hard-coded templates. However, LLM models have their own challenges, such as producing irrelevant information, hallucinations, and redundant responses. To mitigate these, effective prompt designs are needed to ensure that the model produces clear, accurate, and relevant responses. Furthermore, a structured prompt design and appropriate performance evaluation are two important aspects to ensure that LLM-based interviews stay context-aware and reliable. Consequently, this study aims to design and analyze the performance of an adaptive conversational AI-powered interviewer that generates contextually relevant and non-repetitive interview questions. Additionally, it evaluates how well the system maintains coherent and user-appropriate dialogue flow with participants of diverse knowledge, experience, and expertise levels. Hence, this study focuses on two main research questions (RQs): • RQ1- How effectively does an AI-powered interviewer generate a coherent flow of contextually appropriate, expertise-aligned questions across interview sessions through prompt-driven logic? • RQ2- What are the performance, adaptability, and overall user experience of an AI-powered interviewer? This research provides two key contributions which are (1) a modular, prompt-driven AI-powered interviewer that dynamically adjusts question complexity in real time based on the user’s expertise level, and (2) a structured framework for generating contextually relevant, non-redundant, and semantically coherent interview dialogues using locally hosted LLMs. 2 Background Study Existing Approaches in Chatbots and Automated Interviewers Chatbots and automated interviewers are two different tools widely used for conversational interaction between human and machine [ 1 ] . Chatbots are designed to do routine tasks, and are often used for answering frequently asked questions, scheduling appointments, and giving scripted customer support [ 7 ] . Examples such as Replika [ 3 ] and Mitsuku [ 4 ] use rule-based logic or intent classifiers to respond. Their ability to personalize conversations or to ask nuanced follow-up questions is limited because of their static designs. However, automated interviewers are more suited and generally used for structured interactions, such as candidate screening, academic interviews, and qualitative research [ 8 ] . Systems such as HireVue [ 5 ] and Tengai [ 6 ] attempt to make interviews like real conversations. But they have limitations such as asking repeated questions, not being able to understand conversations well, and a lack of adaptability to different scenarios due to rigid question structure or limited NLP capabilities. The AI-powered interviewer proposed in this study addresses these limitations by integrating local LLMs to dynamically generate context-aware and expertise-aligned interviews. Intelligent Interview Technologies NLP is a widely used technique in the development of conversational agents [ 9 ] . Basic interactions in earlier systems used template-based generation, part-of-speech tagging, and entity recognition [ 10 ] . However, due to the evolution of NLP techniques, methods such as topic modeling, semantic similarity scoring, and sequence-to-sequence models were introduced to improve the conversational flow and thematic relevance [ 11 ] . Also, some interview bots incorporate domain-specific ontologies or knowledge graphs to ensure question consistency within technical fields [ 12 ] . However, these systems have limited scalability because they heavily depend on manually designed dialogue flows, which limit their responsiveness to unexpected user inputs. The popularity of LLMs has improved conversational dialogue. Models like GPT-4, LLaMA, and Gemini can generate human-like but coherent conversation that adapts to the user’s domain, tone, or expertise level without needing predefined templates [ 13 ] . Despite these benefits, cloud-based commercial LLMs cannot be used to process sensitive information due to privacy and regulatory compliance. Examples include ChatGPT and Gemini. Consequently, there is growing interest in deploying LLMs locally in institutional or personal infrastructure, which guarantees data privacy, the blocking of third-party access, and maintains ethical considerations in data-sensitive research and operations. The Role of Prompt Engineering in Local LLM Local LLMs are highly sensitive to prompt structure unlike commercial models that use a wide range of reinforcement training and server-side optimization to improve output accuracy and quality. Without these techniques, prompt engineering is critical to extract reliable outputs from local models. When using local language models, prompt engineering is very important because they do not have the extensive fallback mechanisms as commercial models [ 15 ] . To get effective results, local models need clear and well-structured prompts. If the prompts are poorly designed, the model may produce confusing or irrelevant outputs. In worst cases, it may lead to hallucination, contradictions, or a break in the conversational flow. There are two main types of prompts that control how an LLM behaves [ 19 ] . System prompts define the model behavior during the entire session [ 16 ] . For example, a system prompt might instruct the model to provide responses according to the user’s preferences. User prompts are specific inputs given during interaction, such as responses from the user or situational data [ 17 ] . They assist the model in deciding what to ask next (follow-up questions) or summarize

Read the complete text