Ethics and Social Responsibility in AI-Assisted Interviewing: An LLM-in-the-Loop Study of AI-Generated Follow-Up Questions Conference: Adjunct Proceedings of the 5th Annual Symposium on Human-Computer Interaction for Work; June 22–25, 2026; Linz, Austria Adjunct Proceedings of the 5th Annual Symposium on Human-Computer Interaction for Work (CHIWORK ’26), June 22–25, 2026, Linz, Austria DOI: 10.1145/3805029.3818282 ISBN: 979-8-4007-2598-2/2026/06 CCS: Human-centered computing Empirical studies in HCI CCS: Human-centered computing Collaborative and social computing CCS: Human-centered computing Interaction design

He Zhang, Yueyan Liu, Xin Guan, Jie Cai, John M. Carroll · 2026

Read Ethics and Social Responsibility in AI-Assisted Interviewing: An LLM-in-the-Loop Study of AI-Generated Follow-Up Questions Conference: Adjunct Proceedings of the 5th Annual Symposium on Human-Computer Interaction for Work; June 22–25, 2026; Linz, Austria Adjunct Proceedings of the 5th Annual Symposium on Human-Computer Interaction for Work (CHIWORK ’26), June 22–25, 2026, Linz, Austria DOI: 10.1145/3805029.3818282 ISBN: 979-8-4007-2598-2/2026/06 CCS: Human-centered computing Empirical studies in HCI CCS: Human-centered computing Collaborative and social computing CCS: Human-centered computing Interaction design by He Zhang, Yueyan Liu, Xin Guan, Jie Cai, John M. Carroll (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30980.txt.

Introduction

He Zhang, Yueyan Liu, Xin Guan, Jie Cai and John M. Carroll study what can go wrong when an AI suggests follow-up questions during research interviews. Interviewing depends on timely, sensitive follow-ups, but workload and unfamiliar topics can limit depth. In a Wizard-of-Oz study, GPT-4o generated follow-ups in real time during live interviews. A human co-interviewer chose which to voice and could edit them first, simulating an assistant while keeping a person in charge. Seventeen interviewers with varied expertise took part.

Five interlocking concerns emerged. Participants worried about harmful or biased wording and harms no one could predict. They worried interviewees would feel disrespected when attention split and body-language cues were missed. They raised unequal access to the technology. They asked who is responsible when harm occurs. And they flagged privacy risks when AI records sensitive talk.

Catalog record

CREATORHe Zhang, Yueyan Liu, Xin Guan, Jie Cai, John M. Carroll
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.30980

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Ethics and Social Responsibility in AI-Assisted Interviewing: An LLM-in-the-Loop Study of AI-Generated Follow-Up Questions Conference: Adjunct Proceedings of the 5th Annual Symposium on Human-Computer Interaction for Work; June 22–25, 2026; Linz, Austria Adjunct Proceedings of the 5th Annual Symposium on Human-Computer Interaction for Work (CHIWORK ’26), June 22–25, 2026, Linz, Austria DOI: 10.1145/3805029.3818282 ISBN: 979-8-4007-2598-2/2026/06 CCS: Human-centered computing Empirical studies in HCI CCS: Human-centered computing Collaborative and social computing CCS: Human-centered computing Interaction design He Zhang, Yueyan Liu, Xin Guan, Jie Cai, John M. Carroll Abstract . Semi-structured interviews rely on timely, context-sensitive follow-up questions, yet interviewers’ cognitive load and limited domain familiarity can constrain probing depth. We report findings from an LLM-in-the-loop Wizard-of-Oz (WoZ) study that simulates an AI follow-up assistant in live interviewing while preserving human oversight. In our setup, a co-interviewer selectively relayed and could edit AI-generated follow-up questions (AGQs) produced in real time by GPT-4o, enabling a realistic approximation of deployment without fully automating the interaction. Across 17 interviewers with varied qualitative-method expertise, participants raised five interlocking concerns: (1) harmful or discriminatory language and unpredictable interaction harms, (2) undermining interviewees’ sense of respect through divided attention and missing nonverbal cues, (3) technology-based participation inequality, (4) unclear responsibility when harms occur, and (5) privacy, disclosure, and compliance risks when AI listens, records, or transcribes sensitive content. We translate these concerns into design and governance implications for safer, more respectful, and more accountable AI-assisted interviewing. Figure 1 . LLM-in-the-loop Wizard-of-Oz study design for AI-assisted qualitative interviewing (study schematic). The lead interviewer conducts a semi-structured interview with an “Oz” interviewee. The Wizard requests 1-3 candidate follow-ups from GPT-4o based on Oz’s response, then selectively voices/edits a follow-up. This simulates an AI follow-up assistant with human oversight. † † cc-license: by 1. Introduction Semi-structured interview is the one of the most common format of data collection and one of the cornerstone of qualitative research, relying on interviewers’ ability to produce timely, context-sensitive follow-up questions that probe emerging themes while sustaining rapport and trust ( 14 ; 7 ; 5 ) . Generating such follow-ups in real time is cognitively demanding and uneven across levels of methodological expertise, particularly under time pressure or when addressing complex and sensitive topics ( 1 ; 2 ; 12 ) . Recent advances in large language models (LLMs) have therefore motivated growing interest in AI-assisted interviewing tools that suggest candidate follow-up questions during live interaction ( 4 ; 9 ; 11 ; 15 ; 17 ) . While prior research has largely examined the utility and perceived helpfulness of AI-generated follow-up questions (AGQs), less attention has been paid to the ethical and social responsibility implications of integrating AI assistance into the moment-by-moment dynamics of interviews. Qualitative interviews are not merely information-extraction procedures; they are social encounters shaped by trust, power relations, respect, and accountability ( 8 ; 6 ) . Introducing AI systems into these interactions, directly or indirectly, may alter how responsibility, agency, and ethical obligations are understood by interviewers and interviewees ( 16 ; 10 ) . This work investigates these issues through an LLM-in-the-loop Wizard-of-Oz (WoZ) study that simulates an AI follow-up assistant with human oversight. A co-interviewer selectively reviews, edits, and voices candidate follow-up questions generated by GPT-4o in real time, approximating realistic deployment while avoiding fully autonomous AI intervention. The operating procedure is shown in Fig. 1 . Drawing on interviewers’ reflections before and after AI involvement was disclosed, we identify five interrelated ethical concerns: language harms and unpredictable interaction risks; erosion of interviewees’ sense of respect and rapport; technology-based participation inequality; ambiguity in responsibility attribution when errors occur; and privacy, disclosure, and compliance risks. Together, these findings foreground AI-assisted interviewing as a socio-technical practice that demands careful ethical design and governance. This study is guided by two research questions: RQ1. How do interviewers perceive the ethical and social responsibility implications of AI-generated follow-up questions in a simulated semi-structured interviewing context? RQ2. What design and governance considerations do interviewers’ reflections suggest for future AI-assisted interviewing tools? 2. Method 2.1. Participants We recruited 17 participants who had prior experience conducting or supporting qualitative research. Participants were recruited through study flyers distributed on social media and peer referrals within HCI and social science research communities. The final sample included 10 women and 7 men, aged 21–35. Participants came from fields including HCI, education, psychology, social work, applied linguistics, human geography, management science, usable privacy and security, and humanities/social sciences. We categorized participants’ qualitative-method experience into three levels. Novice participants had participated in qualitative data collection, especially interviews. Intermediate participants had published one to three peer-reviewed papers or reports based on qualitative methods. Advanced participants had published more than three peer-reviewed qualitative-method papers. Based on this definition, the sample included 10 novice, 5 intermediate, and 2 advanced participants. We recognize that this distribution overrepresents novice and intermediate researchers. We therefore interpret the findings primarily as reflecting how researchers with varied but often early-stage qualitative-method experience reason about AI-assisted interviewing, rather than as a comprehensive account of expert qualitative researchers’ ethical practice. 2.2. Procedure Before starting the study, we asked each participant to provide an interview topic they wished to discuss, along with a general direction for several interview questions, and we fed this information into the LLM as initial context. Each session then involved three roles: (1) a recruited participant acting as the lead interviewer, (2) a researcher acting as the interviewee (“Oz”) to standardize interaction content, and (3) a researcher acting as the co-interviewer (“Wizard”). During each session, the Wizard entered Oz’s most recent response into GPT-4o and requested one to three candidate AI-generated follow-up questions (AGQs), using the prompt: “Please generate follow-up questions based on the participant’s responses: *transcription of the participant’s response content*.” The Wizard then selected whether and when to voice one candidate question. We varied the timing pattern of Wizard follow-ups (e.g., occasional insertion; periodic insertion; clustered insertion) to approximate realistic co-interviewing rhythms. The Wizard was instructed not to introduce new substantive content beyond the AI-generated candidate question. We varied the timing pattern of Wizard follow-ups across three interaction patterns: occasional single follow-ups, periodic follow-ups after one or several participant-led questions, and clustered follow-ups in which two or more AGQs were asked consecutively. Crucially, participants completed a two-stage reflection: they first evaluated the co-interviewer’s follow-ups without being told those follow-ups originated from an LLM; we then disclosed LLM involvement and conducted a second reflection focused on disclosure, trust, ethics, and responsibility. Lastly, because the interviewee (“Oz”) was played by a researcher in this study, the conversational content entered into GPT-4o for AGQ generation consisted of Oz’s responses within the simulated interview rather than personal disclosures from recruited participants. Thus, although participants interacted with AI-generated follow-up questions, we did not submit recruited participants’ personal interview responses or sensitive personal data to the LLM for AGQ generation. All participants provided informed consent before taking part in the study. 2.3. Data and Analysis With participants’ consent, all sessions were audio-recorded and transcribed verbatim. Transcripts and associated materials were anonymized prior to analysis. We conducted an inductive thematic analysis using a consensus-oriented coding process. The dataset contains participants’ reflections on a range of experiences with AI-assisted interviewing. In this work, we deliberately

Read the complete text