LLMs for Qualitative Data Analysis Fail on Security-specific Comments in Human Experiments Conference: 34th IEEE/ACM International Conference on Program Comprehension; April 12–13, 2026; Rio de Janeiro, Brazil 34th IEEE/ACM International Conference on Program Comprehension (ICPC ’26), April 12–13, 2026, Rio de Janeiro, Brazil DOI: 10.1145/3794763.3798172 ISBN: 979-8-4007-2482-4/2026/04

Maria Camporese, Fabio Massacci, Yuanjun Gong · 2026

Read LLMs for Qualitative Data Analysis Fail on Security-specific Comments in Human Experiments Conference: 34th IEEE/ACM International Conference on Program Comprehension; April 12–13, 2026; Rio de Janeiro, Brazil 34th IEEE/ACM International Conference on Program Comprehension (ICPC ’26), April 12–13, 2026, Rio de Janeiro, Brazil DOI: 10.1145/3794763.3798172 ISBN: 979-8-4007-2482-4/2026/04 by Maria Camporese, Fabio Massacci, Yuanjun Gong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10834.txt.

Introduction

Camporese, Massacci, and Gong ask whether language models can act as auto labelers for technical security notes in human studies. Theme analysis of reasons is costly, since sound labeling needs several domain experts. Prompting four top models on LiveBench to spot nine security codes in weak code notes, they score outputs against human labelers with Cohen's Kappa. Clear gains appear only with rich code detail. Those gains vary by code and fall short of safely replacing a labeler. The authors urge more studies with more models and labeling tasks.

Catalog record

CREATORMaria Camporese, Fabio Massacci, Yuanjun Gong
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62014
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10834

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLMs for Qualitative Data Analysis Fail on Security-specific Comments in Human Experiments Conference: 34th IEEE/ACM International Conference on Program Comprehension; April 12–13, 2026; Rio de Janeiro, Brazil 34th IEEE/ACM International Conference on Program Comprehension (ICPC ’26), April 12–13, 2026, Rio de Janeiro, Brazil DOI: 10.1145/3794763.3798172 ISBN: 979-8-4007-2482-4/2026/04 Maria Camporese, Fabio Massacci, Yuanjun Gong Abstract . Thematic analysis of free-text justifications in human experiments provides significant qualitative insights. Yet, it is costly because reliable annotations require multiple domain experts. Large language models (LLMs) seem ideal candidates to replace human annotators. [ Problem :] Coding security-specific aspects ( code identifiers mentioned , lines-of-code-mentioned , security keywords mentioned ) may require deeper contextual understanding than sentiment classification. [ Objective :] explore whether LLMs can act as automated annotators for technical security comments by human subjects. [ Method :] We prompt four best LLMs on LiveBench to detect nine security-relevant codes in free-text comments by human subjects analyzing vulnerable code snippets. Outputs are compared to the human annotators along with Cohen’s Kappa (chance-corrected accuracy). We test different prompts mimicking annotation best practices: emerging codes, a detailed codebook with examples, and conflicting examples. [ Negative Results :] We observed marked improvements only with the code descriptions, but they are not uniform across codes and not sufficient to reliably replace a human annotator. [ Limitations :] Additional studies with more LLMs and annotation tasks are needed. LLMs for Qualitative Data Analysis Fail on Security-specific Comments in Human Experiments Authors: Maria Camporese , University of Trento (Italy) Fabio Massacci , University of Trento (Italy), Vrije Universiteit Amsterdam (The Netherlands) Yuanjun Gong , University of Trento (Italy) This work has been partly supported by the European Union (EU) under Horizon Europe grant n . 101120393 (Sec4AI4Sec), by the Nederlandse Organisatie voor Wetenschappelijk Onderzoek (NWO) under grant n. KIC1.VE01.20.004 (HEWSTI), and by the Italian Ministry of University and Research (MUR), under the P.N.R.R. – NextGenerationEU grant n. PE00000014 (SERICS). This paper reflects only the author’s view and the funders are not responsible for any use that may be made of the information contained therein. Cybersecurity for AI-Augmented Systems (Sec4AI4Sec) . As artificial intelligence (AI) becomes omnipresent, even integrated within secure software development, the safety of digital infrastructures requires new technologies and new methodologies, as highlighted in the EU Strategic Plan 2021-2024. To achieve this goal, the EU-funded Sec4AI4Sec project will develop advanced security-by-design testing and assurance techniques tailored for AI-augmented systems. These systems can democratise security expertise, enabling intelligent, automated secure coding and testing while simultaneously lowering development costs and improving software quality. However, they also introduce unique security challenges, particularly concerning fairness and explainability. Sec4AI4Sec is at the forefront of the move to tackle these challenges with a comprehensive approach, embodying the vision of better security for AI and better AI for security. More information at https://sec4ai4sec.eu . Hybrid Explainable Workflows for Security and Threat Intelligence (HEWSTI) In research into threats to safety and security, people and AI collaborate to obtain actionable intelligence. Their sources and methods often have significant uncertainties and biases. Experts are aware of these limitations, but lack the formal means to handle these uncertainties in their daily work. This project will invent a ‘metadata of uncertainty’ for threat intelligence (in both machine-readable and also human-interpretable forms) and validate it empirically. Intelligence agencies will then be able to explicitly consider the trade-off between the accuracy, proportionality, privacy, and cost-effectiveness of investigations. This will contribute towards the responsible use of AI to create a safer, more secure society. In searCh Of eVidence of stEalth cybeR Threats (COVERT) AT 3 aims to analyze emerging attack methodologies and develop advanced methods for detecting attacks and identifying guidelines for designing IT systems that ensure reduced vulnerability to new attack categories. The detailed objectives can be divided into four macro categories: (i) Development of advanced tools for analyzing malware and software aimed at identifying vulnerabilities that could be exploited by malware; (ii) Development of tools for analyzing network traffic to identify communications related to ongoing attacks; (iii) Development of machine learning systems that are robust to attacks and through which it is possible to extract knowledge aimed at creating more advanced tools for timely analysis and early identification of attacks; (iv) Analysis of the "human factors" involved in an attack with the development of tools for analyzing and correlating information from OSINT (open sources intelligence) and for the defense and prevention of attacks based on social engineering techniques. Maria Camporese (MSc 2022) is a PhD student at the University of Trento, Italy. Her research interests include security and machine learning. Contact her at [email protected] . Fabio Massacci (Phd 1997) is a professor at the University of Trento, Italy, and Vrije Universiteit Amsterdam, Fabio Massacci is a professor at the University of Trento, Trento, Italy, and Vrije Universiteit Amsterdam, 1081 HV Amsterdam, The Netherlands. His research interests include empirical methods for the cybersecurity of sociotechnical systems. For his work on security and trust in sociotechnical systems, he received the Ten Year Most Influential Paper Award at the 2015 IEEE International Requirements Engineering Conference. He is named co-author of CVSS v4. He leads the Horizon Europe Sec4AI4Sec project and the Dutch National Project HEWSTI. He is past chair of the Security and Defense Group of the Society for Risk Analysis, and IEEE CertifAIEd Lead Assessor. Contact him at [email protected] . Yuanjun Gong (PhD 2025) is a postdoc researcher at the University of Trento, Italy. Her research interests include static analysis, software security and machine learning. Contact her at [email protected] . How to cite this paper: • Camporese, M., Massacci, F. and Gong, Y. LLMs for Qualitative Data Analysis Fail on Security-specific Comments in Human Experiments. Proceedings of the 2026 IEEE/ACM 34st International Conference on Program Comprehension (ICPC) . IEEE Computer Society. License: • This article is made available with a perpetual, non-exclusive, non-commercial license to distribute. † † cc-license: by 1. Introduction Who has run a software engineering experiment with human subjects and not received a reviewer’s comment “You should manually analyze the participants’ explanations”? The process for doing this qualitative analysis is called Thematic Analysis (TA) ( Dai et al. 2023 ) . TA is a method for identifying, coding, and interpreting patterns of meaning (themes) within qualitative data ( Clarke and Braun 2017 ) . The aim is to distill insight from large volumes of qualitative material to allow for quantitative analysis ( Zhang and Wildemuth 2009 ) . Fragments of textual, audio, or video recordings are annotated with labels called codes . Codes represent the smallest meaningful units, capturing noteworthy aspects of the recorded material. These codes are used for constructing broader themes, i.e. recurring patterns of meaning. To ensure reliable analysis, the same piece of data is assigned to at least one coder and one reviewer. Further, human coders develop and deepen their data interpretation and coding over multiple iterations, making TA labor-intensive and time-consuming. In the realm of empirical software and security engineering, thematic analysis is used in a variety of settings. For example, opinion mining over software repositories’ comments is a popular research area ( Lin et al. 2022 ) . In experiments with humans, qualitative analysis is used to validate the rationale behind their choices

Read the complete text