Explained, yet misunderstood: How AI Literacy shapes HR Managers’ interpretation of User Interfaces in Recruiting Recommender Systems
Yannick Kalff, Katharina Simbeck · 2025
Read Explained, yet misunderstood: How AI Literacy shapes HR Managers’ interpretation of User Interfaces in Recruiting Recommender Systems by Yannick Kalff, Katharina Simbeck (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-06475.txt.
Introduction
Showing how an AI hiring tool works can make managers trust it more without understanding it better, find Yannick Kalff and Katharina Simbeck in a 2025 study. Recruiting recommenders shape who is called in, so their dashboards add more and more explanations: top features, counterfactuals, and model criteria. The authors ask how a manager's AI literacy changes what those explanations do.
In an online experiment, four hundred ten German HR managers compared plain dashboards with explained ones. Practice dashboards, they note, barely explain at all and keep the AI opaque. They raised felt helpfulness and trust among users with mid or high AI literacy, but not real understanding, and complex explanations could reduce it. Only feature overlays clearly helped high-literacy users, arguing for literacy-matched explanation design and training.
Catalog record
| CREATOR | Yannick Kalff, Katharina Simbeck |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-06475
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Explained, yet misunderstood: How AI Literacy shapes HR Managers’ interpretation of User Interfaces in Recruiting Recommender Systems Yannick Kalff, Katharina Simbeck Abstract AI-based recommender systems increasingly influence recruitment decisions. Thus, transparency and responsible adoption in Human Resource Management (HRM) are critical. This study examines how HR managers’ AI literacy influences their subjective perception and objective understanding of explainable AI (XAI) elements in recruiting recommender dashboards. In an online experiment, 410 German-based HR managers compared baseline dashboards to versions enriched with three XAI styles: important features, counterfactuals, and model criteria. Our results show that the dashboards used in practice do not explain AI results and even keep AI elements opaque. However, while adding XAI features improves subjective perceptions of helpfulness and trust among users with moderate or high AI literacy, it does not increase their objective understanding. It may even reduce accurate understanding, especially with complex explanations. Only overlays of important features significantly aided the interpretations of high-literacy users. Our findings highlight that the benefits of XAI in recruitment depend on users’ AI literacy, emphasizing the need for tailored explanation strategies and targeted literacy training in HRM to ensure fair, transparent, and effective adoption of AI. [orcid=0000-0003-1595-175X, [email protected], url=https://yannickkalff.de, ] *1 1 [orcid=0000-0001-6792-461X, [email protected], url=https://iug.htw-berlin.de, ] 1 keywords AI Literacy ,Explainable AI ,Recommender Systems ,Human Resource Management ,Recruitment ,HR Analytics ,People Analytics † † copyrightyear: 2025 † † copyright: Copyright for this paper by its authors. Use permitted under Creative Commons License Attribution 4.0 International (CC BY 4.0). † † venue: RecSys in HR’25: The 5th Workshop on Recommender Systems for Human Resources, in conjunction with the 19th ACM Conference on Recommender Systems, September 22–26, 2025, Prague, Czech Republic. † † address: HTW Berlin University of Applied Sciences, Treskowallee 8, 10318 Berlin, Germany † † corresp: Corresponding author. † † These authors contributed equally. 1 Introduction Artificial intelligence (AI)-based recommender systems have become widespread in recruitment Zhai et al. 2024 ; Malik et al. 2023 . Recommender systems are software applications that use artificial intelligence techniques to analyze data and provide specific suggestions or predictions to users. AI-based systems typically assist in discovering promising talents for development, identifying the most suitable candidates for a job opening, or assigning the right employees to projects based on their skill sets. In human resource management (HRM), these tools promise to accelerate processes, reduce human bias, and ground decisions in objective data Drage and Mackereth 2022 ; Kelan 2024 . Current trends, such as HR Analytics and People Analytics, integrate AI to offer a broader promise of analytical rigor, predictive opportunities, and prescriptive recommendations for informed decision-making and actions Edwards et al. 2024 , alongside technological modes of control Klöpper and Köhne 2023 . In recruiting, AI recommender systems directly influence decisions about individuals, making them the subject of regulations, such as the EU AI Act European Commission 2021 and the GDPR European Parliament 2016 . Moreover, HR systems have faced severe criticism for fairness issues and biased recommendations Du 2024 ; Fabris et al. 2024 ; Simbeck 2019 ; Köchling et al. 2021 . To mitigate potential biases and, equally important, to make optimal decisions, HR managers must understand the underlying data models and the mechanisms by which individual recommendations are generated. Explainable AI (XAI) techniques aim to make “black-box” models interpretable when they are opaque—due to complexity or proprietary constraints Molnar 2022 ; Bhatt et al. 2020 . XAI methods offer interpretable, context-specific explanations for model decisions Speith 2022 ; Khalili 2023 . In recruitment, these explanations can clarify why a candidate’s application is ranked highly or why specific competencies are flagged during the CV parsing process. This transparency is essential for HR managers who often have non‐technical backgrounds and are responsible for legally and ethically sound decisions that comply with anti‐discrimination laws. At the same time, from a human resources management perspective, their decisions must be economically sensible and strategically appropriate for the company. A lack of transparency in AI elements or data, combined with unrecognized distortions, can lead users to incorrect conclusions. The issue is amplified by providers and developers, as transparency and explanations of AI interfaces remain the exception in practice. Lacking transparency often seems to be a deliberate UI design decision (three exemplary dashboards can be found in the appendix Figure 4 – 6 ). However, attaching explanation widgets to a recruitment dashboard does not guarantee impact. For XAI to be effective, HR managers must decode and critically evaluate the provided information Bauer et al. 2023 . We contend that AI literacy—a combination of knowledge, skills, and attitudes that enables individuals to understand and assess AI systems Laupichler et al. 2023 ; Carolus et al. 2023 —directly affects both the subjective and objective effectiveness of XAI. Subjectively, AI literacy influences how helpful, trustworthy, and accessible explanations appear. Objectively, it affects accurate factual understanding that HR managers present when they interpret and act on the information provided by AI dashboards. To investigate this effect, we conducted an experiment with 410 German-based HR managers, who compared a baseline AI dashboard with versions enriched by three explanation styles: important features (a simplified feature importance approach), counterfactual explanations, and global model criteria summaries Guidotti et al. 2019 ; Bodria et al. 2023 . Drawing on a genuine recruitment ranking tool that exists on the market, we measured participants’ perceived trust, usability, and assessment quality for each existing dashboard variant. Further, the participants assessed statements on the dashboards with correct or false answer possibilities. We address two guiding research questions: RQ1 How do HR managers’ subjective perceptions of a recruiting recommender system change when adding explainable AI elements, and does this effect differ across different levels of AI literacy? RQ2 How does HR managers’ objective understanding of a recruiting recommender system change when adding explainable AI elements, and does this effect differ across different levels of AI literacy? Our results show that higher AI literacy is associated with greater perceived usefulness and transparency of XAI‐enhanced dashboards. Paradoxically, higher AI literacy also corresponds to a lower objective understanding of the user interfaces. These findings suggest that the benefits of XAI depend critically on users’ AI literacy levels, though self-assessed AI literacy may be prone to overconfidence. The article is structured as follows: First, we review the literature on AI literacy and XAI, with a focus on their intersection in recruitment contexts ( 2 ). Next, we present our methodological approach ( 3 ) and empirical findings ( 4 ). We discuss the theoretical and practical implications for responsibly embedding explainable recommender systems in HRM that arise from AI literacy and its impact on subjective perception and objective understanding ( 5 ). We conclude with an outlook on future research topics that can be derived from our findings ( 6 ). 2 State of Research The scholarly discourses on AI literacy and explainable AI (XAI) have so far evolved independently (with few exceptions Bhat and Long 2024 ). AI literacy research emphasizes the competencies required to comprehend, evaluate, and interact with AI‐enabled tools Lintner 2024 . Several authors have developed scales to assess individuals’ abilities to recognize, understand, apply, and critically or ethically evaluate AI systems Laupichler et al. 2023 ; Carolus et al. 2023 ;