Humble AI in the real-world: the case of algorithmic hiring DOI: XXXXXXX.XXXXXXX Conference: Symposium on Human-Computer Interaction for Work; June 23–25, 2025; Amsterdam, Netherlands ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems CCS: Computing methodologies Uncertainty

Rahul Nair, Inge Vejsbjerg, Elizabeth Daly, Christos Varytimidis, Bran Knowles · 2025

Read Humble AI in the real-world: the case of algorithmic hiring DOI: XXXXXXX.XXXXXXX Conference: Symposium on Human-Computer Interaction for Work; June 23–25, 2025; Amsterdam, Netherlands ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems CCS: Computing methodologies Uncertainty by Rahul Nair, Inge Vejsbjerg, Elizabeth Daly, Christos Varytimidis, Bran Knowles (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20918.txt.

Introduction

Rahul Nair and co-authors test, in a 2025 paper, what a shy AI looks like in real hire work. Humble AI, from Knowles and others, asks for doubt of its own stats, a nose for shocks, and care for worth past score. Their field is job match: a wide-used stage pairs folk to posts by rank. Rank can slight odd paths in ways fair tests miss. The team shows the three rules can be built: doubt grades on ranks, spread reads, and a face that shows what the tool does not know. First talks with hire pros read how that face lands.

More load on the mind may build trust, the team holds. User tests come next to weigh that claim.

Catalog record

CREATORRahul Nair, Inge Vejsbjerg, Elizabeth Daly, Christos Varytimidis, Bran Knowles
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20918

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Humble AI in the real-world: the case of algorithmic hiring DOI: XXXXXXX.XXXXXXX Conference: Symposium on Human-Computer Interaction for Work; June 23–25, 2025; Amsterdam, Netherlands ISBN: 978-1-4503-XXXX-X/18/06 CCS: Information systems Recommender systems CCS: Computing methodologies Uncertainty quantification Rahul Nair, Inge Vejsbjerg, Elizabeth Daly, Christos Varytimidis, Bran Knowles Abstract . Humble AI (Knowles et al., 2023) argues for cautiousness in AI development and deployments through scepticism (accounting for limitations of statistical learning), curiosity (accounting for unexpected outcomes), and commitment (accounting for multifaceted values beyond performance). We present a real-world case study for humble AI in the domain of algorithmic hiring. Specifically, we evaluate virtual screening algorithms in a widely used hiring platform that matches candidates to job openings. There are several challenges in misrecognition and stereotyping in such contexts that are difficult to assess through standard fairness and trust frameworks; e.g., someone with a non-traditional background is less likely to rank highly. We demonstrate technical feasibility of how humble AI principles can be translated to practice through uncertainty quantification of ranks, entropy estimates, and a user experience that highlights algorithmic unknowns. We describe preliminary discussions with focus groups made up of recruiters. Future user studies seek to evaluate whether the higher cognitive load of a humble AI system fosters a climate of trust in its outcomes. 1. Introduction Our first interaction with work is through the hiring process. Firms solicit applications from candidates for a job opening by putting out an advertisement. Recruiters then screen applications for suitability for the role. Shortlisted candidates are then interviewed and a final selection made. While specific details may vary from firm to firm, these are generally the multiple steps involved in the hiring pipeline. Increasingly, firms are turning to algorithmic tools for these tasks. Dedicated human resource (HR) platforms are used for managing job requisitions, candidate pools, résumé parsing, and a wide range of activities that would typically be conducted by human recruiters. There are over 250 AI tools for various HR functions ( Forum 2021 ) . This proliferation of automation tools brings with it serious challenges related to bias. Labour markets are rife with structural inequities ( Bertrand and Mullainathan 2004 ) related to race, gender, age and other candidate characteristics. There is growing recognition that AI automation can amplify and scale up these biases (see ( Fabris et al. 2024 ) for a recent survey on fairness challenges in hiring). The prime example of such cases in practice is the machine learning recruiting tool used by Amazon that discriminated against women ( Reuters 2018 ) . Even without algorithms, making good hiring decisions is a difficult proposition. “Hiring is about probabilities” ( Sink 2006 ) where information signals about candidates serve as proxies for how well they are likely to do in the future. These signals can be misleading. Candidates that are good on paper can turn out to be poor fit for the role, and conversely those with less impressive credentials turn out to be stellar. Taken together, the increasing use of AI automation to assist with tasks that are subjective and difficult for humans within the hiring process brings a risk of amplifying bias, and motivates reconsideration about how such systems ought to be designed and developed. Humble AI principles were designed to foster trust in AI by reducing harm to individuals who are passed over for opportunities due to an inability of the model to recognize their eligibility. (a) Low uncertainty regime where AI system is less uncertain on candidate rankings (b) High uncertainty regime where AI system has high uncertainty Figure 1 . Rank sets for two prototypical scenarios Image describing the concept of ranksets for two cases. Left shows rank sets with low uncertainty, and right image shows rank sets with high uncertainty. In this work, we explore the principles of Humble AI ( Knowles et al. 2023 ) in this hiring context and see how these can be applied in practical settings. Humble AI argues for cautiousness in AI deployments through three principles. The first is scepticism in model predictions as they are inherently uncertain and being “open to the possibility of being wrong”. The second principle is curiosity by exploring what-if scenarios, if alternative decisions to those made by an AI system were considered. The last principle is commitment to a value system that goes beyond model performance and considers broader processes that foster trust. Specifically, we focus on one step of the hiring pipeline, candidate screening. Given a job description and a (large) pool of candidates, the screening step seeks to determine a ranking of the candidates based on suitability for that specific position. This is typically accomplished using a recommendation system or a machine learning model that predicts scores for each candidate that indicate hiring potential. The top ranked candidate is adjudged to be the best suited for the job. The top- k candidates are moved on further through the hiring pipeline. We operationalize Humble AI principles with uncertainty and entropy quantification procedures and design a user experience that exposes AI uncertainty and confidence to end users. Since screening is effectively a ranking problem, our primary innovation here is around the use of rank sets , a generalisation of ranking candidates. Instead of a fixed ranking, a rank set denotes a set of possible ranks a candidate can take along with an associated probability for each rank. Figure 1 shows prototypical examples of when AI system estimates of candidate rankings are less or more uncertain. Considering probability of ranking allows us to compute uncertainty of an AI system for specific candidates. An additional measure of entropy (see the Section 2 for more details) further quantifies candidates for which the AI system’s decisions are less reliable. Candidates with high rank entropy may need additional manual reviews. We demonstrate key ideas on a widely used real-world HR platform 1 1 1 <anonymised> that performs virtual screening. Using actual job specifications and anonymised candidate profiles. Additionally, we report on synthetic data experiments where the true ranking is known. In the presence of noise, we demonstrate that accounting for uncertainty improves the rate at which the true rankings can be recovered. Preliminary feedback from a focus group of recruiters and HR specialists highlight gaps in our designs and challenges in the user experience. As contributions, we operationalise principles of Humble AI in a practical real-world setting. Using the idea of rank sets, we demonstrate how uncertainty and entropy measures capture key elements of model ignorance. We propose methods to compute rank sets in black box settings where AI system access is only available for inference, and lastly we report on preliminary focus group discussions with recruiters on our envisioned user experience. 2. Methods Given a set of n candidates \mathcal{X}=\{x_{1},x_{2},\ldots,x_{n}\} for a specific job y and a scoring function f_{y}:\mathcal{X}\rightarrow\mathbb{R} , the basic screening task seeks a permutation \sigma that orders the n candidates based on the scores in descending order, i.e. f_{y}(x_{\sigma(1)})\geq f_{y}(x_{\sigma(2)})\geq\dots\geq f_{y}(x_{\sigma(n)}) . We assume that higher scores are more desirable and indicate greater relevance of a candidate for a job. Additionally, the scoring function is assumed to be available in a black-box manner. In other words, the AI system can be only used

Read the complete text