Development and validation of a questionnaire measuring healthcare professionals’ individual perceptions of advanced practice nurses’ contributions to team functioning: a modified international Delphi approach Authors: Tim Hubo, Karolien D'Hollander, Lise-Marie Kinnaer, Pauline Boeckxstaens, Elsie Decoene, Kelley Kilpatrick, Ann Van Hecke Published: 2026 ABSTRACT ObjectiveTo develop, and to face and content validate a questionnaire that measures healthcare professionals' individual perceptions of advanced practice nurses' contributions to team functioning.DesignA three-phase approach including a rapid review, a two-round modified international Delphi procedure, and cognitive interviews.MethodsA questionnaire was derived from a rapid review of international literature and grey literature. Face and content validity were assessed through a two-round modified Delphi procedure involving international experts from various professional backgrounds (advanced practice nurses, healthcare professionals, managers, and academics) and healthcare settings (primary care, hospital care, mental healthcare, and long-term residential care). Seven healthcare professionals participated in cognitive interviews to test the questionnaire's clarity and comprehensibility.ResultsInitially, the questionnaire consisted of 102 outcomes organised into 14 domains. Two Delphi rounds with 27 and 23 experts respectively led to refinement, merging, or removal of outcomes based on item-level content validity indices, comprehensibility scores, and qualitative feedback. Cognitive interviews led to further rephrasing of unclear outcomes. The final questionnaire comprises 67 outcomes across 11 domains: innovation and quality culture, support and application of evidence-based practice, healthcare team capacity building, advanced practice nurse role clarity, acceptance and satisfaction, healthcare team members' perception of their own professional role, workload and job satisfaction, communication policy, clinical decision-making, problem-solving and conflict management, continuity of care, and collaborative practice and sense of belonging.ConclusionsThis study developed and content validated the first comprehensive questionnaire to measure healthcare professionals' individual perceptions of advanced practice nurses' contributions to team functioning across diverse healthcare settings. The questionnaire is suitable for use by professionals working in teams with advanced practice nurses across diverse care settings. What is already known •Advanced practice nurses can influence team functioning.•Current impact research mainly focuses on patient outcomes.•No validated outcome questionnaire to assess the impact of advanced practice nurses on teams exists. What this paper adds •The first content and face validated questionnaire measuring perceived impact of advanced practice nurses on teams across diverse healthcare settings.•The questionnaire captures the diverse roles of advanced practice nurse. Alt-text: Unlabelled box dummy alt text What is already known •Advanced practice nurses can influence team functioning.•Current impact research mainly focuses on patient outcomes.•No validated outcome questionnaire to assess the impact of advanced practice nurses on teams exists. •Advanced practice nurses can influence team functioning. Advanced practice nurses can influence team functioning. •Current impact research mainly focuses on patient outcomes. Current impact research mainly focuses on patient outcomes. •No validated outcome questionnaire to assess the impact of advanced practice nurses on teams exists. No validated outcome questionnaire to assess the impact of advanced practice nurses on teams exists. What this paper adds •The first content and face validated questionnaire measuring perceived impact of advanced practice nurses on teams across diverse healthcare settings.•The questionnaire captures the diverse roles of advanced practice nurse. •The first content and face validated questionnaire measuring perceived impact of advanced practice nurses on teams across diverse healthcare settings. The first content and face validated questionnaire measuring perceived impact of advanced practice nurses on teams across diverse healthcare settings. •The questionnaire captures the diverse roles of advanced practice nurse. The questionnaire captures the diverse roles of advanced practice nurse. Alt-text: Unlabelled box dummy alt text Background Globally, healthcare systems face rising prevalence of chronic diseases, multimorbidity, growing care complexity, and workforce shortages, necessitating innovative care models (Brownwood and Lafortune, 2024; Laurant et al., 2018; Scheffler and Arnold, 2018). Simultaneously, these systems are confronted with emerging technological innovations and rapidly expanding scientific research that informs evidence-informed care (Van Hecke et al., 2024). In response, authoritative bodies such as the National Academies and the World Health Professional Alliance have advocated for enhanced interprofessional collaboration (National Academies of Sciences, Engineering, and Medicine, 2021; World Health Professions Alliance, 2025). Within this transforming landscape, advanced practice nurses are positioned to play a pivotal role in addressing these challenges (Brownwood and Lafortune, 2024; Goldsberry, 2018; International Council of Nurses, 2020; Ranchal et al., 2015). The International Council of Nurses defines an advanced practice nurse as ‘a registered nurse who has acquired, through additional education, the expert knowledge base, complex decision-making skills and clinical competencies for expanded nursing practice, the characteristics of which are shaped by the context in which they are credentialed to practice. The minimum required entry level is a master’s degree’ (International Council of Nurses, 2020). The two most common types internationally are the clinical nurse specialist and the nurse practitioner. Advanced practice nurse roles are predominantly implemented in high-income countries. In some countries (for example, Australia, Canada, the Netherlands, the United Kingdom, the United States) these roles are well-established, while in others (for example, Austria, France, Germany, Switzerland) development is still evolving (Bryant-Lukosius et al., 2016, 2017; Maier et al., 2017). Little is reported on how these roles have evolved in low- and middle-income countries (Kilpatrick et al., 2024). In Belgium, scope of practice legislation was expanded in 2025 to authorize advanced practice nurses to autonomously 1) perform routine low-complexity diagnostic and therapeutic activities; 2) prescribe medications, medical tests and blood products; 3) refer patients to other healthcare professionals; 4) issue medical certificates for reimbursement of medications and healthcare services; and 5) make decisions about hospital admission and discharge. Advanced practice nurses can take on these activities for a defined patient group and based on a formal interprofessional collaboration agreement with physicians (Koninklijk besluit van 14 april 2024, 2024). The implementation of advanced practice roles is currently concentrated in hospital settings. Integration in primary care, mental healthcare and rehabilitation remains limited (Van Hecke et al., 2019). Advanced practice nurses demonstrate competencies that exceed those of generalist nurses (International Council of Nurses, 2020). Hamric et al. defined seven core competencies: direct clinical practice, guidance and coaching, consultation, evidence-based practice, leadership, collaboration, and ethical decision-making (Tracy et al., 2018). Competencies such as guidance and coaching of other team members, stimulating evidence-based practices, leadership and collaboration can influence team functioning, roles of team members, and collaborative processes (Tracy et al., 2018). Consequently, assessing team-related outcomes is essential for capturing the entirety of the effects advanced practice nurses can exert (Kilpatrick et al., 2024; Tracy et al., 2018). Similarly, the evaluation framework of Bryant-Lukosius et al. (2016) not only highlights the need to assess the impact of the advanced practice nurses at every stage: introduction, implementation, and long-term sustainability. It also states to assess from different perspectives, including patients, healthcare professionals, and policy makers (Bryant-Lukosius et al., 2016). Evaluating advanced practice nurse roles is essential for evidence-informed decisions regarding sustainable implementation and optimisation (Bryant-Lukosius and Dicenso, 2004; Bryant-Lukosius et al., 2016; DiCenso et al., 2010; Kilpatrick et al., 2024). It is also a priority in performance-based healthcare services (Elliott et al., 2013). Given their diverse core competencies, advanced practice nurses’ sphere of influence is multifaceted. Outcome research has predominantly focused on patient-related outcomes (for example, health status, patient satisfaction) and organisational metrics (for example, costs, length of stay) (Casey et al., 2017; Deschodt et al., 2024; Elliott et al., 2013; Kilpatrick et al., 2023; Martin-Misener et al., 2015; Martínez-González et al., 2014). Existing studies often focus on specific aspects such as guideline adherence, leadership, or team functioning (Audet et al., 2024; Elliott et al., 2013; Kilpatrick et al., 2019), or are restricted to particular settings such as hospitals (Hurlock-Chorostecki et al., 2013a; Hurlock-Chorostecki et al., 2013b). Reviews of advanced practice nurse and nurse practitioner roles in hospital and primary care settings highlight the need for further exploration on their impact on healthcare professional teams across diverse settings (Hurlock-Chorostecki et al., 2013b; Kilpatrick et al., 2023; Torrens et al., 2019). Outcome-oriented research would be valuable for better understanding how advanced practice nurses contribute to interprofessional team dynamics (Audet et al., 2024). A recent umbrella review summarised indicators used in advanced practice nurse research globally (Kilpatrick et al., 2024). However, to our knowledge, no comprehensive assessment questionnaire exists to measure healthcare professionals’ perceptions of advanced practice nurses’ contributions on their teams across various settings. Therefore, this study represents the first steps in developing and psychometrically validating such a questionnaire. Aim This study aimed to develop, and to face and content validate a questionnaire that measures healthcare professionals' individual perceptions of advanced practice nurses' contributions to team functioning. Methods This study is reported in accord with the Accurate Consensus Reporting Document and Delphi Critical Appraisal Tool guidelines for reporting Delphi studies. Completed checklists are available in the Supplementary tables S1 and S2. Overview A three-phase approach was applied to develop, and face and content validate the questionnaire (see Fig. 1). Phase 1 involved initial questionnaire development through a rapid review of literature. Phase 2 assessed face and content validity through a two-round international modified Delphi procedure. Phase 3 further refined the questionnaire through cognitive interviews with healthcare professionals.Fig. 1Three-phase approach of the questionnaire development.Fig 1 dummy alt text Three-phase approach of the questionnaire development. Phase 1: Initial questionnaire development – rapid review Design To identify relevant outcomes for the questionnaire, we conducted a rapid review and grey literature in September 2023 (Grant and Booth, 2009; Smela et al., 2023). As this rapid review yielded relevant team-level outcomes. The research team subsequently expanded the work into a systematic review of primary studies guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses framework (July 2024–March 2025). The manuscript of this systematic review is currently being prepared for submission to a peer-reviewed journal (Dehennin et al., 2026). No additional outcomes beyond those identified in the rapid review were found in the systematic review. The systematic review was registered in PROSPERO (CRD42024559985). Literature search of the rapid review We searched for reviews in PubMed using a search string with three key concepts: ‘advanced practice nurse’, ‘healthcare professional team’, and ‘impact’. We used free-text terms and relevant Medical Subject Headings combined with Boolean operators: ‘AND’ and ‘OR’. All types of reviews published between 2003 and 2023 were included without language or geographic restrictions. Earlier records were excluded given the development of advanced practice nursing roles occurred primarily in the past twenty years. Given international variation in the regulation of advanced practice nursing roles, reviews were included if they described nursing roles consistent with the definition and scope of practice of advanced practice nurses, even if not explicitly identified as such (Heale and Buckley, 2015). Nurse anaesthetists and nurse midwives were excluded as these roles are not universally recognised as advanced practice nursing roles (International Council of Nurses, 2021; Kilpatrick et al., 2023). Grey literature was manually searched. This included reports (International Council of Nurses, 2020), competency frameworks (Van Hecke et al., 2024), and relevant master's theses supervised by members of the research team (Corneillie et al., 2023; Pattyn et al., 2023; Swaenepoel et al., 2020; Verdoodt et al., 2022). Screening and selection Records were managed in Excel and duplicates were removed. Two researchers screened titles and abstracts according to the inclusion criteria. Discrepancies were resolved by discussion or consultation with a third researcher. One researcher reviewed full-text documents and extracted outcomes using a data extraction sheet developed in Excel. Outcome and domain development The research team discussed the extracted outcomes and organised them into domains based on content similarity during multiple meetings. The research team comprised academics experienced in outcomes research, health policy, advanced practice nursing education, innovative intervention evaluation, primary care, and clinical practice with advanced practice nurses. The team ensured that outcomes reflected advanced practice nurse competencies at the highest scope of practice. Outcomes were clearly distinguished from generalist nursing roles and aligned with internationally recognised advanced practice nurse core competencies (International Council of Nurses, 2020; Tracy et al., 2018; Van Hecke et al., 2024). For each domain, a description was provided based on literature and/or input from the research team. During this development process, we applied the following definition of 'team': ‘A collection of individuals who are interdependent in their tasks, who share responsibility for outcomes, who see themselves and who are seen by others as an intact social entity embedded in one or more larger social systems, and who manage their relationships across organisational borders’(Cohen and Bailey, 1997). Accordingly, the concept of team extended beyond the nursing team to include both intraprofessional and interprofessional healthcare professionals. Teams were not restricted by organisational boundaries and could operate across inpatient, outpatient, and community care settings. Based on the identified outcomes, the research team developed a questionnaire assessing healthcare professionals' individual perceptions of advanced practice nurses' contributions to team functioning. Subsequently, a two-round modified Delphi procedure was conducted for face and content validation of the questionnaire. Phase 2: Face and content validity: a two-round modified Delphi procedure Design A two-round international modified Delphi procedure was set up. This approach is well suited for achieving expert consensus on complex topics with limited empirical evidence (Khodyakov et al., 2023). It enables structured input from experts across diverse regions and professional backgrounds while minimising dominance by individual participants (Keeney et al., 2001; Khodyakov et al., 2023). Two predefined Delphi rounds were employed to limit participant burden and drop-out (Keeney et al., 2001), with planned questionnaire revisions based on expert feedback. Predefined stopping criteria after round two included achievement of acceptable content validity (≥0.78) for at least 80% of outcomes and the absence of substantial unresolved conceptual disagreement. If these criteria were not met, a third Delphi round or an additional online consensus meeting was planned. Participants A purposively selected panel of national and international experts was invited by email to participate in the Delphi procedure. Selection aimed to ensure diversity in professional background, country, and work setting. Eligibility criteria included advanced practice nurses employed in primary care, hospital care, mental healthcare, or long-term residential care. Healthcare professionals and managers with at least three years of experience collaborating closely with, mentoring, or coaching an advanced practice nurse were also eligible. In addition, researchers with published work on advanced practice nurse role development, implementation, or evaluation were included. Experts were defined as professionals with demonstrable knowledge of advanced practice nurse roles. This expertise could derive from clinical practice, leadership roles, or academic positions with active involvement in advanced practice nurse education, research, or policy development. Experts were recruited through national and international networks of the research team and through established networks of senior researchers in countries with both established and emerging advanced practice nurse roles. Procedures For each Delphi round, a structured Qualtrics survey was developed in English and reviewed by the research team. In the first round (February–March 2024), participants rated each outcome's relevance, comprehensibility, and applicability across all healthcare settings. Ratings were provided using a four-point Likert scale (1 = strongly disagree to 4 = strongly agree) to avoid an ambivalent midpoint (Lynn, 1986). Scoring was mandatory to prevent missing data. Participants could provide comments for each domain and completed a demographic form. In the second round (April–July 2024), participants re-rated relevance and comprehensibility of revised outcomes using the same scale. Item-level content validity index scores from the first round were displayed alongside each outcome. A summary of qualitative feedback from the first round was compiled into a document and shared with participants before the second round to explain revisions and support informed re-rating. Based on predefined stopping criteria and high content validity indices, the research team decided no additional round was required. Remaining feedback concerned wording clarity rather than conceptual disagreement, which was addressed through cognitive interviews. The questionnaire was then translated into Dutch and tested through cognitive interviews. Data analysis After the first Delphi round, the item-level content validity index for relevance were calculated for each outcome. Additionally, the percentage of experts who rated the outcomes as 'disagree' or 'strongly disagree' was calculated for both comprehensibility and applicability. Based on established criteria, cut-off values were set at 0.78 for the item-level content validity index and at a maximum of twenty-two percent disagreement for comprehensibility and applicability (Polit et al., 2007). To account for chance agreement inherent in the four-point Likert scale, modified kappa values were retrospectively calculated for each outcome in both Delphi rounds using the method proposed by Polit et al. (2007). Interpretation followed established thresholds: values above 0.74 indicated excellent agreement, values between 0.60 and 0.74 good agreement, values between 0.40 and 0.59 fair agreement, and values below 0.40 poor agreement (Cicchetti and Sparrow, 1981). The scale-level content validity index average was calculated to assess overall questionnaire validity in both rounds. Qualitative feedback was reviewed outcome by outcome. Outcomes below the item-level content validity index threshold were retained if qualitative feedback indicated high conceptual relevance and disagreement was primarily due to wording or contextual interpretation. One researcher synthesised all qualitative feedback and proposed revisions. These proposals were discussed within the full research team until consensus was reached. The refined questionnaire was included in the second round and analysed using the same methods. Outcomes exceeding 22% disagreement for applicability were excluded. Applicability was not reassessed in the second round. Phase 3: Cognitive testing and refinement – cognitive interviews Design Cognitive interviews were conducted to assess clarity and to further strengthen content validity of the questionnaire. Hence, the cognitive interviews focused on clarity, wording, and comprehensibility issues. It allowed to identify unclear outcomes by uncovering the cognitive processes healthcare professionals used to complete the questionnaire, allowing for their revision or removal (Balza et al., 2022; Willis, 2015). Participants Participants were recruited through purposive distribution of a flyer via email within the research team's advanced practice nurse network. All healthcare professionals working with an advanced practice nurse were eligible to participate, including nurses, head nurses, managers, and physicians. Additionally, we aimed to achieve diversity in employment settings such as primary care, hospital care, and mental healthcare. Procedures The interviews were conducted via Microsoft Teams between November 2024 and February 2025, each lasting approximately 60 minutes. A combination of the think-aloud method and concurrent verbal probing was used (Balza et al., 2022; Boeije and Willis, 2013). An interview guide included general instructions and probing questions such as ‘What did you understand by this question?’ and ‘Can you rephrase the question in your own words?’. Interviews were audio and video recorded but not transcribed. Participants read the introduction and each question aloud on-screen, verbalising their thoughts as they attempted to answer the outcomes. The interviewer posed probing questions as needed to assess understanding before proceeding. Data analysis During the interviews, the interviewer took notes and memos, which were later reviewed alongside the recordings and summarised in an Excel spreadsheet. Comments were organised into a structured outcome-level matrix, allowing direct documentation of clarity-related issues without full verbatim transcription. Once two interviews were completed, three members of the research team analysed the compiled notes for each outcome. The team discussed the results, identifying recurring issues related to length, academic wording, and comprehensibility, and made decisions regarding rephrasing, merging, reassignment, or removal of outcomes through consensus. Revised outcomes were again tested for clarity in subsequent interviews (Balza et al., 2022; Willis and Artino, 2013). Interviews continued until saturation was reached, defined as the point at which no new issues related to clarity or comprehensibility were identified. Each participant was interviewed only once. Ethical considerations The study was approved by the Ethical Committee of Ghent University Hospital (ONZ-2023-0528). Written informed consent was obtained from all participants, who were informed that data would be pseudonymised and handled confidentially. Rigour Several steps were taken to ensure study rigour. First, the initial questionnaire was developed using multiple data sources and iteratively refined by the research team with diverse expertise and backgrounds. Second, to address challenges associated with Delphi studies, the Delphi Critical Appraisal Tool was employed in study design and execution (Keeney et al., 2001; Khodyakov et al., 2023). Anonymity was maintained using anonymised summaries of responses in feedback documents. Iteration was achieved using two rounds with the same response options, allowing panellists to revise their responses. To minimise attrition, data were collected using Qualtrics, a secure web-based survey platform supporting anonymous participation, and mandatory responses. General and personalised email reminders were sent regularly, the number of rounds was limited, and participants were given at least two weeks per round. At the end of round two, participants could indicate their preference for acknowledgement in the publication. Three research team members were involved in analysing survey responses and qualitative feedback and developing feedback documents. Third, cognitive interview recordings, results, and memos were discussed within the research team. Last, the Accurate Consensus Reporting Document guidelines and Cognitive Interviewing Reporting Framework were followed (Boeije and Willis, 2013; Gattrell et al., 2024). Results Phase 1: Initial questionnaire development – rapid review As indicated in the flow diagram (Fig. 2), the rapid review identified 2,399 records through PubMed. After removing duplicates, 2,386 records remained for title and abstract screening. Eight additional grey literature records were identified. After title and abstract screening, 68 published records remained for full-text reading. Of these, 34 records were excluded based on eligibility criteria and two because the full text could not be retrieved. Thus, 40 records were selected for analysis, including two records dating from before 2003 that were retained after the research team determined they contained relevant information (DiCenso, 1998; Kleinpell-Nowell and Weiner, 1999).Fig. 2Flow diagram rapid review.Fig 2 dummy alt text Flow diagram rapid review. After discussion of the extracted outcomes within the research team, an initial questionnaire of 102 outcomes organised in 14 domains was obtained: (1) innovation and quality culture, (2) support to and adopting evidence-based/-informed practice, (3) healthcare team capacity building, (4) advanced practice nurse and healthcare team members' role clarity, (5) advanced practice nurse role acceptance and satisfaction, (6) healthcare team members' perception of their own role, (7) workload, (8) job satisfaction, (9) communication, (10) clinical decision-making, (11) problem-solving and conflict management, (12) continuity of care, (13) collaborative practice, and (14) sense of cohesion. Each outcome was introduced with ‘The advanced practice nurse in my team ensures that…’ or ‘The advanced practice nurse in my team implies that…’. The initial questionnaire is presented in Supplementary table S3. Phase 2: Face and content validity — modified Delphi procedure Characteristics of the Delphi expert panel Of the 41 individuals who expressed interest in participating, 27 completed the first round of the survey; of these, 23 also completed the second round. The participants were primarily from Europe (round 1, n = 24; round 2, n = 20), with a smaller number from North America (round 1, n = 3; round 2, n = 3). About half of the experts were from Belgium. Their professional backgrounds were academics, healthcare managers, advanced practice nurses, and physicians. Their work settings included primary care, secondary/general and tertiary/university hospital care, mental healthcare, long-term care, and/or academia. More detailed participant characteristics are presented in Table 1.Table 1Socio-demographic characteristics of Delphi participants.Table 1: dummy alt textParticipant characteristicsRound 1Round 2Gendern = 27n = 23Male65Female2119Country of employmentn = 27n = 23Belgium1515Canada22Finland22France11Iceland10Ireland11The Netherlands31The United Kingdom10The United States11Highest degreen = 27n = 23Medical doctor22Nurse with master’s degree1612Other33Current job(s)*Medical doctor22Nurse11Specialised nurse22Clinical nurse specialist32Nurse practitioner21Advanced practice nurse32Healthcare manager66Academic1614Work setting(s)*Primary care76Secondary/general hospital41Tertiary/ university hospital66Mental healthcare64Long-term care⁎⁎22Academia1110⁎Multiple responses possible⁎⁎Long-term residential care other than mental healthcare Table 1Socio-demographic characteristics of Delphi participants.Table 1: dummy alt textParticipant characteristicsRound 1Round 2Gendern = 27n = 23Male65Female2119Country of employmentn = 27n = 23Belgium1515Canada22Finland22France11Iceland10Ireland11The Netherlands31The United Kingdom10The United States11Highest degreen = 27n = 23Medical doctor22Nurse with master’s degree1612Other33Current job(s)*Medical doctor22Nurse11Specialised nurse22Clinical nurse specialist32Nurse practitioner21Advanced practice nurse32Healthcare manager66Academic1614Work setting(s)*Primary care76Secondary/general hospital41Tertiary/ university hospital66Mental healthcare64Long-term care⁎⁎22Academia1110⁎Multiple responses possible⁎⁎Long-term residential care other than mental healthcare Socio-demographic characteristics of Delphi participants. Multiple responses possible Long-term residential care other than mental healthcare First Delphi round As a first step, the research team retained outcomes with relevance scores ≥0.78 and comprehensibility disagreement rates ≤ 22%. All feedback was analysed and discussed. Adjustments to wording were made based on expert input. In general, outcomes with lower relevance scores were removed. For outcomes with high relevance but low comprehensibility, accompanying comments were carefully reviewed to adjust the outcomes. All nineteen outcomes with applicability disagreement above the cut-off also showed insufficient item-level content validity index scores and were revised or removed accordingly. Overall, eighteen outcomes were removed, thirteen new outcomes were added, and fourteen overlapping outcomes were merged. This resulted in a revised questionnaire comprising ninety outcomes across fourteen domains for evaluation in the second round. Modified kappa values for the 102 outcomes in round one ranged from 0.22 to 1.00 (mean = 0.75, standard deviation = 0.19). 83% of outcomes achieving good to excellent agreement (k ≥ 0.60). 9% showed poor agreement, which consistently aligned with low item-level content validity index scores. The scale-level content validity index average was 0.76, indicating good overall content validity and agreement beyond chance (Polit et al., 2007). Overall, 51% of outcomes in the first round had an item-level content validity index ≥0.78. An overview of the outcomes with item-level content validity index scores, corresponding modified kappa values, and percentages calculated from the input of the first Delphi round is presented in Supplementary table S4. Experts frequently noted that outcome wording was unclear or overly directional. Several outcomes were perceived as difficult to assess from the perspective of an individual healthcare professional or insufficiently linked to the respondent’s context or area of specialisation. The absence of a defined evaluation period was also highlighted. As a result, the wording for surveying the outcomes was adjusted. More specifically, the phrases 'The advanced practice nurse in my team ensures that...' and 'The advanced practice nurse in my team implies that...' were replaced with 'In the last 3 months, please indicate the extent to which you think the role of the advanced practice nurse in your team has contributed to the following outcomes'. Response options ranged from −2 (substantial negative contribution) to +2 (substantial positive contribution). Outcomes were rephrased in neutral, non-directional language, framed from an individual perspective, and explicitly linked to the respondent’s context. Furthermore, the description of the 'Collaborative practice' domain was refined based on feedback regarding the lack of comprehensibility of this concept. 44 outcomes had an item-level content validity index below 0.78, of which twelve were removed, while 32 were retained for reassessment after rephrasing, as expert feedback suggested that clarity improvements could enhance relevance. Six additional outcomes above the threshold were removed due to overlap. In summary, the first Delphi round resulted in a refined questionnaire of 90 outcomes across 14 domains to be evaluated in round two. Second Delphi round In the second Delphi round, 83% of participants rated the revised outcome wording as comprehensible and appropriate. The proposed 3-month timeframe was perceived as appropriate by 65% of participants. However, based on experts feedback, the timeframe was adjusted to 6 to 12 months. This adjustment aimed to balance the duration required for some advanced practice nurse activities (for example, implementing quality improvement initiatives), the frequency of some advanced practice nurse activities (for example, providing training to the healthcare team), and the need to minimise recall bias. Although some experts recommended the addition of a 'not applicable' option, at this stage of the research the research team decided not to adopt this, as it could lead to poorer data quality by encouraging hesitant respondents to select it too readily. Following the second Delphi round, agreement among experts improved, with modified kappa values ranging from 0.28 to 1.00 (mean = 0.84, standard deviation = 0.16) and 90% of outcomes reaching good to excellent agreement (k ≥ 0.60). Only 4% of outcomes showed poor agreement (k < 0.40), and these outcomes again coincided with lower I-CVI scores. The scale-level content validity index average rose to 0.85, indicating improved content validity and sustained agreement beyond chance (Polit et al., 2007). In the second round, 80% of outcomes achieved an item-level content validity index ≥0.78. An overview of the outcomes with item-level content validity index scores, corresponding modified kappa values, and percentages calculated from the input of the second Delphi round is presented in Supplementary table S5. After the second Delphi round, twelve outcomes were removed and seven were merged based on experts' input. Domains addressing 'advanced practice nurse and healthcare team members' professional role clarity', 'advanced practice nurse role acceptance and satisfaction', and 'healthcare team members' perception of their own professional role' were rearranged into 'advanced practice nurse role clarity, acceptance and satisfaction' and 'healthcare team members' perception of their own professional role'. The domain 'workload' was merged with 'job satisfaction' to form 'workload and job satisfaction'. The domain 'collaborative practice' was combined with 'sense of cohesion' to form 'collaborative practice and sense of cohesion'. Eighteen outcomes had an item-level content validity index lower than 0.78 of which twelve were removed. The remaining six were retained with justification from the research team. Specifically, ‘A clear definition of my own professional role’ and ‘A clear division of work within my healthcare team’ were kept because these team-level outcomes are well supported by existing literature and our qualitative studies on team dynamics involving advanced practice nurses (Andregård and Jangland, 2014; DiCenso, 1998; Foster et al., 2016; Kerr et al., 2021; Kilpatrick et al., 2010; Kilpatrick et al., 2014; Schadewaldt et al., 2013). ‘My initiatives to involve expert patients in care’ was also retained, as the questionnaire aims to assess perceived advanced practice nurses’ contributions across different healthcare systems. The integration of expert patients varies internationally but is expected to expand (Boulet, 2016; Clavel et al., 2021; Kendir et al., 2023). Finally, ‘Access to a healthcare provider who can order tests, prescribe medication, or write attestations’ was merged into a single outcome to capture all aspects of team effectiveness (Kilpatrick et al., 2019). The wording of nineteen outcomes was slightly adjusted based on expert comments and/or low comprehensibility scores. Additionally, eight outcomes were reassigned to a different domain following expert recommendations. Finally, all experts' suggestions on information to be added in the introduction of the questionnaire or throughout the final team impact questionnaire were taken into account. The questionnaire at the end of the second Delphi round consisted of 11 domains and 74 outcomes. An overview of the adjustments made to the questionnaire during both Delphi rounds is presented in Supplementary table S6. Phase 3: Cognitive testing and refinement – cognitive interviews Characteristics of the participants Seven healthcare professionals consented to participate in the cognitive interviews. The participants included specialised nurses performing nursing consultations, head nurses, managers, and physicians, all of whom were employed in hospitals. Each participant had collaborated with an advanced practice nurse for a minimum of three years and a maximum of 10 years, with one participant reporting 24 years of experience working with an advanced practice nurse. The participants' tenure in their current roles ranged from six to 26 years. Results from the interviews Based on the cognitive interviews, the number of outcomes in the questionnaire was reduced from 74 to 67 while maintaining the 11-domain structure. Feedback was consistent across participants and focused on the wording, length, and complexity of outcomes. This suggests that clarity-related issues had reached saturation. As a result, several outcomes were rephrased to improve readability and clarity. For instance, participants found outcome 3.1, ‘My access to one-on-one training (mentoring/coaching) relevant to the context and/or the specialty in which I am working’, unclear and too complex. They felt that ‘my access’ was ambiguous and that the references to context and specialty added little value. The outcome was therefore revised to ‘individual coaching or training for me’. Six outcomes were removed due to ambiguity or overlap. Additionally, one outcome was merged with another, and two outcomes were reassigned to different domains to enhance coherence. The outcomes that were removed, merged, or reassigned to a different domain are presented in Supplementary table S7. Additionally, almost all participants emphasized the need for a 'not applicable' response option. They noted that not all outcomes are always applicable across organisations, settings, or stages of advanced practice nurse implementation. For instance, one participant explained that outcome 7.7 (‘Completeness of discharge and referral letters’), fell outside the advanced practice nurse’s responsibilities in their setting. The participant questioned how this outcome should be scored without a ‘not applicable’ response option. In response, 'not applicable' was added to distinguish outcomes that lie outside the advanced practice nurse's scope from ‘no contribution’. In contrast, ‘no contribution’ indicates that impact could be possible but not perceived. This distinction supports more accuracy and prevents forced responses. The detailed process of the questionnaire development is illustrated in Fig. 3.Fig. 3Overview of the development process of the questionnaire.Fig 3 dummy alt text Overview of the development process of the questionnaire. An overview of the final version of the questionnaire is presented in Table 2. The full version of the final questionnaire is presented in the Supplementary table S8.Table 2overview of the final questionnaire.Table 2: dummy alt textDOMAIN I. Innovation and quality culture*1.1 Identifying quality improvement items aligned with the needs of my team1.2 Initiating quality improvement initiatives tailored to my team's needs1.3 Implementing quality improvement initiatives within my team1.4 Sustainable follow-up and evaluation of quality improvement initiatives in my team1.5 Using scientific evidence when developing quality initiatives within my team1.6 My involvement in developing quality improvement initiatives in my team1.7 Realising or achieving quality indicators in my teamDOMAIN II. Support and application of evidence-based practice*2.1 My access to evidence-based information, policies, procedures, and/or guidelines2.2 My adherence to evidence-based policies, procedures, and/or guidelines2.3 My awareness of relevant research2.4 Initiating relevant research projects2.5 Execution of relevant research projects2.6 My willingness to collaborate in relevant research projects2.7 My access to evidence-based information for patientsDOMAIN III. Healthcare team capacity building*3.1 Individual coaching or training for me3.2 Organising interprofessional training3.3 Meeting my needs for knowledge and skills development3.4 Support during my professional training trajectory3.5 Further development of the nursing profession3.6 My critical reflection on care deliveryDOMAIN IV. Advanced practice nurse role clarity, acceptance and satisfaction*4.1. My clear understanding of the advanced practice nurse role4.2. My acceptance of the advanced practice nurse role4.3 My realistic expectations regarding the advanced practice nurse role4.4 My confidence in the advanced practice nurse role4.5 My satisfaction with the advanced practice nurse roleDOMAIN V. Healthcare team members' perception of their own professional role*5.1 A clear definition of my professional role (for example, tasks, responsibilities)5.2 A clear division of labour in my team5.3 Enrichment of my professional role5.4 The extent to which I am a role model who motivates and inspires colleagues5.5 Complementary collaboration within my teamDOMAIN VI. Workload and job satisfaction*6.1 Experiencing a more manageable workload6.2 My overall job satisfaction6.3 My satisfaction with my team’s performanceDOMAIN VII. Communication policy*7.1 Clear written communication among care providers within the organisation (intramural)7.2 Clear written communication between organisations (transmural)7.3 Clear verbal communication among care providers within the organisation (intramural)7.4 Clear verbal communication between organisations (transmural)7.5 Availability of a clear communication protocol (for example, If X occurs, contact Y)7.6 Organising interprofessional team meetings7.7 Completeness of discharge and referral letters7.8 My access to patient, clinical, and organisational information7.9 Addressing patients' questions about their careDOMAIN VIII. Clinical decision-making*8.1 The ability to consult on clinical decisions8.2 Support in addressing highly complex patient care issues8.3 A coherent clinical decision-making process within my team8.4 My participation in clinical decision-making8.5 Integration of ethical considerations in clinical decision-making8.6 Considering patients’ physical, social, spiritual, and psychological needs in clinical decisionsDOMAIN IX. Problem-solving and conflict management*9.1 Recognizing issues in patient care9.2 Recognizing issues in team collaboration9.3 Recognizing issues in care organisation within my team9.4 Supporting the resolution of issues in patient care9.5 Supporting the resolution of team collaboration issues9.6 Supporting the resolution of care organisation issues9.7 Discussing the needs of my healthcare team (regarding patient care, team collaboration, or care organisation)DOMAIN X. Continuity of care*10.1 Implementation of care pathways (for example, diabetes management, surgical pathway, dementia pathway, depression treatment)10.2 Smooth care processes among providers within the organisation10.3 Smooth care processes between organisations (for example, referrals between institutions, GPs, social services)10.4 My knowledge of patients’ care plans10.5 Timely execution of patient care10.6 Timely addressing of actual or potential complications10.7 Easy access to request medical tests, prescriptions, and certificates10.8 Actively involving patients and their families in care10.9 Actively involving experience experts in care (patients sharing their experience to improve care)10.10 Clear discharge planning for patientsDOMAIN XI. Collaborative practice and sense of belonging*11.1 Collaboration in my team11.2 Feeling treated as an equal partner in my team (for example, in team meetings, ethical discussions)⁎For each outcome, indicate the extent to which you believe the advanced practice nurse in your team has contributed in the past 6 to 12 months.Please select only one answer per outcome, using the following scoring options:-2 = substantial negative contribution: this score indicates a highly negative contribution-1 = slight negative contribution: this score suggests a relatively minor negative contribution0 = no contribution: this score suggests that the advanced practice nurse had no impact on this outcome+1 = slight positive contribution: this score suggests a relatively minor positive contribution+2 = substantial positive contribution: this score indicates a highly positive contributionN/A = not applicable: this outcome does not apply to the advanced practice nurse's work in my setting Table 2overview of the final questionnaire.Table 2: dummy alt textDOMAIN I. Innovation and quality culture*1.1 Identifying quality improvement items aligned with the needs of my team1.2 Initiating quality improvement initiatives tailored to my team's needs1.3 Implementing quality improvement initiatives within my team1.4 Sustainable follow-up and evaluation of quality improvement initiatives in my team1.5 Using scientific evidence when developing quality initiatives within my team1.6 My involvement in developing quality improvement initiatives in my team1.7 Realising or achieving quality indicators in my teamDOMAIN II. Support and application of evidence-based practice*2.1 My access to evidence-based information, policies, procedures, and/or guidelines2.2 My adherence to evidence-based policies, procedures, and/or guidelines2.3 My awareness of relevant research2.4 Initiating relevant research projects2.5 Execution of relevant research projects2.6 My willingness to collaborate in relevant research projects2.7 My access to evidence-based information for patientsDOMAIN III. Healthcare team capacity building*3.1 Individual coaching or training for me3.2 Organising interprofessional training3.3 Meeting my needs for knowledge and skills development3.4 Support during my professional training trajectory3.5 Further development of the nursing profession3.6 My critical reflection on care deliveryDOMAIN IV. Advanced practice nurse role clarity, acceptance and satisfaction*4.1. My clear understanding of the advanced practice nurse role4.2. My acceptance of the advanced practice nurse role4.3 My realistic expectations regarding the advanced practice nurse role4.4 My confidence in the advanced practice nurse role4.5 My satisfaction with the advanced practice nurse roleDOMAIN V. Healthcare team members' perception of their own professional role*5.1 A clear definition of my professional role (for example, tasks, responsibilities)5.2 A clear division of labour in my team5.3 Enrichment of my professional role5.4 The extent to which I am a role model who motivates and inspires colleagues5.5 Complementary collaboration within my teamDOMAIN VI. Workload and job satisfaction*6.1 Experiencing a more manageable workload6.2 My overall job satisfaction6.3 My satisfaction with my team’s performanceDOMAIN VII. Communication policy*7.1 Clear written communication among care providers within the organisation (intramural)7.2 Clear written communication between organisations (transmural)7.3 Clear verbal communication among care providers within the organisation (intramural)7.4 Clear verbal communication between organisations (transmural)7.5 Availability of a clear communication protocol (for example, If X occurs, contact Y)7.6 Organising interprofessional team meetings7.7 Completeness of discharge and referral letters7.8 My access to patient, clinical, and organisational information7.9 Addressing patients' questions about their careDOMAIN VIII. Clinical decision-making*8.1 The ability to consult on clinical decisions8.2 Support in addressing highly complex patient care issues8.3 A coherent clinical decision-making process within my team8.4 My participation in clinical decision-making8.5 Integration of ethical considerations in clinical decision-making8.6 Considering patients’ physical, social, spiritual, and psychological needs in clinical decisionsDOMAIN IX. Problem-solving and conflict management*9.1 Recognizing issues in patient care9.2 Recognizing issues in team collaboration9.3 Recognizing issues in care organisation within my team9.4 Supporting the resolution of issues in patient care9.5 Supporting the resolution of team collaboration issues9.6 Supporting the resolution of care organisation issues9.7 Discussing the needs of my healthcare team (regarding patient care, team collaboration, or care organisation)DOMAIN X. Continuity of care*10.1 Implementation of care pathways (for example, diabetes management, surgical pathway, dementia pathway, depression treatment)10.2 Smooth care processes among providers within the organisation10.3 Smooth care processes between organisations (for example, referrals between institutions, GPs, social services)10.4 My knowledge of patients’ care plans10.5 Timely execution of patient care10.6 Timely addressing of actual or potential complications10.7 Easy access to request medical tests, prescriptions, and certificates10.8 Actively involving patients and their families in care10.9 Actively involving experience experts in care (patients sharing their experience to improve care)10.10 Clear discharge planning for patientsDOMAIN XI. Collaborative practice and sense of belonging*11.1 Collaboration in my team11.2 Feeling treated as an equal partner in my team (for example, in team meetings, ethical discussions)⁎For each outcome, indicate the extent to which you believe the advanced practice nurse in your team has contributed in the past 6 to 12 months.Please select only one answer per outcome, using the following scoring options:-2 = substantial negative contribution: this score indicates a highly negative contribution-1 = slight negative contribution: this score suggests a relatively minor negative contribution0 = no contribution: this score suggests that the advanced practice nurse had no impact on this outcome+1 = slight positive contribution: this score suggests a relatively minor positive contribution+2 = substantial positive contribution: this score indicates a highly positive contributionN/A = not applicable: this outcome does not apply to the advanced practice nurse's work in my setting overview of the final questionnaire. For each outcome, indicate the extent to which you believe the advanced practice nurse in your team has contributed in the past 6 to 12 months. Please select only one answer per outcome, using the following scoring options: -2 = substantial negative contribution: this score indicates a highly negative contribution -1 = slight negative contribution: this score suggests a relatively minor negative contribution 0 = no contribution: this score suggests that the advanced practice nurse had no impact on this outcome +1 = slight positive contribution: this score suggests a relatively minor positive contribution +2 = substantial positive contribution: this score indicates a highly positive contribution N/A = not applicable: this outcome does not apply to the advanced practice nurse's work in my setting Discussion To fully realise the potential of advanced practice nurses, their multifaceted role requires evaluation across all spheres of influence (Bryant-Lukosius et al., 2016). This study addresses the lack of a questionnaire to measure healthcare professionals' perceptions of advanced practice nurses' contributions to team functioning across healthcare settings. We developed and validated a questionnaire comprising 67 outcomes organised into 11 domains. The questionnaire was derived from peer-reviewed international literature, grey literature, and multidisciplinary expert input. Face and content validation was obtained using a two-round modified international Delphi procedure and cognitive interviews. This resulted in a relevant, comprehensible, and comprehensive questionnaire based on outcomes that reflect the advanced practice nurse role (Balza et al., 2022; Ingersoll et al., 2000). To our knowledge, this is the first questionnaire to quantitatively assess healthcare professionals' individual perceptions of advanced practice nurses' contributions to team functioning across primary care, hospital care, mental healthcare, and long-term care settings. Existing instruments focus on specific domains, or settings, such as adherence to clinical guidelines, leadership, or teamwork in hospital contexts (Audet et al., 2024; Elliott et al., 2013; Hurlock-Chorostecki et al., 2013a). In contrast, the present questionnaire captures a broader range of team-level outcomes, including innovation, clinical decision-making, problem-solving, continuity, and team capacity building. By encompassing both generic and context-sensitive outcomes, the questionnaire is applicable across different advanced practice nurse roles and settings. The questionnaire aligns with the framework developed by Bryant-Lukosius et al. (2016), which outlines evaluation objectives for advanced practice nurses at each role development stage: introduction, implementation, and long-term sustainability. This framework advocates for evaluation that examines advanced practice nurse role structures, processes, and outcomes from multiple stakeholder perspectives, including patients and families, healthcare professionals and teams, managers, and policymakers. Our questionnaire specifically highlights the healthcare professional perspective, which Bryant-Lukosius et al. (2016) identify as one of the core evaluation domains essential for comprehensive advanced practice nurse role assessment. Moreover, recent Delphi-based research at the patient and system level provides an important complementary perspective to the present team-level questionnaire. Toniolo et al. (2025) established expert consensus on patient- and system-level indicators for evaluating advanced practice nurse contributions, focusing on clinical practice, care coordination, interprofessional collaboration, and leadership. Taken together, these findings support the relevance of multi-level evaluation frameworks in which team-level processes constitute a distinct component of comprehensive advanced practice nurse role assessment (Bryant-Lukosius et al., 2016). Cross-cultural differences further shape the relevance of the domains identified in this questionnaire. In emerging advanced practice nurse contexts such as Belgium and several European countries (for example, France and Switzerland) (Bryant-Lukosius et al., 2016; Toniolo et al., 2025; Van Hecke et al., 2020), domains related to role clarity, acceptance, and satisfaction appear particularly salient. Whereas in more mature advanced practice nurse systems (for example, Canada and the United States), these domains are less prominent and greater emphasis is placed on cost-effectiveness and productivity (Brownwood andcornei Lafortune, 2024; Kilpatrick et al., 2024). However, role clarity has been identified as a key outcome for assessing team functioning even in established contexts (Kilpatrick et al., 2023). This suggests that all questionnaire domains have cross-context relevance. Although the relevance of domain four: advanced practice nurse role clarity, acceptance and satisfaction may vary according to the stage of advanced practice nurse role development. Implications This questionnaire evaluates nurses actively practising in an advanced practice nurse role and should be completed by healthcare professionals who collaborate with them. It applies to nurses whose scope of practice aligns with the advanced practice nurse competencies defined by the International Council of Nurses (2020). It is not intended to assess nurses who hold a master’s degree but do not function in an advanced practice nurse role. The questionnaire captures individual healthcare professionals’ perceptions of advanced practice nurses' contributions to team functioning and is validated for individual-level analysis. It allows exploration of variation in perceptions across professional roles, settings, and interventions. Aggregation to the team level is currently not recommended, as teams may span multiple disciplines and organisations, resulting in substantial heterogeneity. Future research may explore aggregation where within-team agreement is sufficient. When interpreting results, users should account for the specific advanced practice nurse role development stage, as evaluation objectives and appropriate outcome measures may differ (Bryant-Lukosius et al., 2016). For example, outcome 4.1 ('My clear understanding of the advanced practice nurse role') may be more prominent where roles are emerging, whilst outcome 6.1 ('Experiencing a more manageable workload') may be more prominent where roles are well established. In practice, the questionnaire complements patient- and organisation-focused evaluation tools and supports evidence-informed decisions on implementation and optimisation of advanced practice nurse roles. It can highlight areas requiring strengthening or refinement to optimise the team-level impact of advanced practice nurses. By improving team practices, this can contribute to better patient outcomes, quality of care, and cost savings (Kilpatrick et al., 2024). Future psychometric validation should include exploratory and confirmatory factor analysis to evaluate the 11-domain structure, assessment of internal consistency (Cronbach's alpha), and examination of construct validity. Factor analysis may also inform item reduction, thereby shortening the questionnaire and reducing respondent burden. However, given the absence of a comparable established instrument, criterion validity is not currently feasible. Construct validity should instead be assessed through known-groups validity by comparing perceptions across professional roles, settings, and stages of advanced practice nursing role development, as outlined above. Strengths and limitations Several strengths should be noted. First, the use of a two-round international modified Delphi procedure enabled structured consensus building among experts with diverse professional backgrounds, countries, and work settings. To ensure study quality, the RAND guidance was followed (Khodyakov et al., 2023). Participant numbers exceeded those typically reported in Delphi studies, and attrition between rounds was minimal (n = 4) (Boulkedid et al., 2011). Experts provided detailed qualitative feedback, which enhanced refinement of outcomes. Second, content validation was strengthened through the combined use of quantitative indices and qualitative feedback. Item-level content validity index scores were complemented by modified kappa values to account for chance agreement, demonstrating consistently high agreement beyond chance. Outcomes below strict cut-off values were retained only when supported by strong theoretical and empirical justification. Cognitive interviews provided further evidence of clarity and relevance, reinforcing overall content validity. However, several limitations warrant discussion. First, the literature base and expert panel predominantly reflected high-income countries. This aligns with the general scarcity of evidence on advanced practice nurse roles in low- and middle-income countries, which may affect generalisability to these settings (Kilpatrick et al., 2024; Wheeler et al., 2022). Second, most Delphi experts were employed in Belgium (round one: 56 percent; round two: 65 percent), where advanced practice nurse roles are emerging. This may have influenced emphasis on outcomes related to role clarity, acceptance, and satisfaction, and could limit transferability to contexts with more established or differing scopes of practice. However, these outcomes showed very high outcome-level content validity scores (three outcomes scored 1.00, and one scored 0.96). Additionally, role clarity has been identified as a key outcome for assessing team functioning even in established contexts (Kilpatrick et al., 2023). Furthermore, the research team included senior researchers with extensive advanced practice nurse implementation research expertise, including a researcher from Canada with well-established roles. This diversity, alongside the rapid review's international scope and non-Belgian Delphi participants from Europe and North America, supported the questionnaire’s international transferability. This also presents an opportunity for future research to explore international applicability, including potential differences in item interpretation and response patterns across regions with varying advanced practice nursing scopes of practice. Third, the cognitive interviews were limited to Dutch-speaking participants working in a Belgian healthcare setting. The final English version was reviewed by a native English-speaking research team member who identified no additional phrasing issues. However, further testing for clarity and comprehensiveness in diverse geographical contexts remains important. Fourth, no primary care professionals participated in the cognitive interviews, despite recruitment efforts. This reflects the current concentration of advanced practice nurse roles in hospitals in Belgium (Van Hecke et al., 2019). While a primary care professional on the research team reviewed the questionnaire and confirmed most outcomes’ applicability, outcome 10.10 (‘the impact of the advanced practice nurse on clear discharge’) may be less relevant outside hospital settings. Fifth, the 6-to-12-month timeframe was selected to balance capturing meaningful advanced practice nurse activities with minimising recall bias. Although this extended period may be susceptible to recall bias, the questionnaire design reduces this concern by focusing on respondents' overall perceptions rather than requiring enumeration of specific events. Bradburn et al. (1987) demonstrate this approach aligns more closely with how individuals naturally recall extended experiences. Similarly, variability in respondents' exposure to advanced practice nurse activities represents an inherent limitation; to address this, future studies using this questionnaire should account for the frequency of exposure, enabling a more nuanced interpretation of findings across different stakeholder groups. Sixth, formal subgroup analyses by country, professional role, or healthcare setting were not conducted. Most outcomes in the Delphi rounds showed high relevance across all care settings, indicating broad applicability. Additionally, the sample was unbalanced, over half of participants were from Belgium, and worked in academia, making statistical subgroup comparisons prone to bias. Nevertheless, extensive qualitative feedback was collected after each round, which allowed us to explore contextual differences and potential sources of disagreement at the outcome level without formal subgroup analyses. Conclusion This study developed and validated the first comprehensive questionnaire to measure healthcare professionals' individual perceptions of advanced practice nurses' contributions to team functioning across diverse healthcare settings. Through a rigorous three-phase approach including rapid review of international literature, a two-round modified international Delphi procedure with 27 experts, and cognitive interviews with healthcare professionals, we established a questionnaire comprising 67 outcomes organised into 11 domains with strong face and content validity. The questionnaire contributes to multi-level evaluation frameworks essential for comprehensive assessment of advanced practice nurse contributions to healthcare delivery. This questionnaire enables evidence-based decisions about advanced practice nurse role optimisation. Declaration of generative AI and AI-assisted technologies in the manuscript preparation process During the preparation of this work, the authors used ChatGPT and Perplexity to improve the readability and language of the manuscript. After using these tools, the authors reviewed and edited the content as needed and take full responsibility for the content of the published article. Acknowledgments The authors would like to thank all the Delphi panellists for their crucial contribution to the study. Funding Karolien D’Hollander and Tim Hubo are supported by a Ph.D. Grant from the Research Foundation Flanders (FWO), grant number G074423N. CRediT authorship contribution statement Tim Hubo: Writing – review & editing, Writing – original draft, Methodology, Formal analysis, Data curation, Conceptualization. Karolien D'Hollander: Writing – original draft, Methodology, Investigation, Formal analysis, Data curation, Conceptualization. Lise-Marie Kinnaer: Writing – review & editing, Supervision, Data curation, Conceptualization. Pauline Boeckxstaens: Writing – review & editing, Supervision, Conceptualization. Elsie Decoene: Writing – review & editing, Supervision, Conceptualization. Kelley Kilpatrick: Writing – review & editing, Supervision, Conceptualization. Ann Van Hecke: Writing – review & editing, Supervision, Data curation, Conceptualization. Declaration of competing interest The authors declare no conflicts of interest.