Development of a theory-informed questionnaire to assess the acceptability of healthcare interventions.

Sekhon M, Cartwright M, Francis JJ. · 2022

Read Development of a theory-informed questionnaire to assess the acceptability of healthcare interventions. by Sekhon M, Cartwright M, Francis JJ. (2022) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc8887649.txt.

Introduction

Sekhon, Cartwright, and Francis build a questionnaire that measures how acceptable a health intervention feels. Acceptability shapes whether treatments get used at all. A framework names seven parts of it. They include burden, ethical fit, and how well the point of the intervention makes sense. The team wanted one generic tool for any intervention. They built it through a five-step validation method.

The item pool began with 138 candidate questions. Most were cut or rewritten to cover the seven constructs. Two disease-specific versions came first. Feedback from stakeholders refined the wording. A generic version followed. Think-aloud tests used the COVID-19 vaccine as the test case. Twenty participants tried prospective and retrospective versions. Most items read clearly. Three constructs still caused some confusion. The authors report those honestly.

Catalog record

CREATORSekhon M, Cartwright M, Francis JJ.
YEAR2022
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC8887649

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Development of a theory-informed questionnaire to assess the acceptability of healthcare interventions By Mandeep Sekhon, Martin Cartwright, Jill J Francis Published in: BMC Health Services Research DOI: 10.1186/s12913-022-07577-3 ABSTRACT Abstract Background The theoretical framework of acceptability (TFA) was developed in response to recommendations that acceptability should be assessed in the design, evaluation and implementation phases of healthcare interventions. The TFA consists of seven component constructs (affective attitude, burden, ethicality, intervention coherence, opportunity costs, perceived effectiveness, and self-efficacy) that can help to identify characteristics of interventions that may be improved. The aim of this study was to develop a generic TFA questionnaire that can be adapted to assess acceptability of any healthcare intervention. Methods Two intervention-specific acceptability questionnaires based on the TFA were developed using a 5-step pre-validation method for developing patient-reported outcome instruments: 1) item generation; 2) item de-duplication; 3) item reduction and creation; 4) assessment of discriminant content validity against a pre-specified framework (TFA); 5) feedback from key stakeholders. Next, a generic TFA-based questionnaire was developed and applied to assess prospective and retrospective acceptability of the COVID-19 vaccine. A think-aloud method was employed with two samples: 10 participants who self-reported intention to have the COVID-19 vaccine, and 10 participants who self-reported receiving a first dose of the vaccine. Results 1) The item pool contained 138 items, identified from primary papers included in an overview of reviews. 2) There were no duplicate items. 3) 107 items were discarded; 35 new items were created to maximise coverage of the seven TFA constructs. 4) 33 items met criteria for discriminant content validity and were reduced to two intervention-specific acceptability questionnaires, each with eight items. 5) Feedback from key stakeholders resulted in refinement of item wording, which was then adapted to develop a generic TFA-based questionnaire. For prospective and retrospective versions of the questionnaire, no participants identified problems with understanding and answering items reflecting four TFA constructs: affective attitude, burden, perceived effectiveness, opportunity costs. Some participants encountered problems with items reflecting three constructs: ethicality, intervention coherence, self-efficacy. Conclusions A generic questionnaire for assessing intervention acceptability from the perspectives of intervention recipients was developed using methods for creating participant-reported outcome measures, informed by theory, previous research, and stakeholder input. The questionnaire provides researchers with an adaptable tool to measure acceptability across a range of healthcare interventions. Supplementary Information The online version contains supplementary material available at 10.1186/s12913-022-07577-3. Keywords: Acceptability, Questionnaire development, Pre-validation methods, Healthcare intervention, Theoretical framework STATEMENT OF CONTRIBUTION What is known on this topic: - It is important to assess the acceptability of healthcare interventions. - A recently developed theoretical framework of acceptability (TFA) proposes seven component constructs (affective attitude, burden, ethicality, intervention coherence, opportunity costs, perceived effectiveness, and self-efficacy) to help identify characteristics of interventions that may be improved. What this study adds: - A generic, theoretically informed questionnaire for assessing acceptability of healthcare interventions has been developed. - The comprehensibility, relevance, and answerability of the adapted items in the generic acceptability questionnaire were assessed using think-aloud methods. - The generic TFA-based questionnaire is a brief and adaptable tool for researchers and clinicians to measure intervention/treatment acceptability across a range of healthcare settings. INTRODUCTION A health intervention that is not acceptable to the people who deliver or receive it is difficult to evaluate, as intervention facilitators are unlikely to deliver the key components faithfully and recipients are unlikely to engage with the intervention as required. Intervention acceptability from the perspective of patients and healthcare professionals has been proposed to have an impact on intervention implementation, uptake, adherence, intended outcomes and overall effectiveness [1–5]. The UK Medical Research Council (MRC) has published guidance for intervention developers and researchers, describing best practice methods for designing and evaluating complex interventions [4–6]. The guidance recommends that researchers assess intervention acceptability [5, 6] but provides few suggestions about how to do this. In a systematic overview of reviews, we found that 55% of included reviews used behavioural measures as indicators of acceptability [7], such as total trial dropout rate and reasons for discontinuation [8–10]. However, there are several reasons, other than acceptability problems, that may explain why participants discontinue treatment or withdraw from an intervention [11]. Reasons may include lack of motivation to take part, mistrust of the research process [12] or personal circumstances external to the trial or the intervention [13]. Furthermore, reliance on measures of observed behaviour does not provide information on which aspects of an intervention are (un)acceptable and hence does not inform how to enhance acceptability. Notably, in our overview of reviews, we found that there was no standardised or validated intervention acceptability questionnaire [7]. The Theoretical Framework of Acceptability (TFA) [7, 14] can guide assessments of intervention acceptability across three temporal perspectives (before, during and after participation in an intervention) and from the perspectives of intervention deliverers and recipients. In some contexts, a questionnaire approach may offer a time-efficient way to identify potential problems with intervention acceptability, within all four phases of intervention development and evaluation identified in the MRC guidance, i.e., development, feasibility and piloting, evaluation, implementation [4–6]. Questionnaires are often considered a practical and cost-effective method for assessing participant outcomes (e.g., quality of life, emotional health, experienced symptoms). They have the advantage of being able to be administered to large samples, and to enable quantitative analysis including longitudinal assessments and direct comparisons between different trial arms and across different studies [15, 16]. To assess whether other researchers had developed a TFA-based acceptability questionnaire, we completed a forward citation search in Google scholar (October 2021), and identified two articles that report using quantitative measures of the TFA constructs [17, 18]. Neither article reported using an established method to develop their questionnaire, and neither questionnaire included an item assessing overall acceptability. Keyworth et al. [18] describe useful methods for analysing data from Likert scale responses to TFA items but reported problems with the wording of the Opportunity Costs item and potential issues with the response format of this item and the Self-Efficacy item. Renko et al’s [17] questionnaire contained several examples where the item wording did not accurately reflect the TFA definitions or items that conflated multiple TFA constructs. This study included no assessment of the comprehensibility of the items to participants. These studies highlight the challenges of developing a TFA questionnaire and demonstrate the need for a generic TFA questionnaire that can be used as the starting point for questionnaire development across health interventions. The development and validation of questionnaires is a complex process [19]. Common methods to develop questionnaires include both inductive “bottom-up” approaches and deductive “top-down” approaches. The bottom-up approach focuses on generating items from empirical data often generated by exploratory qualitative methods (e.g., semi-structured interviews, focus groups) to ensure items represent the perspectives of the target population [20]. The top-down approach focuses on reviewing the literature to identify existing items [20, 21] or generating items based on pre-existing theory. To develop the questionnaire, we combined methods for the development and pre-validation of participant-reported outcome measures [20] and methods used to establish the content validity of items in theoretically informed questionnaires [22] (see Method section and supplementary files 1 and 2 for details). Aims and objectives The aim of the current study was to develop a generic TFA

Read the complete text