Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework.
Helfrich CD, Li YF, Sharp ND, Sales AE. · 2009
Read Organizational readiness to change assessment (ORCA): development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework. by Helfrich CD, Li YF, Sharp ND, Sales AE. (2009) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc2716295.txt.
Introduction
Helfrich and co-authors built in 2009 the ORCA survey, a tool to judge whether a health organization is ready to adopt proven care practices. It follows the PARIHS framework, which says success rests on evidence, context, and facilitation, meaning skilled help to make change happen. That framework had guides but no tested measure to score its parts.
They tested a seventy-seven-item survey from three Veterans Health projects, grouped into nineteen subscales under the three main scales. Facilitation and context scales held together well, while the evidence scale fell below the usual reliability bar and lost three items. Two subscales also failed to load as the framework predicts, so more testing is still needed.
Catalog record
| CREATOR | Helfrich CD, Li YF, Sharp ND, Sales AE. |
|---|---|
| YEAR | 2009 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Organizational readiness to change assessment (ORCA): Development of an instrument based on the Promoting Action on Research in Health Services (PARIHS) framework By Christian D Helfrich, Yu-Fang Li, Nancy D Sharp, Anne E Sales Published in: Implementation Science : IS DOI: 10.1186/1748-5908-4-38 ABSTRACT Abstract Background The Promoting Action on Research Implementation in Health Services, or PARIHS, framework is a theoretical framework widely promoted as a guide to implement evidence-based clinical practices. However, it has as yet no pool of validated measurement instruments that operationalize the constructs defined in the framework. The present article introduces an Organizational Readiness to Change Assessment instrument (ORCA), organized according to the core elements and sub-elements of the PARIHS framework, and reports on initial validation. Methods We conducted scale reliability and factor analyses on cross-sectional, secondary data from three quality improvement projects (n = 80) conducted in the Veterans Health Administration. In each project, identical 77-item ORCA instruments were administered to one or more staff from each facility involved in quality improvement projects. Items were organized into 19 subscales and three primary scales corresponding to the core elements of the PARIHS framework: (1) Strength and extent of evidence for the clinical practice changes represented by the QI program, assessed with four subscales, (2) Quality of the organizational context for the QI program, assessed with six subscales, and (3) Capacity for internal facilitation of the QI program, assessed with nine subscales. Results Cronbach's alpha for scale reliability were 0.74, 0.85 and 0.95 for the evidence, context and facilitation scales, respectively. The evidence scale and its three constituent subscales failed to meet the conventional threshold of 0.80 for reliability, and three individual items were eliminated from evidence subscales following reliability testing. In exploratory factor analysis, three factors were retained. Seven of the nine facilitation subscales loaded onto the first factor; five of the six context subscales loaded onto the second factor; and the three evidence subscales loaded on the third factor. Two subscales failed to load significantly on any factor. One measured resources in general (from the context scale), and one clinical champion role (from the facilitation scale). Conclusion We find general support for the reliability and factor structure of the ORCA. However, there was poor reliability among measures of evidence, and factor analysis results for measures of general resources and clinical champion role did not conform to the PARIHS framework. Additional validation is needed, including criterion validation. INTRODUCTION The Promoting Action on Research Implementation in Health Services, or PARIHS, framework is a theoretical framework widely promoted as a guide to implementation of evidence-based clinical practices [1-5]. It has been the subject of much interest and reference by implementation researchers [6-13], at a time when theoretical frameworks are needed to guide quality improvement activities and research [14-16]. However, a key challenge facing the PARIHS framework is that it has as yet no pool of validated measurement instruments that operationalize the constructs defined in the framework, and the PARIHS framers have prioritized development of diagnostic or evaluation tools [5]. Currently the only published instruments related to PARIHS are a survey on clinical practice guideline implementation [13], and the Context Assessment Index (CAI) [17], both of which have important limitations for assessing readiness to implement a specific evidence-based practice. The purpose of the present article is to introduce an organizational readiness to change assessment instrument (ORCA), derived from a summative evaluation of a quality improvement study and organized in terms of the PARIHS framework, and to report scale reliability and factor structures. The ORCA was developed by the Veterans Health Administration (VHA) Quality Enhancement Research Initiative for Ischemic Heart Disease and was initially field tested in three quality improvement projects and studies. The scales were designed to assess organizational readiness to change in preparation for testing interventions designed to implement evidence-based changes in clinical practice. The scales are intended for diagnostic use, to identify needs or conditions that can be targeted by implementation activities or resources, and to provide a prognosis of the success of the change effort at the organizational level. BACKGROUND The PARIHS framework The PARIHS framework was developed to represent essential determinants of successful implementation of research into clinical practice [1]. The PARIHS framework posits three core elements that determine the success of research implementation: (1) Evidence: the strength and nature of the evidence as perceived by multiple stakeholders; (2) Context: the quality of the context or environment in which the research is implemented, and (3) Facilitation: processes by which implementation is facilitated. Each of the three core elements, in turn, comprises multiple, distinct components. Evidence includes four components, corresponding to different sources of evidence: (1) research evidence from published sources, or participation in formal experiments, (2) evidence from clinical experience or professional knowledge, (3) evidence from patient preferences or based on patient experiences, including those of caregivers and family; and (4) routine information derived from local practice context, which differs from professional experience in that it is the domain of the collective environment and not the individual [4,5]. While research evidence is often treated as the most heavily weighted form, the PARIHS framers emphasize that all four forms have meaning and constitute evidence from the perspective of users. Context comprises three components: (1) organizational culture, (2) leadership, and (3) evaluation [3,5]. Culture refers to the values, beliefs, and attitudes shared by members of the organization, and can emerge at the macro-organizational level, as well as among sub-units within the organization. Leadership includes elements of teamwork, control, decision making, effectiveness of organizational structures, and issues related to empowerment. Evaluation relates to how the organization measures its performance, and how (or whether) feedback is provided to people within the organization, as well as the quality of measurement and feedback. Facilitation is defined as a "technique by which one person makes things easier for others" which is achieved through "support to help people change their attitudes, habits, skills, ways of thinking, and working" [1]. Facilitation is a human activity, enacted through roles. Its function is to help individuals and teams understand what they need to change and how to go about it [2,10]. That role may encompass a range of conventional activities and interventions, such as education, feedback and marketing [10], though two factors appear to distinguish facilitation, as defined in PARIHS, from other multifaceted interventions. First, as its name implies, facilitation emphasizes enabling (as opposed to doing for others) through critical reflection, empathy, and counsel. Second, facilitation is expressly responsive and interactive, whereas conventional multi-faceted interventions do not necessarily involve two-way communication. Stetler and colleagues provide a pithy illustration from an interview[10]: On the site visit, I came in with a PowerPoint presentation. That is education. When they called me for help ... that was different. It was facilitation. Harvey and colleagues propose that facilitation is an appointed role, as opposed to an opinion leader who is defined by virtue of his or her standing among peers [2]. Prior publications have also distinguished facilitation roles filled by individuals internal versus external to the team or organization implementing the evidenced-based practice [2,10]. Internal facilitators are local to the implementation team or organization, and are directly involved in the implementation, usually in an assigned role. They can serve as a