The Implementation Research Logic Model: a method for planning, executing, reporting, and synthesizing implementation projects.
Smith JD, Li DH, Rafferty MR. · 2020
Read The Implementation Research Logic Model: a method for planning, executing, reporting, and synthesizing implementation projects. by Smith JD, Li DH, Rafferty MR. (2020) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/europmc-pmc7523057.txt.
Introduction
Smith, Li and Rafferty present the Implementation Research Logic Model, called the IRLM. Health research often uses many models for parts of a project. Projects still struggle to link those parts in a clear way.
The model gives a shared structure for that link. It connects determinants, strategies, mechanisms and outcomes. Teams can use it to plan, run and report projects. The authors built it with input from varied research teams. They also tested its use in training for over 130 researchers and partners. Readers get guiding principles and variants for common study designs.
Catalog record
| CREATOR | Smith JD, Li DH, Rafferty MR. |
|---|---|
| YEAR | 2020 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| LICENSE | CC BY 4.0 |
| RIGHTS | CC BY |
| SOURCE | Europe PMC |
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Implementation Research Logic Model: a method for planning, executing, reporting, and synthesizing implementation projects By Justin D. Smith, Dennis H. Li, Miriam R. Rafferty Published in: Implementation Science : IS DOI: 10.1186/s13012-020-01041-8 ABSTRACT Background Numerous models, frameworks, and theories exist for specific aspects of implementation research, including for determinants, strategies, and outcomes. However, implementation research projects often fail to provide a coherent rationale or justification for how these aspects are selected and tested in relation to one another. Despite this need to better specify the conceptual linkages between the core elements involved in projects, few tools or methods have been developed to aid in this task. The Implementation Research Logic Model (IRLM) was created for this purpose and to enhance the rigor and transparency of describing the often-complex processes of improving the adoption of evidence-based interventions in healthcare delivery systems. Methods The IRLM structure and guiding principles were developed through a series of preliminary activities with multiple investigators representing diverse implementation research projects in terms of contexts, research designs, and implementation strategies being evaluated. The utility of the IRLM was evaluated in the course of a 2-day training to over 130 implementation researchers and healthcare delivery system partners. Results Preliminary work with the IRLM produced a core structure and multiple variations for common implementation research designs and situations, as well as guiding principles and suggestions for use. Results of the survey indicated a high utility of the IRLM for multiple purposes, such as improving rigor and reproducibility of projects; serving as a “roadmap” for how the project is to be carried out; clearly reporting and specifying how the project is to be conducted; and understanding the connections between determinants, strategies, mechanisms, and outcomes for their project. Conclusions The IRLM is a semi-structured, principle-guided tool designed to improve the specification, rigor, reproducibility, and testable causal pathways involved in implementation research projects. The IRLM can also aid implementation researchers and implementation partners in the planning and execution of practice change initiatives. Adaptation and refinement of the IRLM are ongoing, as is the development of resources for use and applications to diverse projects, to address the challenges of this complex scientific field. Contributions to the literature Drawing from and integrating existing frameworks, models, and theories, the IRLM advances the traditional logic model for the requirements of implementation research and practice.The IRLM provides a means of describing the complex relationships between critical elements of implementation research and practice in a way that can be used to improve the rigor and reproducibility of research and implementation practice, and the testing of theory.The IRLM offers researchers and partners a useful tool for the purposes of planning, executing, reporting, and synthesizing processes and findings across the stages of implementation projects. BACKGROUND In response to a call for addressing noted problems with transparency, rigor, openness, and reproducibility in biomedical research [1], the National Institutes of Health issued guidance in 2014 pertaining to the research it funds (https://www.nih.gov/research-training/rigor-reproducibility). The field of implementation science has similarly recognized a need for better specification with similar intent [2]. However, integrating the necessary conceptual elements of implementation research, which often involves multiple models, frameworks, and theories, is an ongoing challenge. A conceptually grounded organizational tool could improve rigor and reproducibility of implementation research while offering additional utility for the field. This article describes the development and application of the Implementation Research Logic Model (IRLM). The IRLM can be used with various types of implementation studies and at various stages of research, from planning and executing to reporting and synthesizing implementation studies. Example IRLMs are provided for various common study designs and scenarios, including hybrid designs and studies involving multiple service delivery systems [3, 4]. Last, we describe the preliminary use of the IRLM and provide results from a post-training evaluation. An earlier version of this work was presented at the 2018 AcademyHealth/NIH Conference on the Science of Dissemination and Implementation in Health, and the abstract appeared in the Implementation Science [5]. Specification challenges in implementation research Having an imprecise understanding of what was done and why during the implementation of a new innovation obfuscates identifying the factors responsible for successful implementation and prevents learning from what contributed to failed implementation. Thus, improving the specification of phenomena in implementation research is necessary to inform our understanding of how implementation strategies work, for whom, under what determinant conditions, and on what implementation and clinical outcomes. One challenge is that implementation science uses numerous models and frameworks (hereafter, “frameworks”) to describe, organize, and aid in understanding the complexity of changing practice patterns and integrating evidence-based health interventions across systems [6]. These frameworks typically address implementation determinants, implementation process, or implementation evaluation [7]. Although many frameworks incorporate two or more of these broad purposes, researchers often find it necessary to use more than one to describe the various aspects of an implementation research study. The conceptual connections and relationships between multiple frameworks are often difficult to describe and to link to theory [8]. Similarly, reporting guidelines exist for some of these implementation research components, such as strategies [9] and outcomes [10], as well as for entire studies (i.e., Standards for Reporting Implementation Studies [11]); however, they generally help describe the individual components and not their interactions. To facilitate causal modeling [12], which can be used to elucidate mechanisms of change and the processes involved in both successful and unsuccessful implementation research projects, investigators must clearly define the relations among variables in ways that are testable with research studies [13]. Only then can we open the “black box” of how specific implementation strategies operate to predict outcomes. Logic models Logic models, graphic depictions that present the shared relationships among various elements of a program or study, have been used for decades in program development and evaluation [14] and are often required by funding agencies when proposing studies involving implementation [15]. Used to develop agreement among diverse stakeholders of the “what” and the “how” of proposed and ongoing projects, logic models have been shown to improve planning by highlighting theoretical and practical gaps, support the development of meaningful process indicators for tracking, and aid in both reproducing successful studies and identifying failures of unsuccessful studies [16]. They are also useful at other stages of research and for program implementation, such as organizing a project/grant application/study protocol, presenting findings from a completed project, and synthesizing the findings of multiple projects [17]. Logic models can also be used in the context of program theory, an explicit statement of how a project/strategy/intervention/program/policy is understood to contribute to a chain of intermediate results that eventually produce the intended/observed impacts [18]. Program theory specifies both a Theory of Change (i.e., the central processes or drivers by which change comes about following a formal theory or tacit understanding) and a Theory of Action (i.e., how program components are constructed to activate the Theory of Change) [16]. Inherent within program theory is causal chain modeling. In implementation research, Fernandez et al. [19] applied mapping methods to implementation strategies to postulate the ways in which changes to the system affect downstream implementation and clinical outcomes. Their work presents an implementation mapping logic model based on Proctor et al. [20, 21], which is focused primarily on the