The co-design of a digitally supported intervention for selecting implementation tools and actions for standards (SITAS) Authors: Yvonne Kelly, Niamh O’Rourke, Josephine Hegarty, Judy Gannon, Rachel Flynn, Laura M. Keyes Published: 2024 ABSTRACT BackgroundHealth and social care standards are multi-faceted interventions that promote quality and safe care in health systems. There is a need to apply evidence-based, rigorous and transparent methods when selecting strategies to support the implementation of standards. We aimed to develop an evidence- and theory-informed intervention to guide researchers in identifying appropriate implementation strategies and then selecting tailored support tools and actions for use when implementing a set of standards.MethodsOur intervention is a digital tool entitled ‘Selecting Implementation Tools and Actions for Standards (SITAS).’ The Medical Research Council Framework for Developing and Evaluating Complex Interventions guided the design of SITAS. Co-design of SITAS, using a multi-stage and multi-methods approach included developing programme theory; identifying and prioritising enablers and barriers to implementing standards; identifying the best fit implementation framework using the Theory Comparison and Selection Tool; mapping enablers and barriers to the Consolidated Framework for Implementation Research (CFIR); identifying matching implementation strategies using the CFIR-ERIC (Expert Recommendations for Implementing Change) matching tool; mapping enablers and barriers to the Behaviour Change Wheel (BCW). The enablers and barriers, outputs from the CFIR-ERIC matching tool and the BCW were used to develop a prototype of the content and interactive logic within a digital tool. The prototype was refined following feedback from intended users (n = 7) at three design workshops.ResultsProgramme theory was developed and refined following feedback from intended users of SITAS. Twenty-three enablers and barriers were prioritised. CFIR was identified as the best fit framework with the majority of enablers and barriers (n = 15) mapped to the ‘Inner Setting’ domain. ‘Conduct educational meetings’ was the most common strategy retrieved using the CFIR-ERIC matching tool. ‘Physical opportunity’ was the component of the BCW with the most enablers and barriers (n = 8). A prototype of SITAS was designed in Microsoft Excel based on the aforementioned steps. Workshops with intended users provided key insights about the content, functionality and user experience for SITAS which resulted in refinements to SITAS.ConclusionWe developed a practical intervention enhanced by user involvement. SITAS guides users through the process of selecting and tailoring implementation strategies to specific contexts, using core concepts of implementation science. SITAS will need to undergo formal piloting before spread and scale-up.Supplementary InformationThe online version contains supplementary material available at 10.1186/s12913-024-12075-9. Background Implementation science aims to translate evidence into everyday practice. Despite this aim, approximately 40% of service-users do not receive healthcare according to best evidence and 10% of service-users experience medical harm or adverse events globally [1–3]. The complexities of making change in real-world settings contributes to an implementation gap [4]. Moreover, the complexity of implementation science contributes to this gap. Researchers have referred to implementation science as a “Tower of Babel” ([5] p23) and a “dizzying array of information and recommendations” ([6] p27). This is not surprising considering there are over 100 Theories, Models and Frameworks (TMFs) in implementation science [7]. Furthermore, individual TMFs such as the updated Consolidated Framework for Implementation Research (CFIR) 2.0 presents 48 constructs and 19 sub constructs [8], the Expert Recommendations for Implementing Change (ERIC) taxonomy defines 73 implementation strategies [9] and Proctor’s Conceptual Framework for Implementation Outcomes presents 17 outcome domains [10]. All of these implementation concepts are for consideration when undertaking an implementation project. This complexity may explain why many organisations struggle with the ‘how to’ implement an intervention and resort to the ISLAGIATT principle (“It seemed like a good idea at the time”) ([4], p1010, [11] p74). Oxman et al. concluded from their research that there were “no magic bullets” ([12] p1427) for improving quality care, however, they believed that if available strategies were used appropriately, they could lead to quality improvements in healthcare [12]. Implementation strategies are defined as “methods or techniques used to enhance” adoption and implementation of a practice [13] and thus enables bridging of the evidence-to-practice gap. Strategies can be classified. For example, the developers of the ERIC implementation strategy compilation distinguish between discrete, multi-faceted and blended implementation strategies. Discrete strategies involve one process or action; multi-faceted involves two or more discrete strategies and blended involves a number of discrete strategies that address barriers at multiple levels [14]. Examples include education materials, audit and feedback, and champions [9, 15]. Tailoring implementation strategies enhances uptake of a practice and can occur at different stages in an implementation project. The goal of tailoring is to ensure that the implementation strategy is suitable for the intended users and services. For example, Lake et al. conducted an intervention mapping study to develop a psycho-educational resource (leaflet) to promote retinal screening uptake and tailored this resource to the needs of young adults with Type 2 Diabetes [16]. Young adults took part in pilot testing the leaflet and reported that the information had impact and would promote adoption of retinal screening among young adults [16]. Researchers have reported that organisations may have little knowledge and capacity to participate in implementation projects [4, 12]. Additionally, organisations may not have access to specialist implementation science expertise [17]. This lack of expertise can pose challenges in the decision-making process when factoring in the scientific evidence that will ultimately influence decisions on an implementation project. A qualitative explanatory study using a multiple case design examined the role of scientific evidence in decision-making with the adoption of innovations [18]. The authors found that decision-makers considered issues such as expected cost and operational implications, expected impact on service-users and equitable access to care, alongside the scientific evidence. Cost and financial constraints encompassed resources, training and operational needs. Study participants reported on competing priorities, for example, investing in one innovation would mean not providing resources to another innovation. Additionally, health systems internationally are challenged by limitations of resources. Guidance on how to prioritise implementation efforts is scarce [19] and thus poses challenges with decision-making on which implementation strategies to select [20]. The development of implementation strategies will have cost and resource implications. Therefore, it is necessary to provide a rigorous process underpinned by the evidence to justify the development of implementation strategies and associated costs and resource demands [18, 19] and to ensure that those selected are most likely to have a good fit with services where they are implemented [21]. Guidance exists to assist organisations and researchers with implementation science, however, they are usually non-interactive, academic and general in terms of their context [22]. It is noteworthy that there are problematic areas across the research relating to implementation strategies [23]. Pre-requisites when studying implementation strategies are to provide clear descriptions of their conceptualisation and how they will be operationalised [13, 24–26]. Researchers have reported difficulties in deciphering which implementation strategies were used from the literature. This in turn means, there is little information on their effectiveness and measures for replication of research in practice [13, 23, 26]. Researchers argue that implementation strategies are most likely altered during the implementation process and tracking these changes are not clear or rigorous. Additionally, descriptions of implementation strategies are inconsistent, lack operational definition and lack a clear theoretical and pragmatic justification on how the strategy was developed and applied [23]. Also, there is limited evidence to support the effectiveness of strategies, be they multi-faceted, a single-component strategy [23, 27] or tailored [23, 28]. Baker et al. conducted a systematic review of 32 studies to compare tailored interventions that address identified determinants with interventions not tailored to determinants [28]. They found that tailoring had only modest effects and there was insufficient evidence on effective approaches to tailoring interventions. Nonetheless, they concluded that interventions tailored to address identified barriers were more likely to enhance practice than no intervention [28]. Researchers have recommended applying theory when selecting implementation strategies to facilitate an understanding and explanation of how and why implementation is more likely to succeed [29, 30]. Applying theory to implementation strategies to specify their actions is important to learn and test the mechanisms through which the strategy has effect [21, 23, 31]. If there is no desired outcome supporting an implementation strategy, it is likely that a sub-optimal strategy will be selected and operationalised [32]. Additionally, a clearer understanding of causal mechanisms is important to learn how and when an implementation strategy affects implementation outcomes. Lewis et al. recommended conceptualising causal mechanisms as “proximal outcomes” in implementation. Proximal outcomes are described as direct, measurable and observable outputs of the implementation strategy that happen as a result of the specific actions and thus asks questions such as how will I know if the mechanisms for this strategy and the strategy itself have been effective? ([33] p5). Priority areas have been reported to enhance the impact of implementation strategies. These areas include enhancing methods for designing and tailoring; specify and test mechanisms of change; improve tracking and reporting [23]. As such, our research has been informed and guided by these priority areas. To reduce an evidence-to-practice gap, there is a need to link implementation strategies to enablers, barriers and contextual features using a systematic process that adopts theory and evidence, generates stakeholder feedback and participation and ensures replication for future practice [21, 24, 30]. Despite this need, there is a lack of guidance on selecting implementation strategies [34]. Health and social care standards are complex interventions. They are multi-faceted and require behaviours, expertise and skills from multiple stakeholders across multiple levels of the health system [35]. Health and social care standards (referred to as standards hereafter) target health and social care providers and thus apply to diverse settings. Their aim is to embed evidence-based, safe and high-quality care in services to promote consistency in care delivery; quality assurance; a shared understanding of what safe care looks like for service-users and service providers [35, 36]. The implementation of standards can vary across health systems. They can form part of an oversight process to support quality improvements or to enforce regulation, licensure, or private accreditation requirements [35, 37]. The implementation of standards can be enhanced when they are accompanied by implementation strategies. Powell et al. asserted that there were benefits to developing generalisable processes for designing and tailoring implementation strategies due to the heterogeneity of healthcare (clinical issues, interventions, settings, stakeholders and contextual factors) [23]. This heterogeneity is comparable to the implementation of standards given that standards involve multiple activities from stakeholders across multiple levels in the health system and apply to diverse settings. Implementation strategies selected to enhance the implementation of standards are inevitably complex. The inherent nature of standards is complex. As such, strategies for the implementation of standards will vary in scale, their target stakeholders and the settings in which they target. Therefore, the aim of this article was to describe the methodological development of an intervention drawing on existing evidence, theory and stakeholder involvement. Our intervention is entitled ‘Selecting Implementation Tools and Actions for Standards’ (SITAS). SITAS facilitates a systematic evidence- and theory-informed process that users can prospectively utilise to identify and select tailored support tools and support actions. The tailored support tools and actions will aim to leverage enablers and overcome barriers to implementing standards. It is anticipated that optimum implementation of standards is linked to safer, high-quality care in health systems and thus improved service-user outcomes and experiences. Methods Our aim was to co-design an innovative intervention (SITAS) that guides the user through key steps of implementation science when identifying and selecting support tools and actions. We applied one phase from the Medical Research Council (MRC) Framework for Developing and Evaluating Complex Interventions to this project; ‘Develop intervention’ [38]. Our project comprises four sequential stages using multiple methods such as a mixed research synthesis, qualitative descriptive design and implementation mapping, followed by a co-design approach (Fig. 1). A set of core elements are shared across the MRC framework: context; programme theory; engage stakeholders; identify key uncertainties; refine intervention; economic considerations. Cost analyses were outside the scope of this project so economic evaluations were not considered at this time. The remaining core elements informed research design and decision-making throughout the project with a strong focus placed on programme theory.Fig. 1Sequence of stages and outputs in developing an evidence- and theory-informed digital intervention. *FES: Frequency effect size †CERQual: Confidence in Evidence from Reviews of Qualitative research Sequence of stages and outputs in developing an evidence- and theory-informed digital intervention. *FES: Frequency effect size †CERQual: Confidence in Evidence from Reviews of Qualitative research Preliminary programme theory was developed from the outset, and this was subsequently refined as we progressed through each stage. This involved developing a preliminary set of “if–then” statements using the components: inputs; activities and mechanisms through which the intended outcomes are achieved; intended outputs; intended outcomes [39, 40]. These components were used to decipher what activities were intended to produce certain outcomes and what mechanisms were expected to produce these outcomes [24, 38–40]. These statements were subsequently presented to the research team (NOR, JH, LMK) at team meetings and then refined based on the team’s feedback during the development stage of SITAS. The programme theory was also used to enhance a shared understanding with workshop participants during the co-design stage when articulating the key components of SITAS. Additionally, key decisions were agreed and refinements were made to the programme theory following discussions at workshops to explicate the purpose of SITAS and the mechanisms through which the intended outcomes could be achieved (Table 1). Table 1Programme Theory for developing SITAS (Selecting Implementation Tools and Actions for Standards)InputsAccess to an intervention that would systematically guide the identification and selection of support tools and support actions that can help implement a specific set of national standardsActivities and mechanisms through which the intended outcomes are achievedif members of the standards development team have access to SITAS, then they will learn how to identify and select appropriate support tools and actions that target identified enablers and barriers for a specific context; if they identify and select appropriate support tools and actions, then they will have a better chance of addressing identified barriers to implementing a specific set of standards and adopting a systematic approach using evidence and theoryIntended outputs andIntended outcomesif members of the standards development team use the SITAS toolkit, then they will identify and select support tools and actions that are underpinned by evidence and theory; if they develop the support tools and undertake actions for application in practice, then the health and social care providers will perceive a more supportive context for using standards; if health and social care providers perceive a more supportive context for using standards in everyday practice, then implementation of national standards will have potential to improve; then it is anticipated that safer, higher-quality health and social care delivery will result Table 1Programme Theory for developing SITAS (Selecting Implementation Tools and Actions for Standards)InputsAccess to an intervention that would systematically guide the identification and selection of support tools and support actions that can help implement a specific set of national standardsActivities and mechanisms through which the intended outcomes are achievedif members of the standards development team have access to SITAS, then they will learn how to identify and select appropriate support tools and actions that target identified enablers and barriers for a specific context; if they identify and select appropriate support tools and actions, then they will have a better chance of addressing identified barriers to implementing a specific set of standards and adopting a systematic approach using evidence and theoryIntended outputs andIntended outcomesif members of the standards development team use the SITAS toolkit, then they will identify and select support tools and actions that are underpinned by evidence and theory; if they develop the support tools and undertake actions for application in practice, then the health and social care providers will perceive a more supportive context for using standards; if health and social care providers perceive a more supportive context for using standards in everyday practice, then implementation of national standards will have potential to improve; then it is anticipated that safer, higher-quality health and social care delivery will result Programme Theory for developing SITAS (Selecting Implementation Tools and Actions for Standards) Intended outputs and Intended outcomes The ‘Develop intervention’ phase of the MRC framework describes developing a new intervention based on research evidence and theory [38]. As such, our project began with gathering the evidence. Stage one was a systematic review and meta-summary (mixed research synthesis) that identified and described the most frequently reported enablers and barriers to implementing (inter)nationally endorsed standards [35]. These enablers and barriers were presented as thematic summaries, alongside their frequency effect size (a measurement of the prevalence of each enabler and barrier across the literature reporting enablers and barriers) [41] and CERQual (Confidence in Evidence from Reviews of Qualitative research) assessments (assessments of confidence in enablers and barriers) [42]. Stage two was a qualitative descriptive study which explored stakeholders' experiences of implementing nationally endorsed standards. These stakeholders worked at multiple levels in the health system in Ireland [43]. This qualitative study used reflexive thematic analysis to develop overarching codes that described enablers and barriers to implementing nationally endorsed standards. Stage three used a multi-step approach to construct SITAS using implementation theories and methodologies. Stage four was a co-design approach to refine SITAS using workshops. Stages one and two have been described previously in separate publications [35, 43]. This article reports on stages three and four. The resultant intervention is described and reported in line with the TIDieR (Template for Intervention Description and Replication) checklist (Additional file 1) [44]. Ethical considerations Ethical approval for the co-design stage of the project (Log 2022–183) was obtained on 3rd October 2022 from the Social Research and Ethics Committee, University College Cork in Ireland. Individuals who expressed an interest in taking part in workshops were given a ‘participant information sheet’ that detailed the research including data collection, processing, storage and consent. Participation was voluntary. Informed written consent to take part in the workshops and for publication of the research outputs, was obtained from participants. Study context This study took place in Ireland. Standard-setting bodies in Ireland can be statutory authorities with responsibility to develop national standards and guidance, based on evidence and international best practice, for health and social care services. Some standard-setting bodies develop implementation support tools as a source of information and materials to support the implementation of the standards. Study participants were adults employed in a standard-setting body and involved in developing national standards for health and social care services and/or developing implementation support tools to support the implementation of these standards. The lead researcher (YK) contacted potential participants with permission from senior management, using the staffing list and internal communications email, to invite participants to take part in this study. The following sections describe the methods for stages three and four of this research project. Stage 3: A multi-step approach to construct a digital tool A description of stage three is presented in Table 2. We collated the enablers and barriers identified from the literature (stages one and two). Thematic statements describing enablers and barriers were reviewed and prioritised for inclusion in the digital tool (Additional file 2). The Consolidated Framework for Implementation Research (CFIR) was assessed as the best fit framework using the Dissemination and Implementation Models in Health Research and Practice web tool [45] and The Theory Comparison and Selection Tool (T-CaST) [46] (Additional file 3). Table 2 Description of stage three to construct a prototype of a digital tool using implementation science methodologiesStage 3MethodsOutputs3a. Collate, compare and contrast enablers and barriers to implementing standards.a▪ Thematic statements describing enablers (n = 22) plus FESb and CERQualc assessments▪ Thematic statements describing barriers (n = 24) plus FES and CERQual assessments▪ Overarching codes describing enablers (n = 15)▪ Overarching codes describing barriers (n = 10)Criteria for prioritising enablers and barriers for inclusion were:▪ FES > 10%▪ Moderate or high CERQual assessment▪ Irish context▪ Feasible to addressEnablers and barriers were reviewed for duplication and similarities with underlying meaning. Enablers and barriers were then edited for accessibility.Enablers and barriers excluded (n = 11) based on the following:▪ FES < 10%, low CERQual assessment (n = 5)▪ Not feasible to address (n = 6): pertained to legislation (n = 2); inspection framework (n = 2); service level activities (n = 2)Some enablers and barriers described similar factors. For example, an enabler was the presence or enactment of a factor (for example, recruitment and availability of staff) and the barrier was an absence of the factor (for example, staffing constraints). In this instance, a thematic statement was created to reflect the essence of the enabler and barrier, translating it to an influencing factor that could act as an enabler or barrier.In total, thematic statements (n = 23) were created to describe influencing factors (enablers and/or barriers) to implementing standards (Additional file 2).3b. Select an appropriate Theory, Model or Framework (TMF)An interactive web tool, Dissemination and Implementation Models in Health Research and Practice was used [45]. This web tool contained a list of 112 TMFs.d A search of potentially relevant TMFs was conducted on Octobers 20, 2021. TMFs were selected based on the following criteria:▪ The TMF had a focus on implementation only (I-only) or had more focus on implementation than dissemination (I > D)▪ The TMF operated at all socio-ecologists levels; individual, organisation, community, system and policy level▪ The TMF originated from studies pertaining to health services, healthcare and patient safetyThe Theory Comparison and Selection Tool (T-CaST) was used to complement the decision-making on ‘degree of fit’ for TMFs retrieved from the web tool. The T-CaST included an assessment of a TMF under its characteristics of usability, validity, applicability and acceptability [46].TMFs (n = 2) selected, the Consolidated Framework for Implementation Research (CFIR) [47] and the Dynamic Sustainability Framework (DSF) [48]The T-CAST tool was applied and CFIR was determined as the best fit framework (Additional file 3).3c. Map enablers and barriers to a TMFThematic statements (enablers and/or barriers) (n = 23) created in step 3a were coded to the CFIR domains and constructs by two researchers independently, between May–September 2022. Coding was based on similarity of the thematic statement to the names and definitions of the CFIR constructs.An inter-coder agreement measurement was calculated.Of the 39 CFIR constructs, 18 constructs including sub-constructs were matched with thematic statements (Additional file 4). Thematic statements were coded to the;‘Inner Setting’ domain (n = 15): structural characteristics (n = 1); networks and communications (n = 2); culture (n = 1); readiness for implementation (access to knowledge and information, n = 4, available resources, n = 3, leadership engagement, n = 1); organisational incentives and rewards (n = 2); goals and feedback (n = 1)‘Intervention Characteristics’ domain (n = 6): evidence strength and quality (n = 2); adaptability (n = 1); design quality and packaging (n = 1); cost (n = 1); intervention source (n = 1)‘Outer Setting’ domain (n = 4): patient needs and resources (n = 1); external policy and incentives (n = 2); cosmopolitanism (n = 1)‘Process’ domain (n = 4): engaging (reflecting and evaluating, n = 1; formally appointed internal implementation leaders / champions, n = 3)Thematic statements that were coded to the Inner Setting domain (n = 5) were also relevant to the Outer Setting (n = 2), Intervention characteristics (n = 1) and Process domains (n = 2)The inter-coder agreement was calculated at 86%.3d. Identify matching implementation strategiesThe CFIR-ERICe Matching Tool v.1 was used to match thematic statements to expert-endorsed implementation strategies [34] and was conducted by two researchers independently. The constructs of the CFIR identified in step 3c, were used to select strategies drawn from the ERIC list of strategies in the CFIR-ERIC Matching Tool. Strategies categorised as ‘level 1 strategies’ in the tool were selected (endorsed by 50% of expert panel members as more likely to be effective in addressing the corresponding CFIR constructs [34]). If the corresponding strategies were endorsed by less than 50% of the expert panel, the top strategy endorsed as likely to be effective was selected. This comprised ‘level 2 strategies’ (endorsed by 20–50% of expert panel members [34]).Implementation strategies (n = 40) were selected. ‘Conduct educational meetings’ was the most common strategy retrieved (n = 7), followed by ‘identify and prepare champions’ (n = 6) (Additional file 4).3e. Identify implementation strategy function using behaviour change theoryThematic statements created in step 3a were coded to the COM-Bf model. The outputs were then matched with the Behaviour Change Wheel intervention types. Two researchers independently conducted the coding. An inter-coder agreement measurement was calculated.Thematic statements were coded to ‘physical opportunity’ (n = 8), ‘psychological capability’ (n = 5), ‘social opportunity’ (n = 5), ‘reflective motivation’ (n = 3), ‘automatic motivation’ (n = 2) (Additional file 4)The inter-coder agreement was calculated at 82%.3f. Construct a prototype of a digital toolMethodologies and outputs from steps 3a, 3c-3e were inserted into a Microsoft Excel workbook. A list of support tools and actions was compiled. Support tools and actions were matched to the list of implementation strategies and their target end-users.A prototype of the content and interactive logic within a digital interactive tool was developed.aEnablers and barriers were sourced from stages 1 [35] and 2 [43]bFES: Frequency effect sizecCERQual: Confidence in Evidence from Reviews of Qualitative researchdTMFs: Theory, Model, FrameworkseERIC: Expert Recommendations for Implementing ChangefCOM-B: Capability, Opportunity, Motivation-Behaviour Table 2 Description of stage three to construct a prototype of a digital tool using implementation science methodologiesStage 3MethodsOutputs3a. Collate, compare and contrast enablers and barriers to implementing standards.a▪ Thematic statements describing enablers (n = 22) plus FESb and CERQualc assessments▪ Thematic statements describing barriers (n = 24) plus FES and CERQual assessments▪ Overarching codes describing enablers (n = 15)▪ Overarching codes describing barriers (n = 10)Criteria for prioritising enablers and barriers for inclusion were:▪ FES > 10%▪ Moderate or high CERQual assessment▪ Irish context▪ Feasible to addressEnablers and barriers were reviewed for duplication and similarities with underlying meaning. Enablers and barriers were then edited for accessibility.Enablers and barriers excluded (n = 11) based on the following:▪ FES < 10%, low CERQual assessment (n = 5)▪ Not feasible to address (n = 6): pertained to legislation (n = 2); inspection framework (n = 2); service level activities (n = 2)Some enablers and barriers described similar factors. For example, an enabler was the presence or enactment of a factor (for example, recruitment and availability of staff) and the barrier was an absence of the factor (for example, staffing constraints). In this instance, a thematic statement was created to reflect the essence of the enabler and barrier, translating it to an influencing factor that could act as an enabler or barrier.In total, thematic statements (n = 23) were created to describe influencing factors (enablers and/or barriers) to implementing standards (Additional file 2).3b. Select an appropriate Theory, Model or Framework (TMF)An interactive web tool, Dissemination and Implementation Models in Health Research and Practice was used [45]. This web tool contained a list of 112 TMFs.d A search of potentially relevant TMFs was conducted on Octobers 20, 2021. TMFs were selected based on the following criteria:▪ The TMF had a focus on implementation only (I-only) or had more focus on implementation than dissemination (I > D)▪ The TMF operated at all socio-ecologists levels; individual, organisation, community, system and policy level▪ The TMF originated from studies pertaining to health services, healthcare and patient safetyThe Theory Comparison and Selection Tool (T-CaST) was used to complement the decision-making on ‘degree of fit’ for TMFs retrieved from the web tool. The T-CaST included an assessment of a TMF under its characteristics of usability, validity, applicability and acceptability [46].TMFs (n = 2) selected, the Consolidated Framework for Implementation Research (CFIR) [47] and the Dynamic Sustainability Framework (DSF) [48]The T-CAST tool was applied and CFIR was determined as the best fit framework (Additional file 3).3c. Map enablers and barriers to a TMFThematic statements (enablers and/or barriers) (n = 23) created in step 3a were coded to the CFIR domains and constructs by two researchers independently, between May–September 2022. Coding was based on similarity of the thematic statement to the names and definitions of the CFIR constructs.An inter-coder agreement measurement was calculated.Of the 39 CFIR constructs, 18 constructs including sub-constructs were matched with thematic statements (Additional file 4). Thematic statements were coded to the;‘Inner Setting’ domain (n = 15): structural characteristics (n = 1); networks and communications (n = 2); culture (n = 1); readiness for implementation (access to knowledge and information, n = 4, available resources, n = 3, leadership engagement, n = 1); organisational incentives and rewards (n = 2); goals and feedback (n = 1)‘Intervention Characteristics’ domain (n = 6): evidence strength and quality (n = 2); adaptability (n = 1); design quality and packaging (n = 1); cost (n = 1); intervention source (n = 1)‘Outer Setting’ domain (n = 4): patient needs and resources (n = 1); external policy and incentives (n = 2); cosmopolitanism (n = 1)‘Process’ domain (n = 4): engaging (reflecting and evaluating, n = 1; formally appointed internal implementation leaders / champions, n = 3)Thematic statements that were coded to the Inner Setting domain (n = 5) were also relevant to the Outer Setting (n = 2), Intervention characteristics (n = 1) and Process domains (n = 2)The inter-coder agreement was calculated at 86%.3d. Identify matching implementation strategiesThe CFIR-ERICe Matching Tool v.1 was used to match thematic statements to expert-endorsed implementation strategies [34] and was conducted by two researchers independently. The constructs of the CFIR identified in step 3c, were used to select strategies drawn from the ERIC list of strategies in the CFIR-ERIC Matching Tool. Strategies categorised as ‘level 1 strategies’ in the tool were selected (endorsed by 50% of expert panel members as more likely to be effective in addressing the corresponding CFIR constructs [34]). If the corresponding strategies were endorsed by less than 50% of the expert panel, the top strategy endorsed as likely to be effective was selected. This comprised ‘level 2 strategies’ (endorsed by 20–50% of expert panel members [34]).Implementation strategies (n = 40) were selected. ‘Conduct educational meetings’ was the most common strategy retrieved (n = 7), followed by ‘identify and prepare champions’ (n = 6) (Additional file 4).3e. Identify implementation strategy function using behaviour change theoryThematic statements created in step 3a were coded to the COM-Bf model. The outputs were then matched with the Behaviour Change Wheel intervention types. Two researchers independently conducted the coding. An inter-coder agreement measurement was calculated.Thematic statements were coded to ‘physical opportunity’ (n = 8), ‘psychological capability’ (n = 5), ‘social opportunity’ (n = 5), ‘reflective motivation’ (n = 3), ‘automatic motivation’ (n = 2) (Additional file 4)The inter-coder agreement was calculated at 82%.3f. Construct a prototype of a digital toolMethodologies and outputs from steps 3a, 3c-3e were inserted into a Microsoft Excel workbook. A list of support tools and actions was compiled. Support tools and actions were matched to the list of implementation strategies and their target end-users.A prototype of the content and interactive logic within a digital interactive tool was developed.aEnablers and barriers were sourced from stages 1 [35] and 2 [43]bFES: Frequency effect sizecCERQual: Confidence in Evidence from Reviews of Qualitative researchdTMFs: Theory, Model, FrameworkseERIC: Expert Recommendations for Implementing ChangefCOM-B: Capability, Opportunity, Motivation-Behaviour Description of stage three to construct a prototype of a digital tool using implementation science methodologies ▪ Thematic statements describing enablers (n = 22) plus FESb and CERQualc assessments ▪ Thematic statements describing barriers (n = 24) plus FES and CERQual assessments ▪ Overarching codes describing enablers (n = 15) ▪ Overarching codes describing barriers (n = 10) Criteria for prioritising enablers and barriers for inclusion were: ▪ FES > 10% ▪ Moderate or high CERQual assessment ▪ Irish context ▪ Feasible to address Enablers and barriers were reviewed for duplication and similarities with underlying meaning. Enablers and barriers were then edited for accessibility. Enablers and barriers excluded (n = 11) based on the following: ▪ FES < 10%, low CERQual assessment (n = 5) ▪ Not feasible to address (n = 6): pertained to legislation (n = 2); inspection framework (n = 2); service level activities (n = 2) Some enablers and barriers described similar factors. For example, an enabler was the presence or enactment of a factor (for example, recruitment and availability of staff) and the barrier was an absence of the factor (for example, staffing constraints). In this instance, a thematic statement was created to reflect the essence of the enabler and barrier, translating it to an influencing factor that could act as an enabler or barrier. In total, thematic statements (n = 23) were created to describe influencing factors (enablers and/or barriers) to implementing standards (Additional file 2). An interactive web tool, Dissemination and Implementation Models in Health Research and Practice was used [45]. This web tool contained a list of 112 TMFs.d A search of potentially relevant TMFs was conducted on Octobers 20, 2021. TMFs were selected based on the following criteria: ▪ The TMF had a focus on implementation only (I-only) or had more focus on implementation than dissemination (I > D) ▪ The TMF operated at all socio-ecologists levels; individual, organisation, community, system and policy level ▪ The TMF originated from studies pertaining to health services, healthcare and patient safety The Theory Comparison and Selection Tool (T-CaST) was used to complement the decision-making on ‘degree of fit’ for TMFs retrieved from the web tool. The T-CaST included an assessment of a TMF under its characteristics of usability, validity, applicability and acceptability [46]. TMFs (n = 2) selected, the Consolidated Framework for Implementation Research (CFIR) [47] and the Dynamic Sustainability Framework (DSF) [48] The T-CAST tool was applied and CFIR was determined as the best fit framework (Additional file 3). Thematic statements (enablers and/or barriers) (n = 23) created in step 3a were coded to the CFIR domains and constructs by two researchers independently, between May–September 2022. Coding was based on similarity of the thematic statement to the names and definitions of the CFIR constructs. An inter-coder agreement measurement was calculated. Of the 39 CFIR constructs, 18 constructs including sub-constructs were matched with thematic statements (Additional file 4). Thematic statements were coded to the; ‘Inner Setting’ domain (n = 15): structural characteristics (n = 1); networks and communications (n = 2); culture (n = 1); readiness for implementation (access to knowledge and information, n = 4, available resources, n = 3, leadership engagement, n = 1); organisational incentives and rewards (n = 2); goals and feedback (n = 1) ‘Intervention Characteristics’ domain (n = 6): evidence strength and quality (n = 2); adaptability (n = 1); design quality and packaging (n = 1); cost (n = 1); intervention source (n = 1) ‘Outer Setting’ domain (n = 4): patient needs and resources (n = 1); external policy and incentives (n = 2); cosmopolitanism (n = 1) ‘Process’ domain (n = 4): engaging (reflecting and evaluating, n = 1; formally appointed internal implementation leaders / champions, n = 3) Thematic statements that were coded to the Inner Setting domain (n = 5) were also relevant to the Outer Setting (n = 2), Intervention characteristics (n = 1) and Process domains (n = 2) The inter-coder agreement was calculated at 86%. Thematic statements were coded to ‘physical opportunity’ (n = 8), ‘psychological capability’ (n = 5), ‘social opportunity’ (n = 5), ‘reflective motivation’ (n = 3), ‘automatic motivation’ (n = 2) (Additional file 4) The inter-coder agreement was calculated at 82%. aEnablers and barriers were sourced from stages 1 [35] and 2 [43] bFES: Frequency effect size cCERQual: Confidence in Evidence from Reviews of Qualitative research dTMFs: Theory, Model, Frameworks eERIC: Expert Recommendations for Implementing Change fCOM-B: Capability, Opportunity, Motivation-Behaviour Thematic statements were applied to the domains and constructs of the CFIR. The CFIR-ERIC (Expert Recommendations for Implementing Change) Implementation Strategy Matching Tool v.1 was used to generate a list of expert-endorsed implementation strategies to consider, to address a barrier or leverage an enabler [34], that was previously coded to the CFIR constructs (Additional file 4). The Behaviour Change Wheel (BCW) was applied to understand the “causal pathways” through which an implementation strategy works [49]. This was to maximise the effectiveness of selected implementation strategies [33, 50]. The BCW is made up of three layers. Two layers of the BCW were used to identify targeted behaviours and then determine the function of an appropriate implementation strategy. The inner layer of the BCW is the COM-B model that outlines the necessary conditions for behaviour to occur. They are capability (C), opportunity (O), and motivation (M), all of which interact to generate behaviour and each have influence over each other [50]. The second layer concentrates on nine intervention types. These are education, persuasion, incentivisation, coercion, training, enablement, modelling, environmental restructuring, and restriction [50]. This classification broadly sets out how the strategy can change a behaviour. Thematic statements describing enablers and barriers (identified previously) were coded to the COM-B components and then matched with corresponding intervention types (Additional file 4). Two researchers (YK, JG) independently conducted all coding activities. A third independent researcher (NOR) conducted the coding where a disagreement occurred. Discrepancies were discussed and resolved. An inter-coder agreement measurement was calculated by dividing the number of coding agreements by the total number of thematic statements coded. A prototype of SITAS was designed by firstly creating worksheets in Microsoft Excel with the content for each step of SITAS and then matching content from each step with subsequent steps using implementation science methodologies and outputs as described in Table 2. These worksheets included steps that described: enablers and barriers to implementing standards; corresponding implementation strategies for enablers and barriers; implementation strategy function; target end-users for implementation strategy; recommended support tools and support actions. The lead researcher (YK) compiled a list of support tools and actions and this list was cross-checked by NOR and LMK. This list was generic to ensure generalisability and scalability to a wide range of health and social care services. Support tools and actions were then matched with the list of implementation strategies and their target end-users. The steps of SITAS were converted into a mode of transmission with coding behind it, based on SITAS’s interactive logic. The main purpose was that SITAS designated and displayed corresponding recommendations and actions back to the user based on the user’s input. Stage 4: A co-design approach to refine the digital tool Co-design is described as an approach to bringing stakeholders together to plan, design and produce solutions in partnership, and thus creates reciprocal relationships [51]. Our aim was to co-design a digital tool by involving end-users and valuing their knowledge, experiences and contributions to create an intervention that was fit for purpose. Purposive sampling was used to recruit participants to take part in co-design workshops. Sampling was based on a set of criteria, mainly that participants were employed in the Irish standard-setting body, working on a standards development team, actively involved in the development of national health and social care standards and or supporting the implementation of these standards. These criteria were based on the fact that the standards development team were the intended users of SITAS; the content of SITAS was informed by the evidence on the implementation of national standards; and an overall aim to support implementation of national standards. Potential participants were invited to take part in workshops by email. Participants completed a demographic questionnaire which asked questions on their role and years of experience developing standards and supporting the implementation of standards. Twelve individuals were invited to take part in the workshops as this was the total number of individuals working on the standards development team at the time of recruitment. We aimed to have an open discussion during the workshops among end-users about SITAS and obtain feedback on refinements required prior to formal piloting. In advance of the workshops, participants received an information pack containing the prototype of SITAS and details on how the tool was developed, and some questions to expect at the workshops. Three workshops were conducted using the Microsoft (MS) Teams platform [52] from January to March 2023 and were facilitated by YK. There were six participants in each workshop and each lasted 60–90 min. Workshops were audio-recorded with consent from participants. Recordings were transcribed using the MS Teams auto-transcription feature. Transcripts were reviewed by YK to capture all key information and decisions when writing notes and, as an objective check on participants’ views and suggestions. SITAS evolved in line with the co-design approach, as such, participants received an updated version of the digital tool and were asked to test the digital tool prior to each workshop. As much as possible, the same group of participants attended each workshop so that ongoing ideas were generated and expanded on during each workshop. Each workshop built on one another. The first workshop began with an overview of the research, programme theory and a demonstration of SITAS. Each workshop was structured according to three phases. The aim of phase one was to critique SITAS by assessing understandability, comprehensiveness and content clarity, and various steps and components of SITAS. Examples of questions asked were: Does the tool make sense? Is there anything missing? Is the language appropriate? Are the steps well integrated? Are there navigational issues? The aim of phase two was to find solutions to any issues identified. The aim of phase three was to seek agreement on refinements to SITAS and programme theory. Workshop notes were shared with the participants by email after each workshop to ensure they accurately reflected discussions. There was no formal analysis of the workshop notes, but, they were carefully examined and feedback was aggregated so it could be applied to the prototype. Results Stage 3: A multi-step approach to construct a digital tool A prototype of the content and interactive logic within a digital tool was developed. The prototype was a digitally supported intervention to guide the identification and selection of implementation support tools and actions (SITAS). Stage 4: A co-design approach to refine the digital tool Three workshops were conducted and six participants attended each workshop, with a total sample of seven participants. The final response rate was 58% (7/12). A sample of seven participants was justified because these participants were most likely representative of end-users for SITAS given their positions working on the standards development team. Of the seven participants, four (57%) were research officers and three (43%) were standards development managers. Due to the small sample size and to protect study participants’ anonymity, exact job titles, for example, ‘programme manager’ and ‘project lead’ were referred to as ‘standards development managers.’ The majority had zero to four years’ experience developing standards and supporting the implementation of health and social care standards (n = 5, 71%), the remainder had five to ten years’ experience (n = 2, 29%) (Table 3). Table 3Workshop participants’ characteristics to co-design SITAS (Selecting Implementation Tools and Actions for Standards)Gendern (%) Female7(100)Role in developing health and social care standards Standards Development Officer/ Research Officer4 (57) Standards Development Manager3(43)Years’ experience developing health and social care standards and supporting the implementation of health and social care standards 0–4 years5(71) 5–10 years2(29) Table 3Workshop participants’ characteristics to co-design SITAS (Selecting Implementation Tools and Actions for Standards)Gendern (%) Female7(100)Role in developing health and social care standards Standards Development Officer/ Research Officer4 (57) Standards Development Manager3(43)Years’ experience developing health and social care standards and supporting the implementation of health and social care standards 0–4 years5(71) 5–10 years2(29) Workshop participants’ characteristics to co-design SITAS (Selecting Implementation Tools and Actions for Standards) The workshop participants reflected on the prototype and then generated ideas to improve SITAS. A theme from discussions on content clarity related to an understanding of the language used in implementation science. Participants reported that the behaviour change intervention types and list of implementation strategies in the digital tool may be challenging to understand for users who are not familiar with these concepts. Furthermore, participants reported that terminology used in some definitions of implementation strategies were not relatable to an Irish context. As such, refinements were made to ensure accessibility and relatability (Additional file 5). The list of end-users for support tools and actions was reviewed and additional stakeholder groups were included. A second theme that emerged related to a coherent ‘step-by-step’ pattern. Participants suggested changing the order of steps within SITAS and agreed that the end-users of the support tools and the behavior change intervention function types should be identified prior to selecting implementation strategies. Discussions during workshops included situations where the user may not have identified certain enablers and barriers as listed because this had already been determined by the stage of the project. Participants agreed that an option ‘I don’t know’ should be included alongside the Likert scale to select influencing factors relative to an implementation project. Participants highlighted a need for a guidance document to supplement SITAS, to enhance its usability. Participants suggested that a guidance document should include: a rationale for the digital tool; how and when the digital tool links in with the standards development process; an explanation of components making up the digital tool; guidance regarding the application of the digital tool and its limitations. In addition, participants noted that the first page of SITAS should include instructions and make reference to the guidance document. It was agreed at the workshops that SITAS should be used at different stages throughout the standards development process to account for the extent to which enablers and barriers can fluctuate throughout an implementation project. Participants suggested improvements to design features within SITAS. These included: locking main features to avoid accidental editing or deletion; increasing font size and cells; applying a colour coding system to distinguish support tools and support actions. The output: SITAS (Selecting Implementation Tools and Actions for Standards) toolkit The output from the workshops was the SITAS (Selecting Implementation Tools and Actions for Standards) toolkit. SITAS toolkit is a “blended strategy” comprising a number of implementation strategies with different components that address determinants at multiple levels and is packaged as a broad implementation intervention [14]. Proctor’s fundamental principles for naming, defining and specifying an implementation strategy were applied, alongside the programme theory to aid conceptual clarity and to increase an understanding of how, when, why, and where the SITAS toolkit is likely to be effective (Table 4) [13]. The Effective Practice and Organisation of Care (EPOC) taxonomy was used as this contained the strategy “local consensus processes” which was deemed the most suitable terminology to name the SITAS toolkit [15]. Table 4Naming, defining, specifying SITAS (Selecting Implementation Tools and Actions for Standards) using Proctor’s fundamental principles [13]Name it:Local consensus processes [15]Define it:“Formal or informal local consensus processes” (EPOC) [15]Specify it:An intervention designed to guide decision-making in identifying and selecting appropriate support tools and actions that have potential to promote the implementation of a specific set of national standards. The intervention is presented to users as a toolkit containing a guidance document and a digital tool. The digital tool is an excel file containing a digital interactive flow of questions and answers. The toolkit will be stored and accessed on a local document management and storage system on the standard-setting body’s website until it is accepted for open-access publication.The digital tool has the following features and functions (Additional files 6 and 7):▪ The user identifies if statements are describing an enabler or barrier to implementing the set of standards they are developing, using a 5-point Likert scale with responses from ‘Definitely’ to ‘Definitely not’. Users also have an option of ‘I don’t know.’▪ A list of target end-users that the user must select from. Target end-users are the individuals who will be using the support tool or who the support action is aimed at.▪ A list of targeted behaviour change intervention types, followed by the top ten corresponding implementation strategies that are arranged in order of priority according to the responses to statements describing enablers and barriers. The tool includes 40 implementation strategies, each with a clear definition but only the top ten will be displayed. Careful attention is required to ensure congruence between choice of implementation strategy and behavioural change interventions selected [50, 53].▪ Finally, a list of support tools and actions that can be developed or undertaken, is produced based on previous responses.a) Actor: Research team with responsibility to develop national standardsb) Action: Apply SITAS throughout key stages of the standards development processc) Action Target: Refer to Table 1 (programme theory)d) Temporality: SITAS will be used prospectivelye) Dose: SITAS will be used as required over 18–24 months (project timeline for developing national standards and implementation support tools)f) Implementation outcomes: Appropriateness, acceptability, feasibility, adoption, fidelity of SITASJustification: Implementation Scientists recommend adopting a systematic approach to selecting implementation strategies informed by theory and evidence and to apply conceptual clarity and terminological consistency throughout the process. To provide knowledge and a rationale for decision-making when selecting support tools and actions that will require time, cost and human resources Table 4Naming, defining, specifying SITAS (Selecting Implementation Tools and Actions for Standards) using Proctor’s fundamental principles [13]Name it:Local consensus processes [15]Define it:“Formal or informal local consensus processes” (EPOC) [15]Specify it:An intervention designed to guide decision-making in identifying and selecting appropriate support tools and actions that have potential to promote the implementation of a specific set of national standards. The intervention is presented to users as a toolkit containing a guidance document and a digital tool. The digital tool is an excel file containing a digital interactive flow of questions and answers. The toolkit will be stored and accessed on a local document management and storage system on the standard-setting body’s website until it is accepted for open-access publication.The digital tool has the following features and functions (Additional files 6 and 7):▪ The user identifies if statements are describing an enabler or barrier to implementing the set of standards they are developing, using a 5-point Likert scale with responses from ‘Definitely’ to ‘Definitely not’. Users also have an option of ‘I don’t know.’▪ A list of target end-users that the user must select from. Target end-users are the individuals who will be using the support tool or who the support action is aimed at.▪ A list of targeted behaviour change intervention types, followed by the top ten corresponding implementation strategies that are arranged in order of priority according to the responses to statements describing enablers and barriers. The tool includes 40 implementation strategies, each with a clear definition but only the top ten will be displayed. Careful attention is required to ensure congruence between choice of implementation strategy and behavioural change interventions selected [50, 53].▪ Finally, a list of support tools and actions that can be developed or undertaken, is produced based on previous responses.a) Actor: Research team with responsibility to develop national standardsb) Action: Apply SITAS throughout key stages of the standards development processc) Action Target: Refer to Table 1 (programme theory)d) Temporality: SITAS will be used prospectivelye) Dose: SITAS will be used as required over 18–24 months (project timeline for developing national standards and implementation support tools)f) Implementation outcomes: Appropriateness, acceptability, feasibility, adoption, fidelity of SITASJustification: Implementation Scientists recommend adopting a systematic approach to selecting implementation strategies informed by theory and evidence and to apply conceptual clarity and terminological consistency throughout the process. To provide knowledge and a rationale for decision-making when selecting support tools and actions that will require time, cost and human resources Naming, defining, specifying SITAS (Selecting Implementation Tools and Actions for Standards) using Proctor’s fundamental principles [13] An intervention designed to guide decision-making in identifying and selecting appropriate support tools and actions that have potential to promote the implementation of a specific set of national standards. The intervention is presented to users as a toolkit containing a guidance document and a digital tool. The digital tool is an excel file containing a digital interactive flow of questions and answers. The toolkit will be stored and accessed on a local document management and storage system on the standard-setting body’s website until it is accepted for open-access publication. The digital tool has the following features and functions (Additional files 6 and 7): ▪ The user identifies if statements are describing an enabler or barrier to implementing the set of standards they are developing, using a 5-point Likert scale with responses from ‘Definitely’ to ‘Definitely not’. Users also have an option of ‘I don’t know.’ ▪ A list of target end-users that the user must select from. Target end-users are the individuals who will be using the support tool or who the support action is aimed at. ▪ A list of targeted behaviour change intervention types, followed by the top ten corresponding implementation strategies that are arranged in order of priority according to the responses to statements describing enablers and barriers. The tool includes 40 implementation strategies, each with a clear definition but only the top ten will be displayed. Careful attention is required to ensure congruence between choice of implementation strategy and behavioural change interventions selected [50, 53]. ▪ Finally, a list of support tools and actions that can be developed or undertaken, is produced based on previous responses. a) Actor: Research team with responsibility to develop national standards b) Action: Apply SITAS throughout key stages of the standards development process c) Action Target: Refer to Table 1 (programme theory) d) Temporality: SITAS will be used prospectively e) Dose: SITAS will be used as required over 18–24 months (project timeline for developing national standards and implementation support tools) f) Implementation outcomes: Appropriateness, acceptability, feasibility, adoption, fidelity of SITAS Justification: Implementation Scientists recommend adopting a systematic approach to selecting implementation strategies informed by theory and evidence and to apply conceptual clarity and terminological consistency throughout the process. To provide knowledge and a rationale for decision-making when selecting support tools and actions that will require time, cost and human resources Discussion This study illustrates the application of evidence, theory and stakeholder involvement to develop a digitally supported intervention that will guide users in identifying and selecting support tools and actions to enhance the implementation of national standards in practice. This illustration presents a systematic and explicit approach to integrating the core elements of implementation science and thus addresses reported challenges that inhibit guidance and replication in research [13, 26]. A list of influencing factors to implementing standards was retrieved from the international and Irish contexts and thus provides a broad range of enablers and barriers. These enablers and barriers were collated and then a series of empirically informed key steps were undertaken to prioritise them for inclusion in SITAS against a set of criteria. There is limited research on how best to prioritise enablers and barriers that influence the implementation process [19, 23]. As such, a unique and robust approach to prioritising enablers and barriers was taken when developing SITAS. Prioritisation was based on: the quality of the evidence reporting the enablers and barriers; how frequently the enablers and barriers were reported in the literature; and their application in an Irish context. For inclusion in SITAS, a non-binary approach was taken when addressing enablers and barriers, so enablers and barriers were conceptualised as a “continuum of influence” ([54], p92). This was to capture the potential impact of all enablers and barriers, and to account for the dynamic nature of the implementation process [54]. The majority of influencing factors describing enablers and barriers were mapped to the “inner setting” domain of the CFIR. This underscores the role of organisational characteristics in influencing the standards implementation process. Organisational characteristics included time, resources, knowledge and skills. These findings are similar to previous research that examined influencing factors to implementing clinical guidelines [55–57], evidence-based practices [58, 59] and health policies [60, 61]. The application of the MRC framework provided a structured guidance for developing the SITAS toolkit. A scoping review that explored how intervention development frameworks were used in order to inform rehabilitation interventions reported that the MRC guidance was the most commonly used framework across 35 studies [62]. Notably, this review found that studies using the MRC guidance provided more details about the elements of intervention development compared to studies using other frameworks [62]. The recently updated MRC framework recommends a comprehensive approach to incorporating theory into intervention development, with a strong focus on programme theory throughout its core elements [38]. Conversely, implementation science has been criticised for concentrating on theoretical rigour and not the practical and contextual features of implementation [63, 64]. However, the application of programme theory while developing SITAS not only enhanced theoretical rigour but stimulated a pragmatic approach whereby implicit ideas were made explicit through discussions with the research team and intended users of SITAS during co-design workshops and thus was key to characterising the components of SITAS [40]. SITAS is underpinned by a number of highly-influential theories (MRC framework [38], CFIR [47], BCW [49]). These theories guided the process, facilitated the identification of factors influencing implementation and guided the selection of implementation strategies. Despite the widespread endorsement for theory in implementation science, there are persistent reports of ineffective and superficial use of theory [29, 40, 46]. This has been attributed to a plethora of TMFs existing in the literature, variations in terminology [29, 46] and individuals perceiving theory as intimidating, inaccessible and irrelevant [40, 64]. Furthermore, theory has been selected based on convenience, previous exposures or haphazard decisions [7, 46]. Findings from a survey study reported little consensus among implementation scientists (n = 212) on which criteria were important when selecting a theory and thus reflected a lack of clarity in selecting a theory [7]. Researchers have called for “pragmatic research” that may involve: refining implementation science theory; creating general knowledge in community partnerships; meaningful collaborations; creating tools to assist in identifying, developing implementation strategies; considering mechanisms through which implementation strategies operate [65]. The SITAS toolkit encompasses all of these. The co-design workshops with end-users facilitated practical knowledge on ensuring SITAS was fit for purpose, for example, learning to practically apply the digital tool using accessible language. Other researchers have also found the involvement of professionals in decision-making provided opportunities for user buy-in, resource mobilisation and decision-making that was compatible with the real-world context [66–68]. Interestingly, a study that examined the alignment of experience-based intuition and theory to match implementation strategies with identified barriers found that only 20% of the intuitively selected strategies aligned with those selected using theory [69]. Developers of complex interventions have reported inconsistencies between the evidence (“formal, explicit knowledge”) and the opinions of stakeholders (“tacit, experiential knowledge”) [70]. Researchers need to be cognisant of potential tensions arising from integrating evidence, theory and stakeholder involvement. However, there is limited guidance about how best to manage these inconsistencies and prioritise sources of knowledge [67, 70]. An understanding of how support tools and support actions work in real-world situations is lacking [23, 33]. Lewis et al. proposed a four-step approach to causal pathway models for implementation strategies. Step two ‘Generating Strategy-Mechanism Linkages’ emphasises the need to link implementation strategies to mechanisms deemed to underpin their functioning [33]. Mechanisms are described as a process or event through which an implementation strategy operates in order to have a desired implementation outcome [33]. It is possible that implementation strategies will function under multiple mechanisms and the same mechanisms can be involved in operating multiple implementation strategies. The application of the CFIR-ERIC matching tool and BCW in SITAS aims to provide an integrated approach to address the link between the implementation strategies selected, their function and desired outcome. McHugh et al. identified complementarities between the ERIC list of implementation strategies and the behaviour change technique taxonomies using qualitative content analysis [53]. They concluded that both taxonomies can be integrated to better understand mechanisms of action and different aspects of the BCW could be linked with the ERIC strategies. This could subsequently address reported challenges to knowledge translation in healthcare such as “silo-thinking” [53, 71]. Strengths and limitations SITAS is an evidence, theory and stakeholder informed intervention that consolidates a broad range of enablers and barriers to implementing standards. It builds on implementation theories, frameworks and taxonomies by focusing on the specific steps that are required for a rigorous and transparent identification and selection of support tools and actions. The relationship between some implementation strategies and specific behaviour changes have not been well developed. However, applying the BCW to SITAS encourages users to reflect on how, when, where, and why implementation strategies are effective. SITAS is sensitive to the: importance of context; needs of each standards project; users who may not be familiar with concepts of implementation theory. All of these are imperative to enhance uptake and implementation of standards. Intended users of SITAS were involved in its development. This facilitated tailoring the intervention to the users’ needs and preferences and aligning it with workflows and available resources, prior to pilot testing. The ‘intended outputs’ component of our programme theory can guide decisions on implementation outcome measures during pilot testing. Decisions made when selecting and prioritising options from individual steps in the digital tool will be based on the users’ perceptions on what is deemed important. There is a risk that some options may be missed in favour of more familiar ones and the perceived feasibility of options. Nonetheless, target users are subject matter experts in developing evidence-based national standards. Additionally, SITAS will evolve overtime in line with new emergent evidence. As such, the implementation of SITAS does not stop once it goes live as it will need to be continuously monitored, evaluated and adapted. This will assure that the intended outputs and outcomes from using SITAS are being met. A rapid review of recently published evidence will need to be carried out at various time points to ensure the content, for example enablers and barriers and implementation strategies, of SITAS is up-to-date. Subsequently, the content within SITAS will need to be amended accordingly. The SITAS toolkit represents a practical process including a digital based platform that can help to optimise our collective ability to bridge the evidence-to-practice gap. It was developed for use by a standard-setting body in Ireland and references the Irish context but it is likely that SITAS is transferable to other jurisdictions with similar standard-setting bodies and health and social care systems. The small sample size was mainly determined by the context in which SITAS was designed including availability of staff and resources. These participants were most likely representative of end-users for SITAS and thus offered rich data sufficient to design SITAS. SITAS will need to undergo formal piloting and economic considerations before spread and scale-up. Furthermore, the structure and development approach may be of interest to researchers and stakeholders involved in the implementation of any evidence-based complex intervention. Conclusion This article describes a systematic and practical approach, drawing on implementation science and responding to expert advice in the field, to develop an intervention for supporting the implementation of standards. Our intervention, SITAS aims to guide the identification and selection of potentially appropriate support tools and support actions, tailored for context. These support tools and actions can optimise effective implementation of standards in practice and subsequently promote safe quality experiences and outcomes for people using health and social care services. SITAS integrates the core concepts of implementation science and seeks to bridge the gap between haphazard approaches to selecting TMFs and implicit reporting of implementation strategies. In addition, SITAS presents a rigorous and transparent approach to decision-making when selecting and prioritising support tools and actions whilst being cognisant of resource limitations. Supplementary Information Additional file 1.Additional file 2.Additional file 3.Additional file 4.Additional file 5.Additional file 6.Additional file 7. Additional file 1. Additional file 2. Additional file 3. Additional file 4. Additional file 5. Additional file 6. Additional file 7.