Use of design thinking to develop a benchmarking tool to assess documentation procedures in a hospital pharmacy aseptic compounding unit: a case study Authors: Noelle Murphy, Evelyn Garvey, Bernard D Naughton Published: 2025 ABSTRACT AbstractObjectivesThis paper combines the concepts of design thinking and benchmarking in an aseptic manufacturing context. Design thinking is a problem-solving approach that aims to understand user needs, generate ideas, prototypes and test solutions. There are no published examples in the Irish healthcare setting. There are also no national legislative frameworks in Ireland for compounding medicine in unlicensed hospital aseptic compounding units (ACUs). This study aims to apply design thinking principles to the development of a benchmarking process in the absence of existing frameworks.MethodsA literature review of design thinking research and international best practice guidelines regarding sterile product manufacture documentation was undertaken to develop an initial prototype benchmarking tool. Design thinking principles were implemented by recruiting and empathising with key senior stakeholders (N=5). Semistructured interviews were conducted with these stakeholders to aid the defining, ideation and optimisation of the prototype tool. The optimised tool was then prototyped and tested in practice by end users (N=11), within an Irish ACU. End users were interviewed regarding their experience of using the tool. Transcripts of interviews were coded, and thematic analysis was undertaken to generate overarching themes to support its further development.ResultsThe design thinking approach enabled the development of a benchmarking tool, which was optimised by empathising with key stakeholders. Through the process of empathising, defining, ideation, prototyping and testing, a useful benchmarking tool was developed which was deemed appropriate and accepted by its users.ConclusionsDesign thinking provides a platform for collaboration to deliver innovation and drive quality improvement in healthcare settings. The design thinking process was successful in delivering a user-centred tool for documentation procedures in an aseptic unit, which was accepted for use by end users. When exisiting guidleines and regulations are considered, design thinking shows promise as an innovation tool in Irish aseptic units, manufacturing facilities and the wider healthcare context.Keywords: DOCUMENTATION; PHARMACEUTICAL PREPARATIONS; PHARMACY ADMINISTRATION; PHARMACY SERVICE, HOSPITAL; Practice Guidelines as Topic; Quality Assurance, Health Care; TOTAL QUALITY MANAGEMENT WHAT IS ALREADY KNOWN ON THIS TOPIC There is no national legislative framework in place in Ireland for the compounding of drugs in hospital aseptic compounding units. By integrating design thinking elements into the development of a benchmarking process, solutions which are effective in practice can be developed. There is no national legislative framework in place in Ireland for the compounding of drugs in hospital aseptic compounding units. By integrating design thinking elements into the development of a benchmarking process, solutions which are effective in practice can be developed. WHAT THIS STUDY ADDS Design thinking is an effective method of delivering solutions which are desired by end-users. There were no published examples of its application in the context of an Irish hospital pharmacy department until now. Design thinking is an effective method of delivering solutions which are desired by end-users. There were no published examples of its application in the context of an Irish hospital pharmacy department until now. HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY This study may form the basis of a collaborative approach to development of a national benchmarking tool for aseptic compounding units and encourage ongoing use of the design thinking approach. This study may form the basis of a collaborative approach to development of a national benchmarking tool for aseptic compounding units and encourage ongoing use of the design thinking approach. Introduction Aseptic compounding, regulation and practice Aseptic compounding is defined by the American Society of Health-System Pharmacists (ASHP) as ‘The movement of sterile products from one container to another in which the container-closure system and transfer devices remain intact throughout the entire transfer process, compromised only by the penetration of a sterile pyrogen-free needle or cannula through a designated stopper or port to effect transfer, withdrawal or delivery’.1 The function of aseptic compounding units (ACUs) is to prepare cytotoxic and other sterile medicines for individual patients. This is a high-risk operation and contaminated products supplied from compounding pharmacies have led to fatalities. For example, the Breckinridge report in 1976 led to responsibility for aseptic compounding in UK hospitals resting with pharmacy departments and identified the need for documentation to support the preparation of parenteral products.2 Good manufacturing practice (GMP) describes the minimum standard a medicinal product must meet in its production. GMP aims to ensure that medicinal products are consistently of high quality and appropriate for their intended use. Documentation is an integral part of ensuring quality and compliance with GMP.3,5 At present, there are no national regulations in Ireland specific to ACUs. Current practice in Irish ACUs is largely derived from practices outlined in European Union GMP, WHO guidance, the Hospital-Pharmaceutical Inspection Convention and Pharmaceutical Inspection Co-operation Scheme (H-PIC/S) Guide, the UK’s Quality Assurance of Aseptic Preparation Services Standards Handbook, United States Pharmacopoeia (USP) 797 and ASHP guidance.4,8 The UK’s National Health Service has also identified the need for uniformity in quality assurance across aseptic units.9 The Health Information and Quality Authority (HIQA) in Ireland has identified quality as a key theme in the National Standards for Safer Better Healthcare,10 and areas for the preparation of medications in healthcare settings may be inspected against these standards.11 HIQA Standard 2.8.2 states ‘where national metrics do not exist, the development or adoption of performance indicators and benchmarks in accordance with best available evidence to monitor and evaluate the quality and safety of the care provided and outcomes’ should take place to ensure the ‘effectiveness of healthcare is continuously monitored, evaluated and improved’.10 Benchmarking Benchmarking is the process of establishing a standard of excellence and comparing a function, activity or product with that standard.12 Internal benchmarking against a standard has been identified as an important part of the quality assurance process and a method of continuous quality improvement.10 13 Benchmarking in the healthcare setting has proven to be positively associated with quality,13 and the key components of benchmarking include identifying the activity to be improved, identifying the reference points to benchmark against, collect internal data, identify the gap by comparing the standard to the internal data, set future objectives, communicate results, develop an action plan and implement the actions.12 The use of best available evidence to generate a benchmarking tool for documentation processes in ACUs would allow for self-inspection and peer inspection. Using the best available evidence to generate a benchmarking tool for documentation processes in ACUs would allow for self-inspection and peer inspection of documentation standards in compounding processes. Design thinking Design thinking is an innovation methodology, which aims to generate human-centred solutions to complex challenges by understanding the needs of users to prototype and test multiple possible end products.14 15 It is a non-linear, user-centred approach to solving problems,16 of which there are multiple iterations. These include the Stanford Design school model and the IDEO model (figure 1).17 Although these methods vary, the commonality between them is understanding the problem in depth, gaining insight into the needs of end users, trialling prototypes and evolving to reach the best solution for end users17 18 with empathising with end-users’ needs being a core concept of design thinking.14 15 The IDEO design thinking process (A) and the Stanford Design School design thinking process (B). Design thinking encourages collaboration and iteration, allowing for the exploration of multiple solutions before arriving at the most effective one and addresses the need to consider feasibility, viability and desirability of solutions while keeping end users’ needs in mind.19 Through its collaborative nature, design thinking offers a framework to deliver solutions, which align with an organisation and the people working in it,15 16 thus providing an ideal scaffold for quality improvement in healthcare. Design thinking in healthcare Continuous improvement and innovation are required in healthcare to meet the needs of providers, patients and regulators. Failure to account for human fallibility, need or usability can lead to suboptimal implementation of interventions.20 21 Design thinking has been applied to resolve multifaceted issues and drive innovation in multiple sectors including aviation, education and engineering.16 19 20 22 Design thinking has previously been applied in the context of business model innovation, product design and medical engineering.21 23 This has translated successfully into various healthcare settings such as intensive care, radiology and public health.17 24 In the context of the radiology setting, design thinking was used successfully to reduce fear of MRI scanners in paediatric patients.7 Through empathising with the needs of end users, the MRI scan process was transformed into a pirate adventure.17 While design thinking has been used successfully in healthcare settings internationally, there have been no published examples in an Irish healthcare setting. Considering the need for a benchmarking tool and the effectiveness of design thinking in healthcare settings, the aims and objectives of this study are as follows: Aim To develop a benchmarking tool to assess documentation procedures using design thinking and to perform a case study to test the tool at an Irish hospital ACU. Objectives Conduct a review of current regulatory and guidance standards to develop a prototype benchmarking tool based on design thinking principles Conduct a review of current regulatory and guidance standards to develop a prototype benchmarking tool based on design thinking principles Conduct user-based interviews with senior stakeholders to further develop the benchmarking tool using a design thinking approach Conduct user-based interviews with senior stakeholders to further develop the benchmarking tool using a design thinking approach Test this benchmarking tool at the ACU at Midlands Regional Hospital Tullamore (MRHT) in Ireland as a case study using end user interviews according to design thinking principles Test this benchmarking tool at the ACU at Midlands Regional Hospital Tullamore (MRHT) in Ireland as a case study using end user interviews according to design thinking principles Methods Regulatory publication review A comprehensive literature search on the topic of documentation practices and standards in ACUs was undertaken in October 2022 to define the regulations and standards, which could inform the initial prototype. Multiple search engines were used. Online databases were accessed via MRHT and Trinity College Dublin online libraries. The results of these searches are illustrated in online supplemental appendix 1. Google Scholar and Google online search engines were used to identify existing guidelines and other resources relevant to this topic, which are often found in the grey literature, rather than research databases. The details of this search are outlined in online supplemental appendix 1. Standards examined included EU GMP, H\PICS and USP 797.5 7 25 Documentation standards were defined as reference to a written protocol, record or guideline. Standards were collated using an Excel spreadsheet and reviewed for commonality to create a list of relevant standards, which would inform the development of the ‘Initial Prototype’ benchmarking tool. Understanding the regulatory requirements supported the team to define the problem from a regulatory perspective and formed the basis of the first prototype. Case study context MRHT is an acute hospital and is a regional centre providing haematology and oncology services. The ACU is staffed with pharmacists and pharmacy technicians who are responsible for the safe manual compounding of sterile products. The ACU contains grade A, B, C and D cleanroom areas and uses compounding isolators for the preparation of sterile products.6. The ACU operates at full capacity and releases an average of 700 parenteral items per month. All staff working in the unit must be validated in line with the pharmacy department’s training programme. Staff within the unit have varying levels of experience, responsibility and education. The contextual variables such as physical environment, tasks performed and resources available are reflective of a typical Irish hospital ACU.26 Data collection The initial prototype benchmarking tool was developed based on a list of regulatory evidence and standards identified in the literature search. It was then improved through the interview of senior stakeholders (table 1). Eligible participants (>18 years, staff member of MRHT and had a remit in quality improvement) were invited via email to participate in semistructured interviews, approximately 15 min in length. The interviews included a discussion of the initial prototype as well and the function and appearance of the tool. Interviews were conducted by NM and were recorded using a digital recorder. Interviews were transcribed manually. Transcripts were coded and analysed using NVIVO software. Table 1Design thinking steps and aligned practical actionsStep 1 (Empathise and define to develop the initial prototype)Regulatory evidence review and initial prototype developed by research teamStep 2 (Ideate and finalise the prototype)Senior stakeholder interviews to refine the initial prototype through ideation and preparation of the final prototype for testingStep 3 (Test)Test the final prototype with operational staff to achieve the final benchmarking tool Design thinking steps and aligned practical actions Thematic analysis Thematic analysis of interview transcripts was inspired by the Braun and Clarke approach27 using an inductive approach (bottom-up) by way of engaging the opinions of the staff directly providing the service and a deductive approach (top-down) by way of reviewing regulatory data and seeking senior stakeholder engagement approaches to generate codes.27 Interview data were discussed between the first and second author with the third author reviewing the final quotes and high-level themes. The information was gathered to ideate with key senior stakeholders and was considered alongside the regulatory requirements to further develop the final prototype benchmarking tool. Tool testing The initial prototype tool was refined by senior stakeholder feedback and was then tested in the ACU in MRHT by end-user pharmacists and pharmacy technicians validated in the ACU (table 1). Participants were invited to participate during an ACU staff meeting where study information was provided to help empathise with stakeholders involved in daily operations. Participants (N=11) were interviewed in person about their experience of using the benchmarking tool in semistructured interviews in July and August 2023. Interviews were transcribed manually. Coding and thematic analysis were performed using NVIVO software.27 Results Regulatory publication review 467 research and regulatory publications were retrieved following an extensive literature search. Following removal of publications which were irrelevant, duplicates or unavailable in the English language, 19 were selected for full-text review. After full-text screening, 14 articles were included in the final study (figure 2). Of these, 11 were hospital or pharmacist-specific and EU GMP and USP 797 formed the basis of the publications reviewed.6 Publication identification and selection. 73 documentation criteria were identified within these 19 publications. Once filtered for duplication, 54 documentation criteria were identified to develop the tool. Prototype benchmarking tool Key senior quality stakeholders (n=5) provided feedback on the initial prototype tool, which included a list of regulatory guidelines and standards created by the research team (figure 3), which was shared with them. Participants were chief pharmacists and quality managers in MRHT. The emerging themes concerned benchmarking in practice and the usability of the initial prototype tool. Extract of the initial prototype benchmarking tool presented to senior quality stakeholders to assess its usability. Benchmarking in practice Despite a variation in first-hand experience of using benchmarking tools, all senior stakeholders (N=5) identified benchmarking as a useful tool in practice to maintain and improve service quality. The value of benchmarking for identifying improvement opportunities was also emphasised. The benchmarking tool is a really good way of seeing what you need and what your gaps are—Participant 2 The importance of removing subjectivity from benchmarking was considered as vital to successful benchmarking in practice. It was recognised that to achieve an effective benchmarking process, the wording of criteria must be unambiguous and that the needs of managers and of staff completing the benchmarking tool may vary. I also think it depends on who is using it. For me, in a managerial capacity I want to see quickly are we compliant or not compliant and do we have assurance in that and where do we need to focus on. But as somebody who is doing the assessment, I think they will have different needs—Participant 4 The practical application of benchmarking in healthcare was identified. There are so many different areas in healthcare where a standard might be useful but when you don’t have that I suppose benchmarking is a useful alternative—Participant 5. Benchmarking tool usability Participants all considered a user-friendly tool as being critical to a successful benchmarking exercise. The need for clear, concise language was emphasised as important to achieve a usable tool and remove subjectivity, especially where multiple parties participate in a benchmarking exercise (figure 4). The visuals of the benchmarking tool were mentioned as valuable, and its tick-box structure was cited as aiding time-effective data collection and analysis. Usability of the benchmarking tool. There were mixed views regarding whether a digital or paper-based tool would be preferable. Development of a robust and reliable approach to carry out benchmarking activities was cited as important. We need to build in a bit of resilience around our IT dependency because our IT infrastructure is so poor, with the cyber-attack. We need to have a system that works independently of whether it is paper based or electronic—Participant 4 Tool testing Those interviewed at the prototyping stage reported that including the reference sources for each standard (figure 3) was superfluous information. As technicians, students, and non-pharmacist staff may be conducting the audit, they reported a simple box tick exercise would be simpler for managers to review and for staff to conduct. Participants reported that it was ‘user friendly’ and they would like to use it in everyday practice. This resulted in the production of the final benchmarking tool (figure 5). –Final benchmarking tool after feedback from senior leaders in quality and end users. I found it really easy and straightforward to use, first of all I liked the way there’s two different colours so you can differentiate between the questions and the answers. I thought the questions were really easy, easy English, so nearly anyone could understand the questions—Participant J Staff working in the ACU considered the need for uniform practices across different hospitals. Variation in practices across sites was recognised as a barrier to quality practice. It seems that every hospital does everything slightly different, so if we did have a set of standards, it would make life a lot easier—Participant C The establishment of a national framework within to practice was identified as important to ensure quality service delivery. When it comes to the aseptic unit, I think that there should be very clearly defined standards, they need to come from a national level and there should be audit of those standards—Participant A Discussion This study examines the application of a design thinking process to generate a benchmarking tool for an ACU in an Irish hospital setting, a context in which it has not been widely applied. Other methods of quality improvement and innovation such as Six Sigma and Lean have been used more widely in healthcare settings.17 However, the advantage of design thinking over these methods is the incorporation of end users into the process as seen in this study.17 Regulation and the design thinking process It is important to appreciate that the design thinking process is very rarely a linear one and instead occurs through reiterations through a process of empathising, ideating, prototyping and testing happening at different stages.14 With this in mind, design thinking can be used fluidly. When it comes to design thinking in a regulated industry, it may be logical to begin by defining the limits of the possible innovations rather than beginning with the empathising stage. This ensures that prototypes which are contrary to law or established guidelines are not developed. Given the presence of regulatory standards in the aseptic manufacturing context, it was deemed efficient to explore the regulatory landscape in advance of empathising, this identified any regulatory limits to the extent of innovation in advance of empathising and prototyping. We propose that future design thinking studies do the same when innovating in highly regulated industries. Culture and design thinking in healthcare settings Key stakeholders in this study with a remit in quality identified benchmarking as a useful and practical method of assessing a service. However, the application of design thinking tools to create that benchmarking tool can be influenced, both positively and negatively, by organisational culture.28 Organisational culture can both support and impede specific stages within the process. The ideation stage of design thinking, especially is most effective in risk-taking organisational cultures.28 Therefore, the use of design thinking could be a challenge for healthcare organisations, which are often risk adverse, and practice risk minimisation.29 To manage that challenge, we suggest a multistakeholder approach as worthwhile to help non-risk-taking groups feel supported by other professions, like nurses and doctors, to take innovation action to solve work-based problems. Also, a culture of siloed specialisation, as seen in the context of an electronics company, could also be an impediment to the use of design thinking in healthcare organisations, which contain specialties, which are sometimes known to work in siloes.28 In this case study, a prototype tool was developed prior to empathising with stakeholders. Prototyping earlier could save resources, time and ensure that solutions generated are tangible and effective for end users15 and have a positive impact on breaking down siloes and minimising risk through open communication earlier in the process as seen in this case study. On the other hand, we expect that an open and psychologically safe work culture could facilitate design thinking by making staff feel safe to voice ideas about new ways of working, by suggesting new prototypes and by taking design thinking projects forward. Benchmarking for quality As highlighted in the responses from senior quality stakeholders, benchmarking is a useful alternative in situations where a national standard does not exist. However, the link between benchmarking and success in driving quality initiatives does require further study.13 HIQA state that in this scenario, best practice should be adopted to inform development of a benchmark.10 There is subjectivity involved in developing a benchmarking tool and variance between publications was noted in the review of standards. This further highlights the need for collaboration on a greater level to deliver a framework where quality can be assured across ACUs. Empathy—a key driver for benchmarking Empathising with key stakeholders aids developing the solution which end-users desire and is a critical consideration in any design thinking process.17 In this project, design thinking successfully delivered a usable tool, where all end users of the tool reported the tool to be easy to use. This highlights the value of prototyping and empathising with end users and senior stakeholders. It was identified that the needs of managers and the staff completing the benchmarking tool may differ. The Health Service Executive’s (HSE) strategic change model has adopted a model of ‘Define, Design, Deliver’ as it has recognised the need for stakeholder engagement in order to bring about meaningful change,30 and based on this case study, we propose that this HSE strategy would benefit from including an empathise step in line with design thinking practice. Limitations There are limitations to this study. This was a single-centre case study,26 this study could be repeated on a larger scale across other aseptic units and manufacturing sites to demonstrate generalisability. Future work Empirical This benchmarking tool could be developed further through collaboration with stakeholders from all Irish ACUs and national regulatory and standards authorities. A future project could include a Delphi study to gain technical consensus on this benchmarking tool across the country. Once consensus is achieved, further case studies could be performed to improve the benchmarking tool. Theory and practice Design thinking is a suitable method to facilitate healthcare innovation and change in an Irish Pharmacy context. There are opportunities across Irish and European hospitals to apply design thinking methods to manage other complex problems in other aseptic units, pharmaceutical manufacturing and healthcare more generally.31 This paper also demonstrated how design thinking could be used even in a highly regulated environment like aseptic medicine manufacturing paving the way for design thinking to also be useful in licenced commercial manufacturing facilities. Conclusion This study has developed a new benchmarking tool for documentation procedures in ACUs using the design thinking approach. The application of a collaborative and user-centred design approach can deliver a sustainable and innovative solution to complex problems. Empathising with key stakeholders and considering regulations before prototyping is an important consideration of design thinking and innovation in healthcare. There is value in applying this methodology in this and other settings such as pharmaceutical manufacturing and other healthcare settings. Supplementary material Acknowledgements I would like to thank Danielle Neale for facilitating data collection and Amie Giles for her feedback and advice in advance of submission. Heartfelt thanks to MRHT colleagues for their support and participation in data collection Footnotes Funding: The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors. EAHP statement: EAHP Statement 3: Production and Compounding. Provenance and peer review: Not commissioned; externally peer-reviewed. Patient consent for publication: Not applicable. Ethics approval: Ethics approval was granted by the Clinical Governance Committee at MRHT and Trinity College Dublin School of Pharmacy and Pharmaceutical Sciences Ethics Committee, reference approval number ‘2022-12-02’. Study information and written consent were provided by all participants. Participants gave informed consent to participate in the study before taking part. Data availability free text: Data available on request. Data availability statement Data are available upon reasonable request. References Associated Data Supplementary Materials Data Availability Statement Data are available upon reasonable request.