Comparison of the observer role vs. active participant role in interprofessional simulation-based education for affective skills: a randomized-controlled trial Authors: Maha Inam, Umar Tariq, Rafia Durrani, Masood Muhammad Karim, Zainish Surani, Faisal W Ismail Published: 2025 ABSTRACT AbstractBackgroundAdequate bowel preparation is a critical aspect of colonoscopy, mainly pivoting on the education provided by the relevant healthcare professionals to the patient. Conventional methods of counselling education for these healthcare professionals have prioritized one-to-one practice of the skill over learning through observing fellow learners during simulation-based learning activities. The efficacy of observer roles in simulation for bowel preparation education remains underexplored. This study aims to compare the effectiveness of observer roles versus hands-on practice in simulation-based education.MethodsA simulation-based session was conducted for healthcare professionals involved in bowel preparation education to patients. Learners were randomly assigned to either an observer role in simulation group or a one-to-one practice group. Both groups received standardized education on bowel preparation techniques. Pre- and post-activity self-efficacy scores were collected using a 5-point likert scale. The scores were analyzed using appropriate statistical methods to compare the effectiveness of observer roles versus one-to-one practice.ResultsBoth groups demonstrated substantial improvements in self-efficacy scores post-activity. A median difference of + 0.8 was seen in the control group whereas + 1.1 in the observer group (p = 0.64), revealing comparable increase in confidence of observer and active participants in performing counselling of patients for bowel preparation. This similarity was refelcted in the post-test as well, in which both groups reached a score of 11 out of 13 (p = 0.7).ConclusionObserver roles in simulation are equally effective as hands-on practice for bowel preparation education for healthcare professionals. Both methods contribute significantly to enhancing participants’ self-efficacy in performing bowel preparation counselling. Incorporating observer roles in simulation-based education can offer a cost-effective, resource-efficient, and time-efficient solution for this education.Keywords: Simulation, Observer role, Vicarious learning, Bowel preparation, Counselling, Affective skills training Introduction Simulation-based education (SBE) has gained momentum as an effective educational tool and has gained widespread adoption across various domains in healthcare education, in both the medical and nursing fields [1–3]. Its utilization in teaching [4–7] as well as assessment [8–11] has been well-documented. Studies indicate that simulation can effectively substitute traditional clinical teaching in core nursing courses by up to 50%, highlighting its role as a viable alternative to clinical experience across different educational contexts [12, 13]. Given the vast research evidence in favor of SBE and positive experiences in healthcare education, the integration of SBE has expanded significantly and become an integral component of undergraduate and graduate curricula [6, 14–16]. The increased utilisation of SBE, coupled with growing learner cohorts, doubles the demand that outgrows provision in terms of simulation facilities and expertise [17]. Another paramount factor that adds to this imbalance is faculty time which is institutionally divided into clinical and teaching responsibilities. The strain imposed on faculty members, who face burgeoning teaching responsibilities alongside clinical obligations, contributes significantly to faculty attrition rates [18, 19]. Additionally, disparities in access to simulation resources exacerbate these challenges in regions where facilities or expertise are limited [20]. This necessitates the need for alternate innovative approaches to optimize the use of simulation within resource constraints and accommodate increasing number of learners effectively [21]. SBE has traditionally prioritized individual or one-to-one practice of the skill, known as active participation, over learning through observing fellow learners when teaching skills to healthcare professionals [22]. The observer role in simulation has been defined as the role “where the learner is external to the simulation, for example, the learner will be watching but not participating in the simulation, either within the simulation area or from an area removed from the simulation” [23]. Observer role facilitates learning through observation and reflection and has been studied in various circumstances with proven efficacy in improving learning outcomes [23–28]. Two types of observer roles have been explained: directed and non-directed [29]. A directed observer role involves specific instructions or tools, guiding learners on what to observe during the simulation. This may include learning objectives or even checklists for the expected actions during simulation. A non-directed observer role involves observing the simulation without the use of such tools or instructions. In our hospital, anecdotal feedback was received from gastroenterologists about the inadequacy of bowel preparation for colonoscopy. Adequacy of bowel preparation is one of the most important factors towards the success of a colonoscopy procedure [30]. Poor bowel preparation is a direct indicator of poor quality of colonoscopy outcomes [31]. A quality review of the colonoscopies performed at our institution was conducted using the Boston Bowel Preparation Scale (BPPS) [32]. The results found suboptimal preparation rates, with upto 26% of procedures falling below recommended standards as compared to guidelines which recommend achieving bowel preparation quality scores exceeding 90% within endoscopy units. Significant heterogeneity was observed in the bowel preparation regimens prescribed by the physicians, staff and patient understanding of the instructions to be followed, and pre-procedure staff counselling of patients and their attendants. All these factors affected bowel preparation, which in turn impacted the quality of colonoscopy. This gap was identified as a quality improvement project in the section of Gastroenterology. Keeping in view the challenges related to faculty time constraints, nurse staffing shortages, and limited simulation resources, this study investigated the efficacy and educational impact of employing the directed observer role vs. the active participant role in teaching the affective skill of patient counselling in an interprofessional cohort of healthcare workers. We also aimed to study the differences in perceived self-efficacy and knowledge gain between the two groups of learners following their participation in a simulated educational experience. By addressing these aspects, this study aims to contribute insights into optimizing SBE amidst growing demands and resource limitations in healthcare settings. Methods This study was conducted as a parallel randomized-controlled trial at the Centre for Innovation in Medical Education of the Aga Khan University, Karachi. All subjects gave their informed consent for inclusion before they participated in the study. The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the institutional review board (Application # 2023-9160-27462). Our clinical practice for patients being scheduled for a colonoscopy includes the gastroenterology consultant explaining the complete procedure to the patient with a brief overview of bowel preparation. This is followed by a patient counselling session by the trainee physician, nursing and allied health staff of our endoscopy unit or outpatient department, who become the main players in educating the patient for correct bowel preparation before colonoscopies. A simulation based intervention was designed to teach and train healthcare staff regarding international best practices in bowel preparation, as well as counselling patients regarding the process of bowel preparation. The gastroenterology trainees, unit nurses, and paramedical staff served as the learner cohort. A total of 28 participants were enrolled, all-inclusive of the interprofessional cohort of healthcare professionals including trainee residents, fellows, nurses, and technicians of the endoscopy and outpatient units of the Department of Gastroenterology at the Aga Khan University Hospital Karachi. Informed consent was taken from all participants. The total cohort was randomized into two groups. Each professional group was randomised separately to make two interprofessional groups by random allocation. Participants in the control group (n = 15) underwent active participation in the simulation activity whereas those in the observer group (n = 13) were assigned observer roles within the simulation. Members of the active participant group all got an opportunity to interact individually with the simulated participant (SP) at all scenarios. Members of the observer group directly interacted once with the SP during their turn at any one scenario, but were directed active obervers for the rest of the stations while their collegues performed. The educational session was targeted towards enabling the participants to effectively deliver bowel preparation instructions to patients scheduled to undergo colonoscopy. Four of the most commonly encountered patient cases in clinical practice were chosen and a simulation scenario designed for each (Table 1). Table 1Cases for simulationCase NumberTitle1Patient with no known comorbid conditions undergoing a routine screening colonoscopy.2Patient on antihypertensives and anticoagulation (due to atrial fibrillation) undergoing a colonoscopy due to bleeding per rectum.3Patient with diabetes and chronic kidney disease with poor glycemic control undergoing a colonoscopy due to generalized weakness.4Patient with ischemic heart disease and history of a percutaneous coronary intervention 5 years ago and currently on dual antiplatelet therapy undergoing a routine colonoscopy. Cases for simulation SPs were enrolled for each case from our institutional SP bank according to the requirements of the cases. SPs played the role of patient to be counselled according to the case they were assigned to. Using standards of best practice [33], formal training for the SPs was held before the educational session and a pilot run was conducted to ensure adequacy of their performance. The program was spread over two days; day one for the control group and day two for the observer group. The same structure and design of the presentation and simulation were followed on both days. The same SPs were enrolled for each case on both days to maintain uniformity for both groups. Phase 1 Each day started with the participants in that group sitting a pre-test assessment and filling a self-efficacy questionnaire (SEQ) at baseline. An interactive didactic session followed, which covered best practice international guidelines regarding bowel preparation pre-colonoscopy [31]. A detailed pre-brief as per the recommended standards was conducted before their participation started in the scenario [34]. This covered an overview of the learning objectives for the exercise, orientation to the simulated clincal space and presence of simulated patients, establishment of fiction contract with the participants, as well as creating the atmosphere of psychological safety for them. Additional questions that the participants had were addressed before the pre-brief was concluded and scenarios were started. Phase 2 The control group was divided into 4 subgroups of 3-4-4-4 and observer group was divided into 4 subgroups of 3-3-3-4 participants. All groups were interprofessional, and the total number of professions represented were similar in both groups. The subgroups were assigned to each case and made to rotate in a circuit covering all four cases. Each participant in the control group performed counselling one-to-one with the SP in each of the mentioned cases, and was the active participant. In the observer group, one of the participants counselled the SP while the others observed the active participant as directed observers, which comprised the following 3 characteristics: vicarious observation, use of a checklist and participation in the post simulation debriefing [35]. All the individuals did at least one live training in the active participant group. In the observer group, 4 individuals performed live training (1 participant/scenario x 4 scenarios) while the others were directed observers. However, all the four groups of professionals (assistants, technicians, nurses and physicians) got an opportunity to perform at any 1 station, thus ensuring equal representation. At the end of each scenario for each subgroup, participants were debriefed by the facilitators following the recommended criteria for best practice in simulation [36]. In our study, we used the plus/delta, followed by the Advocacy/Inquiry framework for debriefing [37], as our facilitators are institutionally trained on that framework, making it comfortable for them to use it while debriefing learners. In the debriefing sessions of our intervention group, the observers were also treated as active learners and engaged at all points of conversation during the debrief. Input from the observers was sought before the active participant when discussing ‘strengths’ of performance during the simulation in order to create an air of trust for healthy discussions when it proceeds to the ‘areas for improvement’. Discussion was initiated with the performing participant about ‘areas for improvement’ and then moved towards the observers for their input and what would they do differently in similar situations. Each debriefing session was concluded with a summary of take-home lessons collected from each participant. Phase 3 Upon conclusion of all simulated cases alongwith the debriefing sessions, participants completed a post-test assessment and a SEQ. The pre- and post-tests were designed by gastroenterology faculty to assess the knowledge of participants about key points in bowel preparation counselling. There were 14 items on the test, with one point for each item, making a maximum score of 14. The SEQ was an 11 item form with a 5-point Likert scale assigned to each item to grade perceived self-efficacy by the participants regarding knowledge and counselling skills in bowel preparation prior to colonoscopy (Table 2). All elements of the SEQ were derived from the learning objectives of the educational session. Table 25-point likert scale used to assess self-efficacy of a skill5-point Likert scale for self-efficacy of skills1Cannot do it at all.2Can do it with mistakes.3Can do part of it correctly under supervision4Can do it well and completely under supervision5Can do it independently 5-point likert scale used to assess self-efficacy of a skill Statistical analysis was performed using SPSS version 22.0. Participant demographics were defined using frequencies. Normality was tested using Shapiro-Wilk test. Median test as well as SEQ scores were calculated alongwith their differences. The significance of the difference in scores for both groups was tested using dependent t-test. Results A total of 28 participants took part in our learning exercise, 13 in the observer (intervention) group and 15 in the control group. Overall, 55.2% (n = 16) were men and 37.9% (n = 11) of the participants were women. Age of the participants ranged from 23 to 57 with a median of 32 (interquartile range 27–37). Demographics of participants in each group are provided in Table 3. Table 3Baseline demographics of participantsControl (n = 15)Observer (n = 13)N (%) or Mean +/- Standard Deviation Gender Men Women8 (53.3)6 (40)1 (6.7)8 (61.5)5 (38.5)0 (0)unspecified Age 36.3 +/- 10.429.6 +/- 3.9 Designation Trainee physician Registered Nurses Endoscopy Technicians Health Care Assistants2 (13.3)6 (40)4 (26.6)3 (20)2 (15.4)5 (38.5)4 (30.8)2 (15.4) Number of hours of in practice 11 − 100 101 − 1000 1001 + unspecified2 (13.3)2 (13.3)9 (60)1 (6.7)1 (7.7)5 (38.5)4 (30.8)3 (23.1) Baseline demographics of participants Gender Men Women 8 (53.3) 6 (40) 1 (6.7) 8 (61.5) 5 (38.5) 0 (0) Trainee physician Registered Nurses Endoscopy Technicians Health Care Assistants 2 (13.3) 6 (40) 4 (26.6) 3 (20) 2 (15.4) 5 (38.5) 4 (30.8) 2 (15.4) 11 − 100 101 − 1000 1001 + unspecified 2 (13.3) 2 (13.3) 9 (60) 1 (6.7) 1 (7.7) 5 (38.5) 4 (30.8) 3 (23.1) Both groups of participants were matched at baseline within the pre- and post- tests (Table 4). The increase in scores between the pre- and post- tests demonstrated an increase in the knowledge gained within both groups. There was no significant difference in the increase in scores between the two groups, indicating that the observer role plays an equal part in learning as the active participant role. Table 4Test Scores – Maximum 14Control Group(n = 15)Observer Group(n = 13)P-valuePre-Test980.55Post-Test11110.7 Test Scores – Maximum 14 On the SEQ, participants achieved an overal median difference in score of 0.8 and 1.1 in the control and observer groups, respectively, indicating equivalent gain in self efficacy (Table 5). The difference between these two changes was statistically non-significant (p = 0.64). Table 5Median Self-Efficacy questionnaire (SEQ) Scores – Maximum 5Control Group(n = 15)Observer Group(n = 13)P-valuePre- Intervention4.13.9NAPost-Intervention4.95NADifference+ 0.8+ 1.10.64 Median Self-Efficacy questionnaire (SEQ) Scores – Maximum 5 Participant comments regarding the activity over whelmingly positive.The faculty and observers found the activity helpful and enjoyable on general questioning, with its ‘patient centric’ and ‘engaging’ nature. Particular verbatim comments were: “I learned quite a few things that I can implement in my daily practice”. “I learned quite a few things that I can implement in my daily practice”. “I can confidently differentiate between low risk and high risk patients and procedures”. “I can confidently differentiate between low risk and high risk patients and procedures”. “Excellent way of teaching, this was very effective for me today”. “Excellent way of teaching, this was very effective for me today”. Discussion This study examined the role of directed observer participation against active participation in SBE for achieving the learning objectives in multiple scenarios to improve affective skills related to patient counselling for bowel preparation in an interprofessional cohort of participants. Our findings demonstrate that test scores improved for both groups post-activity, with no statistically significant difference in the degree of improvement between the two groups. Additionally, we found that participants from both groups perceived an increase in self-efficacy in effectively counselling a patient for bowel preparation, with the margin of improvement being statistically insignificant. These results suggest that the observer role is as least as effective as active participation in SBE for training in counselling skills. Observer roles can be effectively employed to enhance knowledge as well as confidence of learners in affective skills learning, with the overarching goal of training intended for quality improvement in patient service where large learner cohorts do not match the time and resource availabilities. These findings have several implications. Firstly, there is no doubt that SBE is here to stay, but its effectiveness pivots on proper design and delivery as defined by the standards of best practice [38, 39]. Faculty trained as simulation educators play a crucial role, yet the pool of such simulation experts is limited. This, alongwith the fact that faculty have defined time for teaching and need to deliver clinical responsibilities as well, further narrows down the availability of simulation expertise at a given time. In this mismatch between SBE demand and expertise, the conventional approach of mandatory active participation of each learner in a simulation becomes impractical and creates bottlenecks [18]. Assigning directed observer roles using vicarious observation to learners can reduce this problem by educating larger cohorts within the same timeframe and resources, without compromising learning outcomes. Kolb’s experiential learning theory [40] was extrapolated to define that active participation (or active experimentation in Kolb’s theory) is the only effective way of keeping the learner engaged in simulation to maximize learning outcomes. In contrast, Bandura’s social learning theory suggests that observation and modeling behaviors, bridged by subconscious reflection leads to learning [41]. This element of reflection, with the correct direction on judgment, can lead to meaningful learning in debriefing post-simulation [42]. Morever, the implementation of SBE in formal curricula incurs significant hidden costs in faculty time. Increasing demand for SBE and larger learner cohorts exacerbate teaching workloads, impacting clinical responsibilties and leading to faculty dissatisfaction. Estimates suggest faculty time cost range from $100 to $500 per hour [43, 44]. To our knowledge, however, the full extent of these influences has not been formally reported in literature. More importantly, various studies have defined a relationship between the amount of workload, organisational attitude towards managing workload, and staff retention [19, 45]. 44.4% of current nursing faculty at an institution were reported to define unrealistic workload as a reason to resign from their positions [46]. With SBE, the additional education required to facilitate simulation and the length of time required for planning simulation activities are not even captured in a typical workload calculation [21]. Therefore, the workload, negative cost implications, and challenges with staff retention can be mitigated by using alternate approaches to increase educational capacity efficiently [18], and we believe that observer role in SBE can do so. Given its time and resource efficiency, the observer role carries great utility in interprofessional education (IPE) where larger and more diverse learner cohorts are trained. However, literature studying the efficacy of such roles is limited [47, 48]. Our findings suggest that observers learn equally as much as the performing participants and, therefore, this modality should be incorporated into IPE sessions to streamline education workflows and optimise team training. During the debriefs, perspectives of the diverse group of observers (from different professions in healthcare) would also serve as educational input that the active participant may not necessarily have thought of. However, we are cognizant of the fact that the return on investment on such an activity can vary from centre to centre. For example, factors such as contractual obligations of faculty, simulation centre rental, availability of trained personnel will all impact the application of this strategy. It is therefore clear, that implementation of this methodology will vary according to individual context. O’Regan et al. explained that learning experience for observers in SBE can be valuable if all roles, including the observer, involve active learning. Therefore, active learning for observers facilitated by appropriate instructions and/or tools can yield comparable learning outcomes to active participation [29]. As compared to an active participant immersed hands-on in the simulation, a directed observer is immersed in the simulation through directed observation using checklists and frameworks dictating what to observe, thereby promoting vicarious learning [35]. Therefore, from simulation educators’ standpoint, active ‘learning’ should be the priority instead of active ‘participation’. Instructions exist on how to maximize learning outcomes from observer role by mindfully applying social learning theory at each step of simulation design [49, 50]. Beyond that, learning for the observers pivots on the effectiveness of the debrief, where the debriefer must ensure constant engagement of the observer alongside the active participant. This strategy ensures dissemination of the observations made by the observing participants, which may not have been noticed by the active participants engaged hands-on. It also gives an opportunity for the observers to think of themselves in similar situations and how they would act, promoting reflection in the learning process. Despite the advantages of observer role in SBE, O’Regan et al. found out that educators often believe hands-on experience provides the best learning [51]. Location of observers during the simulation particularly affects what they observe and notice. In the same study, however, educators also expressed value in observer role provided that the simulation was designed with observers in mind. A scoping review was done that identified three themes that maximize learning outcomes for observers during simulation, including (1) observer comfort level, (2) attention and awareness, and (2) well-defined directed observer role [52]. If designed appropriately, observer role produces ‘agile’ and mentally adept practitioners [53]. The experiments of Andrieux and Proteau provide a plausible explanation to the argument between learning through active participation versus observation [54]. Their experiments explained that observation can complement physical practice, promoting long-term retention of skills. Alternating observation with physical practice can refine skills learned through observation. Therefore, the observer role in SBE offers a cost-effective solution for resource-limited centres and a time-efficient approach for larger institutions with heavily occupied faculty. All of this is achieved without a compromise on learning outcomes, which is of paramount importance to educators. The strength of this research lies in the design of the simulation intervention and its teaching content, both created by specialised gastroenterologists and certified simulation educators. The study was held at an accredited centre for simulation education, following standards of best practice [55]. However, the study has some limitations. The small sample size, though comprehensive and all-inclusive, limits generalisability. Additionally, it is possible that the group may test differently in different scenarios. However, we were more interested if the intervention was successful in the entire interprofessional cohort as one, as opposed in the individual professions. This approach has previously been described [29]. The study was potentially limited by the subjective nature of the self-efficacy measure which compensated for by the objective pre- and post-test, the results of which mirror SEQ scores. Furthurmore, the SEQ was developed by our centre after a through review of literature in collaboration with medical educators, and is internally validated. However, it is not externally validated. Nevertheless, the authors are aware that learner satisfaction and/or self-perception is often not sufficent to catagorically state improvement or transference of skills.Future research should further investigate the long-term retention and application of skills acquired through observer roles in SBE through more robust measures. Conclusion The directed observer role in SBE is equally effective as the active participant role for improving affective skills in an interprofessional cohort of healthcare workers. Both methods contribute significantly to enhancing participants’ self-efficacy and knowledge gain. Incorporating observer roles in SBE can offer a cost-effective, and resource- and time-efficient solution for this education. Acknowledgements We acknowledge the support staff for simulation at the Centre for Innovation in Medical Education of the Aga Khan University Karachi for providing assistance with all the logistics involved in executing this study. Abbreviations Simulation-based education Self-efficacy questionnaire Authors’ contributions All authors have made substantial contributions to the conception and design of the work and have drafted the work or substantively revised itAll authors have approved the submitted version.All authors have agreed both to be personally accountable for the author’s own contributions and to ensure that questions related to the accuracy or integrity of any part of the work, even ones in which the author was not personally involved, are appropriately investigated, resolved, and the resolution documented in the literature. Funding No form of funding was received to conduct this study. Data availability No datasets were generated or analysed during the current study. Declarations Ethics approval and consent to participate Ethics approval was granted by the the institutional review board of the Aga Khan University Karachi (Application # 2023-9160-27462). All participants signed a written informed consent to participate in the study. Consent for publication Not applicable. Competing interests The authors declare no competing interests. Footnotes Publisher’s Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. References Associated Data Data Availability Statement No datasets were generated or analysed during the current study.