Improving Resident Frontal Sinusotomy Education With Three‐Dimensional Surgical Planning Software Authors: Andrew Kelly, Li‐Xing Man, Matthew M Carter, Isaac L Schmale Published: 2026 ABSTRACT ABSTRACTObjectivesFrontal sinusotomy remains a technically challenging component of resident training in endoscopic sinus surgery. We hypothesize that the use of three‐dimensional (3D) surgical planning software improves resident performance, as measured by blinded supervising surgeon evaluations. This study aims to assess whether 3D planning software enhances resident performance during frontal sinusotomy in live surgical cases.MethodsThis is a prospective trial involving unblinded self‐evaluations and blinded evaluations from supervising surgeons. Participants alternated between an experimental and control arm. Participants were residents from their second through fifth year of residency, with a total of 9 participants included in the study.ResultsForty‐one frontal sinusotomies were included. More challenging and less challenging cases were separated for analysis. Among more challenging procedures, blinded attendings rated resident performance on a scale of 1 to 100 on a number of parameters. They reported residents using 3D planning software were more prepared (77.1 vs. 67.3, p = 0.047), more atraumatic (78.2 vs. 59.1, p = 0.002), better cannulated the frontal sinus (77.0 vs. 51.5, p = 0.008), and participated in more of the procedure (53.6% vs. 30.1%, p = 0.05). On self‐evaluations, residents reported they were more prepared (82.6 vs. 55.3, p < 0.001), better cannulated the frontal sinus (77.9 vs. 47.4, p = 0.013), and better identified the frontal sinus drainage pathway on computed tomography imaging (82.1 vs. 51.9, p = 0.001) when utilizing 3D planning.ConclusionsResident performance in frontal sinusotomy was significantly improved when they prepared with 3D planning software prior to challenging frontal sinusotomy cases.Level of Evidence2.Keywords: endoscopic sinus surgery, frontal recess, frontal sinus, frontal sinusotomy, navigation, resident education, resident performance, simulation, surgical education, surgical planning Introduction Endoscopic sinus surgery (ESS) has evolved greatly over the last 30 years, and an otolaryngology trainee's ability to perform this procedure safely is a competency that must be achieved prior to independent practice [1]. Paranasal sinus anatomy, and in particular frontal sinus anatomy, varies greatly among patients [2, 3]. While many components of sinus surgery can be done with a zero degree endoscope and straight instruments, accessing the frontal sinus poses a unique challenge as it typically requires the use of curved instruments and angled endoscopes [4, 5]. When surgical trainees learn how to open the drainage pathway from the frontal sinus, a procedure called frontal sinusotomy, they must be adept in using these instruments via an angled view while applying a detailed three‐dimensional (3D) understanding of a patient's unique anatomy [6]. This is of particular importance as opening the frontal sinus is fraught with higher failure rates than other sinuses [7, 8, 9, 10]. Furthermore, frontal sinusotomy is associated with rare but potentially significant complications like orbital hematoma and cerebrospinal fluid leak [11, 12]. Surgical trainees must have an intimate understanding of each patient's unique frontal sinus anatomy to successfully perform a frontal sinusotomy. Typically, trainees will review patients' computed tomography imaging beforehand [13]. An influential teaching framework created by PJ Wormald prompts learners to conceptualize cells near the frontal sinus as a stack of “building blocks” [14, 15]. These cells must be navigated and removed in order to create an adequate drainage pathway for the frontal sinus in patients requiring frontal sinus surgery. Novel surgical planning tools have been developed to map out a surgical pathway in three dimensions using the “building blocks” framework as a conceptual foundation. Linxweiler et al. studied the use of this technology before sinus surgery and found it to be well‐received by surgeons without any increase in complication rates or operative time [16]. Agbetoba et al. employed similar technology as a resident education tool and found that residents reported improved understanding of frontal sinus anatomy in simulated cases [17]. While these are encouraging applications, the impact of 3D surgical planning on resident technical performance during frontal sinusotomy in real patient care scenarios has not yet been studied. Similar applications in other surgical fields suggest this approach can be particularly helpful for resident trainees and can improve patient outcomes. Sugiyama et al. used a preoperative virtual reality system to study unique patient anatomy before microvascular neurosurgery [18]. Trainees reported this technology significantly improved their understanding of patient anatomy and decision making in critical steps of the procedure. Virtual planning used in other specialties like spine surgery and urology improved operative time and blood loss can be reduced when this technology is utilized [19, 20]. While methods are heterogeneous among various specialties and studies, there is a growing body of literature that suggests 3D planning can be an invaluable tool in preparation for surgeries [21]. Within the field of otolaryngology, the impact of 3D‐planning software on resident performance has not been studied when applied to actual surgical cases involving frontal sinusotomy. We propose that the use of 3D‐planning software before sinus surgery cases can be an innovative, effective, and feasible way to improve resident frontal sinusotomy performance and dissection success when compared to their standard preparation methods. Materials and Methods Settings and Participants We recruited Otolaryngology residents at a single institution in their second through fifth years of training to participate in this study from December 2022 to February 2024. All junior (2nd and 3rd year) and senior (4th and 5th year) residents were eligible for recruitment, and we had no exclusions or residents who opted out. Study approval was obtained by The Research Subjects Review Board at the participating institution and all participants (resident surgeons) provided informed consent to participate in all study activities prior to enrollment. Interventions Residents were trained to use a novel 3D‐planning software (Scopis ENT Software with Target Guided Surgery, Stryker Corp., Portage, MI) that allows for graphical mapping of the frontal recess and the expected frontal sinus drainage pathway in three dimensions (Figure 1). Residents were instructed to alternate their preparation method for ESS which included frontal sinusotomy either with the standard preparation method or standard preparation plus the use of 3D‐planning software. Standard preparation for residents involved imaging review with tri‐planar (3 separate viewing panels showing axial, coronal, and sagittal CT images) reconstruction software with fellow residents and attending rhinologists. The 3D‐planning task took approximately 15 min to complete before each procedure. Only primary or revision procedures involving Draf IIA or Draf IIB were included [22]. A computerized randomization program was utilized to dictate the start condition for each resident, either standard preparation or additional 3D‐planning, followed by an alternating preparation schedule. Attending surgeons were blinded to the method of resident preparation throughout the study. Example of a right sided frontal recess mapping with the expected frontal sinus drainage pathway using 3D‐planning software. Pertinent cells in the frontal recess are labeled and a curvilinear tube (pink) is drawn to represent the expected frontal sinus drainage pathway. ANC, agger nasi cell; BE, bulla ethmoidalis; SAC, supra agger cell; SBC, suprabullar cell. Outcomes Measured After each surgery the resident and attending rhinologist completed a postoperative questionnaire assessing subjective measures of 3D‐planning utility and intraoperative performance (Table 1). These instruments were designed by the authors with the intent of measuring resident performance when performing tasks unique to frontal sinusotomy such as natural drainage pathway identification and tissue handling metrics. Attending rhinologists ranked the procedure difficulty after each case on a scale of 0 to 100. A score of 50 would indicate an average difficulty while higher scores indicated greater difficulty. TABLE 1Postoperative questionnaires collected from residents and attendings regarding the perception of the case difficulty and the resident's performance.Postoperative questionnairesResident self‐evaluationScoreHow would you rank your preparedness for this procedure?Not prepared (0)–very well prepared (100)How technically difficult was this case?Not difficult (0)–extremely difficult (100)How well could you identify and cannulate the frontal sinus?Very poor (0)–excellent (100)How easily were you able to identify the frontal sinus drainage pathway on CT imaging?Unable to identify (0)–identified easily (100)Postoperative questionnairesAttending evaluation of residentScoreHow would you rank your resident's preparedness for this procedure?Not prepared (0)–very well prepared (100)How technically difficult was this case?Not difficult (0)–extremely difficult (100)How well could your resident identify and cannulate the frontal sinus?Very poor (0)–excellent (100)How traumatic was your resident's tissue handling during attempted frontal sinus identification and cannulation?Very traumatic (0)–completely atraumatic (100)What percentage of the frontal sinusotomy did the resident perform?0%–100% Postoperative questionnaires collected from residents and attendings regarding the perception of the case difficulty and the resident's performance. Analysis of the Outcomes Analysis was performed by comparing “more challenging” and “less challenging” procedures. A “more challenging” procedure was determined to be that which had a difficulty score of 50 or greater. A “less challenging” procedure had a difficulty score of less than 50. To account for the repeated measures within residents and patients, and to assess the overall impact of 3D planning across multiple performance metrics simultaneously, a multivariate linear mixed model (MLMM) was built in R version 4.5.1 (R Foundation for Statistical Computing, Vienna, Austria). This omnibus test included preparation method and the seven performance metrics analyzed as fixed effects, along with interactions. Post hoc two‐tailed independent sample t‐tests were used when appropriate with means and standard deviations (SD) reported. Statistical significance was determined utilizing a p‐value of less than or equal to 0.05. Procedures that lacked both an attending rhinologist and resident postoperative survey were excluded from the data analysis. Statistical analysis was also performed using IBM SPSS Statistics, version 29.0.2.0. Results Of the 12 residents eligible for enrollment during the study period, 9 residents were recruited and participated in the study. There were 5 junior residents (postgraduate years 2 and 3) and 4 senior residents (postgraduate years 4 and 5), which represents a mix of minimally to experienced sinus surgery trainees. After a study period of 10 months, a total of 41 frontal sinusotomies, 16 of which were revision (previously had sinus surgery which failed) procedures, with complete survey responses included for analysis. The distribution of procedure difficulty is demonstrated in Figure 2. A bimodal distribution was found, and further analysis was performed by isolating “more challenging” and “less challenging” cases. Distribution of case difficulty as determined by attending rhinologist ratings. Green indicates “less challenging” cases (under 50 out of 100) and red indicates “more challenging” cases (50 out of 100 or greater). A MLMM was conducted to assess the overall impact of 3D planning software on seven resident performance metrics, accounting for resident and patient variability. For the full dataset, significant main effects were observed for both preparation method (F(1, 18.71) = 6.60, p = 0.019) and outcome type (F(6, 32.44) = 2.57, p = 0.038). However, the interaction between preparation method and outcome type was not statistically significant (F(6, 241.12) = 0.91, p = 0.491), indicating no differential impact of 3D planning across the various performance measures. When the MLMM was restricted to more challenging procedures, the main effect of preparation method became highly significant (F(1, 16.36) = 11.48, p = 0.004), and the main effect of outcome type remained highly significant (F(6, 28.59) = 6.57, p < 0.001). The interaction between preparation method and outcome type in challenging cases also remained nonsignificant (F(6, 169.20) = 0.86, p = 0.526). Conversely, for less challenging procedures, the main effect of preparation method was not significant (F(1, 5.47) = 0.03, p = 0.868), while the main effect of outcome type was highly significant (F(6, 23.97) = 5.41, p = 0.001) with a significant interaction between preparation method and outcome type (F(6, 62.83) = 3.08, p = 0.010). Given these results, 3D planning appears to be highly beneficial across performance measures, especially in the more challenging cases. Attending Rhinologist Evaluations In more challenging procedures, attending rhinologists found the residents who prepared with 3D‐planning software had significantly improved tissue handling (standard preparation: mean = 59.1, SD = 12.2; 3D‐planning: mean = 78.2, SD = 17.5; p = 0.002), preparedness (standard preparation: mean = 67.3, SD = 14.3; 3D‐planning: mean = 77.1, SD = 9.6; p = 0.047), and ability to identify and cannulate the frontal sinus drainage pathway (standard preparation: mean = 51.5, SD = 27.6; 3D‐planning: mean = 77.0, SD = 19.4; p = 0.008). Residents also performed a greater percentage of the frontal sinusotomy rather than observing, as graded on a 0%–100% scale, if they prepared with the 3D‐planning software (standard preparation: mean = 30.1, SD = 31.3; 3D‐planning: mean = 53.6, SD = 30.3; p = 0.050) (Figure 3). Attending evaluation means of resident performance by “less challenging” or “more challenging” cases. Solid colored bars are cases prepared for in a standard fashion, while striped bars represent cases prepared for with 3D‐planning software. Blue bars are “less challenging” cases and yellow bars are “more challenging.” Significant results marked with their associated p‐value. Among less challenging procedures, attending rhinologists reported no statistically significant difference in resident tissue handling (standard preparation: mean = 74.3, SD = 14.5; 3D‐planning: mean = 55.0, SD = 21.2; p = 0.091), preparedness (standard preparation: mean = 70.6, SD = 7.3; 3D‐planning: mean = 68.8, SD = 16.5; p = 0.785), percentage of the frontal sinusotomy completed (standard preparation: mean = 91.0, SD = 7.0; 3D‐planning: mean = 93.8, SD = 9.5; p = 0.592), or ability to identify and cannulate the frontal sinus (standard preparation: mean = 84.4, SD = 12.2; 3D‐planning: mean = 78.75, SD = 9.5; p = 0.442) when comparing standard preparation to 3D‐planning software (Figure 3). Resident Self‐Evaluations In more challenging procedures, residents who prepared with the 3D‐planning software reported significantly greater preparedness (standard preparation: mean = 53.3, SD = 9.7; 3D‐planning: mean = 82.6, SD = 10.6; p < 0.001), ability to identify and cannulate the frontal sinus during the procedure (standard preparation: mean = 47.4, SD = 32.5; 3D‐planning: mean = 77.9, SD = 25.3; p = 0.013), and ability to identify the frontal sinus drainage pathway on CT imaging (standard preparation: mean = 51.9, SD = 30.0; 3D‐planning: mean = 82.1, SD = 17.3; p = 0.001). There was no statistically significant difference in the residents' perception of the technical difficulty of the procedure between preparation methods (standard preparation: mean = 67.7, SD = 26.9; 3D‐planning: mean = 52.6, SD = 26.4; p = 0.192) (Figure 4). Resident self‐evaluation means by “less challenging” or “more challenging” cases. Solid colored bars are cases prepared for in a standard fashion, while striped bars represent cases prepared for with 3D‐planning software. Blue bars are “less challenging” cases and yellow bars are “more challenging.” Significant results marked with their associated p‐value. In less challenging procedures, resident self‐assessments did not demonstrate a statistically significant difference in their perceived preparedness (standard preparation: mean = 69.9, SD = 18.2; 3D‐planning: mean = 87.5, SD = 6.8; p = 0.096), the technical difficulty of the procedure (standard preparation: mean = 39.6, SD = 22.5; 3D‐planning: mean = 52.8, SD = 17.2; p = 0.34), their ability to identify and cannulate the frontal sinus (standard preparation: mean = 72.9, SD = 27.6; 3D‐planning: mean = 65.5, SD = 17.7; p = 0.64), or their ability to identify the frontal sinus drainage pathway on CT imaging (standard preparation: mean = 72.1, SD = 24.1; 3D‐planning: mean = 77.5, SD = 9.9; p = 0.68) (Figure 4). Discussion Extended reality technologies like 3D surgical planning, virtual reality, and surgical simulation have been utilized to a limited degree in frontal sinusotomy, although their impact on resident performance has not been studied in this setting [17, 23]. When residents prepared for frontal sinusotomy procedures using 3D planning software in more challenging cases, this study showed they scored better on performance evaluations by supervising surgeons blinded to preparation method along with residents' own self‐assessments. When using this preplanning technology in simulated scenarios, Agbetoba et al. showed an improvement in resident‐reported understanding of frontal sinus drainage pathways [17]. Latour et al. used the same technology aided by virtual reality to overlay planning points and proximity alerts for learners performing ESS on a 3D printed model [23]. They showed residents reported improved confidence in their surgical skills and had fewer complications during this simulated task. This study demonstrates the innovative application of this novel technology in real cases with assessment by surgical educators blinded to trainee preparation. We found comparable improvements in resident self‐reported performance in more challenging cases when compared to the work of Agbetoba et al. and Latour et al. [17, 23]. Furthermore, attending surgeons found resident performance was significantly better in more challenging cases when 3D‐planning was utilized as measured by tissue handling metrics and percentage of the case completed by the resident. In less challenging procedures the resident surgeons performed more than 90% of the critical steps regardless of the preparation condition, although their participation dropped to only 30% during more challenging procedures in our control group. The addition of the 3D‐planning task was associated with an increased case completion percentage to 53.6% for more challenging cases. These residents also demonstrated improved tissue handling despite their increased operative exposure and perceived increased difficulty in more challenging cases. These data suggest the 3D‐planning task can be used during more challenging procedures to maximize the educational benefit, exposure, and participation for a resident. The demonstrable improvement in both resident participation and tissue handling after using the 3D planning software in preparation for more challenging cases is unexpected. It is possible the reinforcement of a patient's anatomy allows the resident to focus on other critical facets of the procedure, including good tissue handling and decision making through critical steps. Cognitive load theory suggests that learners have a fixed capacity of working memory and information processing [24]. Components of a given task that might draw on those finite resources include implicit task complexity, extraneous distractions in the learning environment, and relating prior knowledge and experience to details germane to the task at hand. Using this framework, we can imagine the act of learning about a patient's unique anatomical features with an optimized platform like 3D surgical planning software can reduce the cognitive load on the trainee. Better understanding of patient anatomy can reduce the intrinsic complexity of the task and allow for better attention to other demands of a given procedure. We did not find any improvement in resident performance when looking only at less challenging procedures. While this subgroup was small with only 12 frontal sinusotomies included, it is worth considering that there may be less measurable value for an education intervention under conditions where residents already should perform well. For example, in less challenging procedures, attendings reported residents were performing on average 91% of the frontal sinusotomy in the SP group and this grew to 94% in the 3D‐planning group. One weakness of this study is the use of metrics that have not been validated. There is significant heterogeneity related to study design within the field of surgical education and simulation when studying sinus surgery performance. The current tools such as the Objective Structured Assessment of Technical Skills (OSAT) and sinus surgery modified OSAT are not well‐suited to assess the unique components of frontal sinusotomy [25, 26]. In particular, the sinus surgery modified OSAT contains only two metrics relating to the frontal sinus and it does not encompass key components of the procedure like identification of the sinus drainage pathway [26]. To address this concern, we created new measures expanding on those used in comparable studies by Agbetoga et al. and Lin et al. while still capturing specific technical steps unique to frontal sinusotomy [17, 23]. Another limitation is that the amount of time spent preparing for a given procedure was not recorded. It is possible that some of the observed improvements in resident performance were due to greater time spent examining patient imaging rather than an intrinsic benefit introduced by the 3D‐planning software. Additionally, utilizing post hoc categorization of surgical difficulty has the potential for shifting results away from the null hypothesis of no difference between intervention groups. However, given that residents were performing 91% of less challenging cases regardless of 3D‐planning use status, significant ceiling effects would be observed by including this group in an overall analysis. This is consistent with prior education theory frameworks such as Blooms Taxonomy [27], and previous work in the surgical education field [28, 29, 30, 31], which has shown that as you approach the ceiling of an evaluation instrument, the ability to demonstrate skill acquisition or show improvement over time is diminished. Future endeavors should explore how advanced tools can be implemented for sinus surgery education and performance improvement. Additionally, further endeavors should be geared toward developing validated metrics specific to frontal sinusotomy. ESS lends itself to competency assessments and skill acquisition measures given access to surgical video and the expanded use of intraoperative navigation. Extending the technology described in this study to intraoperative image guidance and augmented reality is a logical next step in our aim to improve the resident educational experience and improve competency acquisition. Conclusion Frontal sinusotomy is a challenging component of ESS with a steep learning curve that requires a strong grasp of highly variable patient anatomy and masterful handling of curved or angled instruments. When residents reviewed patient anatomy with a 3D‐planning software prior to frontal sinusotomy, they demonstrated significantly improved operative performance, preparedness, and completed a greater percentage of the procedure in more challenging cases. Future study on the use of 3D‐planning to improve resident education is warranted and will enable other learning and assessment tools such as augmented reality and motion analysis. Funding An Education Grant provided by Stryker allowed for free access to 3D planning software for residents and attending surgeons involved in this study. Ethics Statement This study was approved by the University of Rochester Institutional Review Board. Conflicts of Interest A.K.: No disclosures. L.‐X.M.: Serves as site principal investigator for studies sponsored by Optinose with fees paid to the institution. Stryker education grant recipient, which allows for free access to 3D planning software for residents and attending surgeons involved in this study. M.M.C.: No disclosures. I.L.S.: Stryker education grant recipient, which allows for free access to 3D planning software for residents and attending surgeons involved in this study. Acknowledgments We acknowledge Dr. Paul Allen's contributions to this project with regulatory support, study design, and statistics consultation. Kelly A., Man L.‐X., Carter M. M., and Schmale I. L., “Improving Resident Frontal Sinusotomy Education With Three‐Dimensional Surgical Planning Software,” Laryngoscope Investigative Otolaryngology 11, no. 2 (2026): e70407, 10.1002/lio2.70407. Prior Oral Presentation: American Rhinologic Society Meeting at the Combined Otolaryngology Spring Meetings, Chicago, Illinois, United States of America, May 16, 2024. Data Availability Statement The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions. References Associated Data Data Availability Statement The data that support the findings of this study are available on request from the corresponding author. The data are not publicly available due to privacy or ethical restrictions.