Who Benefits From Sinus Surgery? Comparing Generative AI and Supervised Machine Learning for Predicting Surgical Outcomes in Chronic Rhinosinusitis

Sayeed Shafayet Chowdhury, Snehasis Mukhopadhyay, Shiaofen Fang, Vijay R. Ramakrishnan · 2026

Read Who Benefits From Sinus Surgery? Comparing Generative AI and Supervised Machine Learning for Predicting Surgical Outcomes in Chronic Rhinosinusitis by Sayeed Shafayet Chowdhury, Snehasis Mukhopadhyay, Shiaofen Fang, Vijay R. Ramakrishnan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-13710.txt.

Introduction

Sayeed Shafayet Chowdhury and co-authors predict who gains from sinus surgery in 2026. Chronic rhinosinusitis is a long-term swelling of the sinuses that burdens daily life. Surgery helps some patients much and others far less. The team defines success as a set drop in the SNOT-22 score six months after surgery.

They compare generative AI with supervised machine learning for this forecast. Both use clinical data from before surgery, not scans alone. A sound forecast could guide patients and doctors to better choices. It could also spare some patients surgery that would not help them.

Catalog record

CREATORSayeed Shafayet Chowdhury, Snehasis Mukhopadhyay, Shiaofen Fang, Vijay R. Ramakrishnan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-13710

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Who Benefits From Sinus Surgery? Comparing Generative AI and Supervised Machine Learning for Predicting Surgical Outcomes in Chronic Rhinosinusitis Sayeed Shafayet Chowdhury, Snehasis Mukhopadhyay, Shiaofen Fang, Vijay R. Ramakrishnan Abstract Artificial intelligence has reshaped medical imaging, yet the use of AI on clinical data for prospective decision support remains limited. We study pre-operative prediction of clinically meaningful improvement in chronic rhinosinusitis (CRS), defining success as a ≥ \geq 8.9-point reduction in SNOT-22 at 6 months (MCID). In a prospectively collected cohort where all patients underwent surgery, we ask whether models using only pre-operative clinical data could have identified those who would have poor outcomes, i.e. those who should have avoided surgery. We benchmark supervised ML (logistic regression, tree ensembles, and an in-house MLP) against generative AI (ChatGPT, Claude, Gemini, Perplexity), giving each the same structured inputs and constraining outputs to binary recommendations with confidence. Our best ML model (MLP) achieves 85% accuracy with superior calibration and decision-curve net benefit; GenAI models underperform on discrimination and calibration across zero-shot setting. Notably, GenAI justifications align with clinician heuristics and the MLP’s feature importance, repeatedly highlighting baseline SNOT-22, CT/endoscopy severity, polyp phenotype, and physchology/pain comorbidities. We provide a reproducible tabular-to-GenAI evaluation protocol and subgroup analyses. Findings support an ML-first, GenAI-augmented workflow: deploy calibrated ML for primary triage of surgical candidacy, with GenAI as an explainer to enhance transparency and shared decision-making. I Introduction Chronic Rhinosinusitis (CRS) is clinically heterogeneous, and patients may experience variable quality-of-life (QoL) gains following endoscopic sinus surgery (ESS) [ 1 , 5 ] . This variability complicates pre-operative decision-making, underscoring the need for individualized pre-operative benefit prediction that can inform shared decisions and set expectations. This consideration is particularly salient within value-based care models that are increasingly shaping contemporary healthcare delivery. We operationalize clinical benefit using the Sino-Nasal Outcome Test-22 (SNOT-22) minimal clinically important difference (MCID), defining success as a \geq 8.9 -point reduction at six months post-operatively [ 2 ] . Objective disease burden, summarized by the Lund–Mackay CT score and endoscopic severity scales, together with phenotype (CRSwNP vs. CRSsNP) and comorbidities further modulate expected benefit observed in cohort studies of ESS outcomes [ 3 , 4 , 5 ] . Large language models (LLMs) are increasingly used for clinical reasoning [ 7 ] , yet their performance relative to tuned, supervised tabular machine-learning (ML) models trained on structured pre-operative data remains unclear. While ML on electronic health records has shown promise [ 6 ] , rigorous, head-to-head comparisons between calibrated tabular models and multiple generative AI (GenAI) systems using the same inputs, clinically grounded endpoints, and responsible-use constraints are sparse. Addressing this gap, we construct a transparent benchmark to test whether pre-operative data can be used to identify patients unlikely to achieve MCID (i.e., those who, in retrospect, should not have been recommended surgery), and to quantify trade-offs between ML classifiers and several GenAI systems under standardized prompting. The main contributions of this work are- (1) To our knowledge, this is the first comprehensive evaluation of generative AI (GenAI) systems for predictive clinical outcome modeling on structured, pre-operative data in chronic rhinosinusitis (CRS). We benchmark multiple state-of-the-art LLMs (e.g., ChatGPT, Claude, Gemini, Perplexity) against tuned, calibrated tabular ML baselines (logistic regression, tree ensembles, and an in-house MLP) on the clinically grounded endpoint of achieving SNOT-22 MCID. (2) We provide standardized expert-guided zero-shot prompts that serialize structured inputs, constrain outputs to binary recommendations with confidence, and analyze the results. (3) We also examine the reasoning process of GPT models [ 7 , 8 ] and, notably, find that the features they emphasize align closely with expert judgment and with the top predictors identified by our ML model. (4) This framework enables practical safeguards for real-world deployment (PHI handling, model/version transparency) and an ML-first, GenAI-augmented workflow in which a calibrated classifier provides primary triage and GenAI serves as a secondary explainer to enhance transparency and shared decision-making [ 6 , 7 ] . Together, these elements establish a clinically grounded, reproducible comparison of ML and GenAI for pre-operative CRS decision support, emphasizing not only accuracy but also calibration, net benefit, and responsible use. II Background & Related Work ESS outcome prediction with supervised ML. Numerous studies have studied endoscopic sinus surgery (ESS) outcomes using pre-operative clinical and imaging summaries to identify risk factors for failure, with emphasis on patient-reported symptoms (e.g., SNOT-22), objective disease burden (CT/endoscopy), phenotype (CRSwNP vs. CRSsNP), and key comorbidities. Multi-institutional cohort work has established that baseline QoL and objective disease severity are associated with post-operative gains, while mood/pain comorbidities can attenuate benefit [ 5 ] . These variables map naturally to tabular machine-learning (ML) pipelines (logistic regression, tree ensembles, neural networks) and provide a structured substrate for prediction once leakage is controlled and calibration is addressed. Our use of SNOT-22 as the primary endpoint and CT/endoscopy as objective correlates follows standard practice in CRS outcomes research [ 2 , 3 , 4 , 5 , 16 ] . LLMs for clinical reasoning and tabular inference. Large language models (LLMs) have demonstrated broad clinical knowledge and emergent reasoning capabilities on textual tasks [ 7 ] , and can produce confidence-like signals that partially reflect uncertainty awareness [ 8 ] . However, when repurposed for predictive inference on structured clinical data, important limitations arise: (i) sensitivity to prompt phrasing and few-shot selection, (ii) instability across sampling runs, and (iii) weaker probability calibration than tuned tabular ML models. Consequently, rigorous comparison against calibrated ML baselines is essential, using metrics that reflect both discrimination and clinical decision quality (e.g., F1 score, AUC) [ 10 , 9 ] . CRS guidelines and MCID rationale. Contemporary CRS guidance emphasizes symptom severity and objective disease burden in surgical selection, with phenotype-stratified considerations and shared decision-making [ 1 , 17 , 18 , 19 ] . The SNOT-22 is a validated instrument [ 2 ] ; an improvement of \geq 8.9 points at follow-up is widely used as a pragmatic minimal clinically important difference (MCID) to denote meaningful benefit at the patient level. Objective disease is commonly summarized by the Lund–Mackay CT score and endoscopic severity scales (e.g., Lund–Kennedy), which correlate with anatomic disease and, in aggregate, with expected post-operative gains [ 3 , 4 , 5 ] . Positioning of this study. Prior LLM evaluations in healthcare have largely focused on question answering, summarization, or qualitative reasoning [ 7 , 8 ] , while prior ESS outcome studies have relied on supervised ML within single method families and without GenAI comparators [ 5 ] . Most of these studies are about making diagnosis of complex cases, not guiding or predicting trajectory. Our study differs in the following ways: (i) focus is on predicting surgery outcome and trajectory, ii) performance analysis of multi-model GenAI benchmarks (ChatGPT, Claude, Gemini, Perplexity) under standardized input prompts and constrained outputs; (iii) strong emphasis on calibration and clinical utility (F1 score, AUC, P-R curves) alongside discrimination [ 9 , 10 ] , (iv) investigating the feature importance as perceived by our in-house ML model as well as the decision logic of the GenAI models and their alignment with human experts. III Dataset To train predictors of surgical benefit for CRS, we focus on pre-operative, routinely available clinical factors

Read the complete text