Development and internal validation of a multivariable MRI-based radiomics prediction model for preoperative cervical lymph node metastasis in thyroid cancer Authors: Shuo Shen, Mingrui Zhang, Fuling Huang, Chunyi Zhou, Yajing Liang, Yimin Liang, Huimei Yang, Ruilin Xiang, HaoJun Tang, Fu Li Published: 2026 ABSTRACT AbstractBackgroundAccurate preoperative assessment of cervical lymph node metastasis (LNM) is crucial for surgical planning in thyroid cancer (TC), yet conventional ultrasound and computed tomography have limited sensitivity. This study aimed to develop and internally validate a magnetic resonance imaging (MRI)-based radiomics prediction model for preoperative LNM status in patients with TC.MethodsWe prospectively enrolled 97 consecutive patients with pathologically confirmed TC who underwent preoperative MRI and cervical lymph node dissection at The First Affiliated Hospital of Guangxi Medical University from April 2017 to January 2019. The reference standard was histopathology. Patients were randomly divided into training and validation sets at a 7:3 ratio. A total of 1,691 radiomics features were extracted from T2-weighted imaging (T2WI) and T1-weighted heterogeneous contrast-enhanced imaging (T1C+), respectively. Using the Boruta algorithm, we selected a subset of optimized features for the radiomics signature, and a random forest algorithm was used to construct the radiomics model. Subsequently, the ability of this model to predict the status of lymph nodes of patients with TC was evaluated through receiver operating characteristic (ROC) curve analysis.ResultsThe combined model had better diagnostic performance than did models based on T2WI and T1C+ alone. Of the 97 patients, 61 (62.9%) were LNM-positive. In the training set, the area under the curve (AUC) values for the T2WI, T1C+, and combined models were 0.914, 0.959, and 0.963, respectively; the corresponding AUC values in the validation set were 0.853, 0.881, and 0.900, respectively. In the validation set, the combined model achieved an AUC of 0.900, with a sensitivity of 0.944 and specificity of 0.500.ConclusionsThe MRI based radiomics model shows promising discriminative ability for preoperative LNM prediction in TC, but its low specificity (0.500) limits standalone clinical utility. External validation in larger cohorts is required before clinical implementation.Keywords: Thyroid cancer (TC), magnetic resonance imaging (MRI), radiomics, cervical lymph node status Highlight box Key findings • Magnetic resonance imaging (MRI)-based radiomics models derived from T2-weighted imaging (T2WI) and contrast-enhanced T1-weighted imaging (T1C+) demonstrated good performance in predicting cervical lymph node metastasis (LNM) in patients with thyroid cancer (TC). • The combined model achieved the best diagnostic performance, with an area under the curve of 0.963 in the training cohort and 0.900 in the validation cohort. What is known and what is new? • Cervical LNM is common in TC and significantly influences the selection of surgical strategy and patient prognosis. Ultrasound and computed tomography are limited in their ability to accurately assess lymph node status before surgery. • This study developed an MRI-based radiomics model consisting of features extracted from T2WI and T1C+ images. The combined MRI radiomics model showed improved predictive performance as compared with the single-sequence models. What is the implication, and what should change now? • MRI radiomics may provide a noninvasive approach for the preoperative evaluation of LNM in patients with TC. • This method could assist clinicians in risk stratification and individualized surgical planning, potentially reducing unnecessary prophylactic lymph node dissection. • Further optimization and external validation are still required before clinical application. Introduction Thyroid cancer (TC) is one of the most common malignant tumors, and its incidence rate is on the rise globally. Papillary TC (PTC) accounts for 84% of TC cases, making it the most common thyroid malignancy (1-3). Patients with PTC can expect a generally good prognosis and relatively long survival (4). Although PTC is considered an indolent tumor, the presence of cervical lymph node metastasis (LNM) can elevate the clinical risk (5). Neck LNM is a high risk factor for local recurrence (6), and is the focus of surgical treatment for TC (7). According to the 2015 American Thyroid Association (ATA) guidelines, prophylactic lymph node dissection (LND) does not significantly improve long-term survival (5) and is associated with a high risk of complications, such as permanent hypoparathyroidism and recurrent laryngeal nerve damage (8). Consequently, the accurate preoperative evaluation of the cervical lymph node status in patients with TC is critical to the formulation of individualized surgical plans and determining patient prognosis. Ultrasonography (US) is the most commonly used method for the preoperative assessment of cervical lymph node involvement but is limited by factors such as instrument resolution and operator experience. Moreover, US cannot sufficiently evaluate the parapharyngeal and cervical lymph nodes (9), with the sensitivity of US diagnosis being reported to be 63% (10). Computed tomography (CT) can be used to evaluate LNM, but it is not routinely recommended (5). With the development of computer science and imaging postprocessing, radiomics has emerged as a promising diagnostic technology. Radiomics involves the high-throughput extraction of a wide range of quantitative features and can transform medical images into available high-dimensional data. These data can then be quantitatively analyzed, and predictive models can be established through artificial intelligence methods to support clinical decision-making (11,12). The diagnostic value of radiomics for LNM, peritumoral invasion, and prognosis has been established in several studies (13-15). Moreover, radiomics has been demonstrated to be superior to US and CT in the preoperative prediction of LNM in patients with PTC (16,17) Magnetic resonance imaging (MRI) offers superior soft‑tissue contrast and multiparametric capabilities, yet its radiomic potential for LNM prediction has been rarely explored. This study aimed to develop a radiomics model based on T2-weighted imaging (T2WI) and contrast-enhanced T1-weighted imaging (T1C+) and to evaluate its ability to preoperatively diagnose cervical lymph node status in patients with TC. We present this article in accordance with the TRIPOD reporting checklist (18) (available at https://gs.amegroups.com/article/view/10.21037/gs-2026-0259/rc). Methods Study design and participants This study was conducted in accordance with the Declaration of Helsinki and its subsequent amendments. This prospective study was approved by the Ethics Committee of The First Affiliated Hospital of Guangxi Medical University (approval No. 2021[KY‑E‑034]). All patients provided written informed consent before the study. Initially, 135 patients who were pathologically diagnosed with TC after surgery between April 2017 and January 2019 were included. Of these patients, 97 were ultimately enrolled; the flowchart of participant inclusion is shown in Figure 1. The inclusion criteria were as follows: (I) pathologically confirmed TC; (II) previous cervical LND; (III) preoperative MRI; (IV) no previous history of thyroid surgery, biopsy, or head and neck cancer; and (V) no history of neck radiotherapy before MRI. Meanwhile, the exclusion criteria were: (I) no neck LND and (II) poor MRI imaging quality. Flowchart of patient enrollment. MR, magnetic resonance; ROI, region of interest; TC, thyroid cancer. Sample size A formal sample size calculation was not performed a priori; the sample was determined by the number of eligible consecutive cases during the study period. With 61 LNM-positive events and 10 final features retained in the model, the events-per-variable (EPV) ratio was 6.1, which is below the conventional threshold of 10–20 for logistic regression. Outcome assessment The reference standard for cervical LNM was histopathological examination of all resected lymph nodes from the surgical specimens. Pathological assessment was performed by two experienced pathologists who were blinded to the MRI findings and radiomics predictions. LNM was defined as the presence of any metastatic focus in at least one cervical lymph node. MRI acquisition MRI scans were performed for all patients 1–2 weeks before surgery using a MAGNETOM Verio 3.0-T device (Siemens Healthineers, Erlangen, Germany) equipped with an 8-channel orthogonal coil. Patients were positioned supine, head-first. The chin was elevated, the head was supported with a padded head cushion, and the hands were placed at the sides. The head was positioned within the coil so that the eyebrows were at the center of the coil. The MRI scanning included a T2WI fat-suppressed T2-weighted imaging sequence [time to repeat/time to echo (TR/TE) =2,000 ms/88 ms, layer thickness =4 mm, continuous scanning, field of view (FOV) =200 mm, number of excitations (NEX) =1] and T1WI sequence (TR/TE =210 ms/2.6 ms, layer thickness =4 mm, FOV =200 mm, NEX =2). The patients were trained in breathing techniques prior to the MRI examination, and they were required to maintain the same level of breath throughout the procedure. Example images are shown in Figure 2. Example of ROI delineation. (A,B) T1C+ and T2WI images of the same patient, respectively. (C,D) Delineated ROIs (yellow outline). (E) Three-dimensional image of the ROI. ROI, region of interest; T1C+, T1-weighted heterogeneous contrast-enhanced imaging; T2WI, T2-weighted imaging. Tumor segmentation and feature extraction MR images were used for tumor segmentation. First, T2WI and T1C+ images were input into the research workstation. Second, the lesions were manually segmented independently by a radiologist with 5 years of experience and a senior radiologist with 15 years of experience; for any discrepant results, the Deputy Director of Radiology was consulted to determine the final result. Semiautomatic delineation of the region of interest (ROI) was conducted along the edge of the lesion, and it was ensured that the lesion was completely visualized in the coronal and sagittal position. Areas of necrosis or calcification in the lesion were avoided. An example of ROI delineation is shown in Figure 2. Inter-observer reproducibility was assessed on a random subset of 30 cases; all extracted features demonstrated good consistency (intraclass correlation coefficient ≥0.89). In cases of multifocal TC, the largest lesion was selected for further analysis. Features from the T2WI and T1C+ images were extracted via Artificial Intelligence ToolKit version 3.0.0 (GE HealthCare, Chicago, IL, USA). A total of 1,691 features were extracted and classified into six groups: (I) gray-level histogram features, (II) shape features, (III) texture features, (IV) gray-level cooccurrence matrix features, (V) gray-level run length matrix features, and (VI) gray-level size zone matrix features. Model construction Patients were randomly assigned to training and validation set at a ratio of 7:3. In order to model the radiomics features in the training set and avoid overfitting, the Boruta algorithm was used for feature screening. The Boruta algorithm is a packaging algorithm based on random forest, which iteratively searches for all possible subsets of related properties and performs top-down screening of related features by comparing the importance of the original properties with the importance of the random implementation (19,20). After the sample size of the training set was accounted for, the 10 most important features were finally retained. Subsequently, the final model was constructed with these 10 features via a random forest algorithm and 10-fold cross-validation. Model validation and statistical analysis In the radiomics features model analysis, receiver operating characteristic (ROC) curve analysis was conducted to evaluate the performance of the model, with the area under the curve (AUC), accuracy, specificity, sensitivity, and accuracy metrics being recorded. The predictive performance of the combined model was rigorously assessed in the internal validation cohort, followed by an evaluation of its potential clinical utility. The default probability threshold of 0.5 was used to define LNM status (i.e., patients with a predicted probability ≥0.5 were classified as LNM-positive). In the statistical analysis of clinical characteristics, continuous variables were tested with the Mann-Whitney test, while categorical variables were tested with the Pearson chi-squared test. SPSS 26.0 (IBM, Armonk, NY, USA) was used to conduct these analyses. For all tests, P<0.05 was considered statistically significant. All statistical tests were two-sided. Results Patient characteristics This study included 97 patients with TC (61 lymph node-positive and 36 lymph node-negative). Tables 1,2 present the baseline data of patients. Age, sex, histological type, and tumor location did not differ significantly between lymph node-positive and -negative groups (P>0.05). Table 1Clinical characteristics of patients with TCCharacteristicLNMPYes (n=61)No (n=36)Age (years)45.2255.40.09Sex, n (%)0.62 Male11 (18.0)8 (22.2) Female50 (82.0)28 (77.8)Histological subtype, n (%)0.14 PTC61 (100.0)34 (94.4) MTC0 (0)1 (2.8) FTC0 (0)1 (2.8)FTC, follicular thyroid cancer; LNM, lymph node metastasis; MTC, medullary thyroid cancer; PTC, papillary thyroid cancer; TC, thyroid cancer. Clinical characteristics of patients with TC FTC, follicular thyroid cancer; LNM, lymph node metastasis; MTC, medullary thyroid cancer; PTC, papillary thyroid cancer; TC, thyroid cancer. Table 2Tumor locations in patients with TCLocationLNMPYes (n=104), n (%)No (n=61), n (%)Left lobe38 (36.5)19 (31.1)0.72Right lobe34 (32.7)20 (32.8)Isthmus32 (30.8)22 (36.1)LNM, lymph node metastasis; TC, thyroid cancer. Tumor locations in patients with TC LNM, lymph node metastasis; TC, thyroid cancer. Model performance Three predictive models were evaluated via ROC analysis, with the results being presented in Figures 3,4. In the training set, the AUC, accuracy, specificity, and sensitivity of the T2WI model were 0.914, 0.714, 0.800, and 0.667, respectively; those of the T1C+ model were 0.959, 0.607, 0.900, and 0.444, respectively; and those of the combined model were 0.963, 0.927, 0.917, and 0.933, respectively. The diagnostic performance from validation was comparable: the AUC, accuracy, specificity, and sensitivity of the T2WI model were 0.853, 0.714, 0.800, and 0.667, respectively; those of the T1C+ model were 0.881, 0.607, 0.900, and 0.444, respectively; and those of the combined model were 0.900, 0.786, 0.500, and 0.944, respectively. The AUC of combined model was slightly higher than those of the stand-alone models, indicating its superiority. ROC curves of the three RF models in the training set. AUC, area under the curve; CE, contrast-enhanced, referring to T1C+ model; RF, random forest; ROC, receiver operating characteristic. ROC curves of the three RF models in the validation set. AUC, area under the curve; CE, contrast-enhanced, referring to T1C+ model; RF, random forest; ROC, receiver operating characteristic. Discussion This study aimed to develop and internally validate an MRI radiomicsbased prediction model for preoperative cervical LNM in patients with TC. The combined T2WI + T1C+ model achieved an AUC of 0.900 in the validation set, which is comparable or slightly superior to prior CT-based models (AUCs 0.71–0.77) (17,21) and US-elastography radiomics models (AUC 0.832) (22). Comparison between training and validation performance. The combined model showed a decline in AUC from 0.963 (training) to 0.900 (validation), and specificity dropped markedly from 0.917 to 0.500. This discrepancy suggests notable model optimism, likely attributable to the limited sample size and the low EPV of 6.1. This underscores that our findings are preliminary and must be interpreted with caution. MRI, as a powerful imaging modality, can visualize the internal structures of objects at the micro and macro scale and provide 2D and 3D imaging in a noninvasive manner (23). Therefore, MRI radiomics features may serve as a reliable means to preoperatively diagnosing LNM. This study has several strengths. It is one of the few studies to explore MRI‑based radiomics for LNM prediction in TC. In this study, MRI radiomics features were examined in patients with TC as a means to assessing lymph node status. A complete randomization group design was used to minimize bias. The Boruta algorithm was used to select the features. This algorithm selects all features associated with the dependent variable, rather than those specific to the model, in order to minimize the model cost. This further provides a comprehensive understanding of the influencing factors of the dependent variable, leading to more suitable and efficient feature selection. Therefore, we used the Boruta algorithm for feature selection in the first stage, retaining the 10 most optimal features. In subsequent stages, the final model was constructed through a random forest algorithm. An important purpose of radiomics is to construct predictive models of treatment response through use of phenotypic features of tumor obtained from medical images. This capability is essential for personalized medicine, in which treatments are tailored to the characteristics of individual patients and their tumors (23). To our knowledge, there are only a handful of radiomic studies that have examined the determination of LNM status in patients with TC. One study examined the use of CT imaging features in predicting central LNM (CLNM) in patients with PTC, reporting a validation set AUC of 0.77 [95% confidence interval (CI): 0.55–0.99] (24). In a multicenter study, radiomics features extracted from CT images were significantly correlated with CLNM, with ROC curve values 0.747 (95% CI: 0.706–0.782), 0.710 (95% CI: 0.634–0.786), and 0.764 (95% CI: 0.654–0.875) in the training, internal validation, and external validation sets, respectively (17). Another study demonstrated that radiomics based on preoperative shear wave elastography images and the corresponding B-mode ultrasound images have the potential to predict LNM, with the AUC in the validation cohort being 0.832 (95% CI: 0.749–0.916) (22). In our study, we evaluated the ability of MRI radiomics to determine cervical lymph node status. We found that the models consisting of radiomics features from T2WI and T1C+ images performed well diagnostically, providing greater accuracy than those reported in the three aforementioned studies. The model with the combined features of the two image types produced a better diagnostic performance (AUC =0.9). Several important limitations must be acknowledged. First, the sample size is small (n=97), and the EPV of 6.1 is below the recommended minimum of 10–20, increasing the risk of overfitting. Although we employed Boruta selection and cross‑validation to mitigate this, the results should be considered hypothesis‑generating rather than definitive. Second, this was a single-centre study with internal validation only (random split); external validation in a larger, independent cohort is essential before clinical translation. Third, we did not perform decision curve analysis (DCA) or formal calibration testing (e.g., Hosmer-Lemeshow) due to the limited sample size, which we acknowledge prevents quantification of net clinical benefit and calibration accuracy. Fourth, manual tumor segmentation is time‑consuming and may limit routine applicability; automated segmentation methods are desirable. Fifth, we did not segment the cervical lymph nodes themselves due to their small size and poor MRI visualization; future work with higher‑resolution MRI could address this. Sixth, we did not include a clinical‑only model for comparison, which would have better illustrated the added value of radiomics. Despite these limitations, our study provides preliminary evidence that MRI radiomics may assist in preoperative risk stratification. Future multicenter studies with larger samples should incorporate DCA, calibration assessment, and automated segmentation to improve clinical applicability and generalizability. Conclusions T2WI and T1C+ imaging radiomics features were used to establish a model for preoperative prediction of cervical LNM in patients with TC. While the model shows promising discriminative ability, its low specificity precludes standalone clinical use at present. With further refinement, incorporation of clinical factors, and external validation in larger cohorts, MRI radiomics may eventually contribute to individualized surgical planning in TC. Supplementary The article’s supplementary files as