Value of Artificial Intelligence in Improving the Accuracy of Diagnosing TI-RADS Category 4 Nodules

Considerable heterogeneity is observed in the malignancy rates of thyroid nodules classified as category 4 according to the Thyroid Imaging Reporting and Data System (TI-RADS). This study was aimed at comparing the diagnostic performance of artificial intelligence algorithms and radiologists with different experience levels in distinguishing benign and malignant TI-RADS 4 (TR4) nodules.

Between January 2019 and September 2022, 1117 TR4 nodules with well-defined pathological findings were collected for this retrospective study. An independent external data set of 125 TR4 nodules was incorporated for testing purposes. Traditional feature-based machine learning (ML) models, deep convolutional neural networks (DCNN) models and a fusion model that integrated the prediction outcomes from all models were used to classify benign and malignant TR4 nodules. A fivefold cross-validation approach was employed, and the diagnostic performance of each model and radiologists was compared.

In the external test data set, the area under the receiver operating characteristic curve (AUROC) of the three DCNN-based secondary transfer learning models-InceptionV3, DenseNet121 and ResNet50-were 0.852, 0.837 and 0.856, respectively. These values were higher than those of the three traditional ML models-logistic regression, multilayer perceptron and random forest-at 0.782, 0.790, and 0.767, respectively, and higher than that of an experienced radiologist (0.815). The fusion diagnostic model we developed, with an AUROC of 0.880, was found to outperform the experienced radiologist in diagnosing TR4 nodules.

The integration of artificial intelligence algorithms into medical imaging studies could improve the accuracy of identifying high-risk TR4 nodules pre-operatively and have significant clinical application potential.