Histological Subtype Classification of Non-Small Cell Lung Cancer with Radiomics and 3D Convolutional Neural Networks

Non-small cell lung carcinoma (NSCLC) is the most common type of pulmonary cancer, one of the deadliest malignant tumors worldwide. Given the increased emphasis on the precise management of lung cancer, identifying various subtypes of NSCLC has become pivotal for enhancing diagnostic standards and patient prognosis. In response to the challenges presented by traditional clinical diagnostic methods for NSCLC pathology subtypes, which are invasive, rely on physician experience, and consume medical resources, we explore the potential of radiomics and deep learning to automatically and non-invasively identify NSCLC subtypes from computed tomography (CT) images. An integrated model is proposed that investigates both radiomic features and deep learning features and makes comprehensive decisions based on the combination of these two features. To extract deep features, a three-dimensional convolutional neural network (3D CNN) is proposed to fully utilize the 3D nature of CT images while radiomic features are extracted by radiomics. These two types of features are combined and classified with multi-head attention (MHA) in our proposed model. To our knowledge, this is the first work that integrates different learning methods and features from varied sources in histological subtype classification of lung cancer. Experiments are organized on a mixed dataset comprising NSCLC Radiomics and Radiogenomics. The results show that our proposed model achieves 0.88 in accuracy and 0.89 in the area under the receiver operating characteristic curve (AUC) when distinguishing lung adenocarcinoma (ADC) and lung squamous cell carcinoma (SqCC), indicating the potential of being a non-invasive way for predicting histological subtypes of lung cancer.