Related Experiment Video
Updated: Oct 1, 2026
A 3D Digital Model for the Diagnosis and Treatment of Pulmonary Nodules
Published on: May 19, 2023
Imaging-based development and validation of artificial intelligence models for lung adenocarcinoma precursor lesions
Junbao Zhang1, Yanyi Hou2,3, Yikang Yang3
1Department of Pulmonary and Critical Care Medicine, Huashan Hospital, Fudan University, Shanghai, China.
Background:
Accurate preoperative assessment of pulmonary nodule invasiveness remains challenging. We developed an internally validated multimodal framework integrating CT representations from a frozen vision foundation model with clinical variables.
Methods:
This retrospective single-centre study included 1,179 pathologically confirmed pulmonary nodules: 247 glandular precursor lesions comprising atypical adenomatous hyperplasia and adenocarcinoma in situ, and 932 invasive lesions comprising minimally invasive and invasive adenocarcinoma. CT volumes were resampled to 0.5-mm isotropic resolution and cropped into 64 × 64 × 64-voxel patches. Slice-level representations were extracted using a pretrained, frozen DINOv3 backbone and aggregated by a trainable Attention Probe. Encoded clinical variables and imaging representations were integrated through self-attention and bidirectional cross-attention, followed by neural classification and regression tree classification. Internal validation used a five-fold rotating train-validation-test procedure, with each fold serving once as the held-out test fold.
Results:
The held-out test-fold AUCs were 0.848, 0.864, 0.867, 0.882, and 0.822, yielding a mean AUC of 0.8566. Pooled out-of-fold predictions produced an AUC of 0.847, accuracy of 0.809, sensitivity of 0.806, specificity of 0.822, and F1 score of 0.873. DINOv3 and NCART achieved the highest point-estimate AUCs among the evaluated feature extractors and classifiers, respectively, although most pairwise differences were not statistically significant. Intermediate fusion significantly outperformed the Gould score and the clinical-data-only model, but not the imaging-only or late-fusion models. In the prespecified secondary analysis, the model achieved an AUC of 0.780 for distinguishing adenocarcinoma in situ from atypical adenomatous hyperplasia.
Conclusion:
The proposed framework achieved internally validated discrimination of pulmonary nodule invasiveness. External multicentre and prospective validation is required before clinical implementation.
