Vision transformer network discovers the prognostic value of pancreatic cancer pathology sections via interpretable risk scores
- Zhiyong Peng 1, Yue Zhang 1, Tianchi Zhou 2, Wenjie Shi 2, Ya Wang 2, Maciej Pech 3, Georg Rose 4, Maximilian Dölling 2, Katrin Hippe 5, Roland S Croner 2,4, Yi Zhu 6, Ulf D Kahlert 7,8
- Zhiyong Peng 1, Yue Zhang 1, Tianchi Zhou 2
- 1School of Optoelectronic Engineering, Guilin University of Electronic Technology, Guilin, China.
- 2Molecular and Experimental Surgery, Clinic for General-, Visceral-, Vascular- and Transplantation Surgery, Medical Faculty and University Hospital Magdeburg, Otto-von-Guericke University, Magdeburg, Germany.
- 3Clinic for Radiology and Nuclear Medicine, University Hospital Magdeburg, Magdeburg, Germany.
- 4Research Campus Stimulate, Otto von Guericke University, Magdeburg, Germany.
- 5Institute of Pathology, Medical Faculty and University Hospital Magdeburg, Otto-von-Guericke University, Magdeburg, Germany.
- 6Department of Gastroenterological Surgery, The Affiliated Hospital of Jiaxing University, Jiaxing, Zhejiang, China.
- 7Molecular and Experimental Surgery, Clinic for General-, Visceral-, Vascular- and Transplantation Surgery, Medical Faculty and University Hospital Magdeburg, Otto-von-Guericke University, Magdeburg, Germany. ulf.kahlert@med.ovgu.de.
- 8Research Campus Stimulate, Otto von Guericke University, Magdeburg, Germany. ulf.kahlert@med.ovgu.de.
- 0School of Optoelectronic Engineering, Guilin University of Electronic Technology, Guilin, China.
Related Experiment Videos
Contact us if these videos are not relevant.
Contact us if these videos are not relevant.
View abstract on PubMed
Summary
This summary is machine-generated.Deep learning models analyze pathology slides to predict pancreatic cancer patient outcomes. This approach enhances precision oncology by identifying prognostic markers for improved survival prediction.
Area Of Science
- Digital pathology
- Computational oncology
- Artificial intelligence in medicine
Background
- Pathological sections contain valuable diagnostic data, but their prognostic potential remains largely untapped.
- Precision oncology seeks to personalize cancer treatment based on individual patient characteristics.
- Pancreatic cancer has a poor prognosis, necessitating improved methods for outcome prediction.
Purpose Of The Study
- To develop and validate a deep learning model for predicting patient outcomes using whole slide images of pancreatic cancer.
- To assess the prognostic value of histopathological features extracted by a modified Visual Transformer (ViT) model.
- To establish interpretable risk scores for stratifying pancreatic cancer patients.
Main Methods
- Analysis of H&E-stained whole slide images from public databases and real-world patients.
- Development of a modified Visual Transformer (ViT) model with spatial attention, fine-tuned on ImageNet2012.
- Prediction of Overall Survival (OS) and Disease-Free Survival (DFS) using the ViT model and calculation of patient risk scores.
Main Results
- The modified ViT model achieved high predictive accuracy, with C-indices of 0.79 (OS) and 0.82 (DFS) in the test set.
- Risk scores generated by the model correlated significantly with patient survival, with higher scores indicating worse prognosis.
- The model demonstrated strong performance with AUCs of 0.813-0.849 for OS and DFS prediction across training and test sets.
Conclusions
- Deep learning models, specifically the modified ViT network, can effectively extract prognostic information from pancreatic cancer pathology slides.
- Interpretable risk scores derived from the model offer a novel approach for prognosis evaluation and clinical risk stratification.
- This study highlights the potential of integrating AI-powered digital pathology into existing clinical diagnostics for enhanced pancreatic cancer management.
Related Experiment Videos
Contact us if these videos are not relevant.
Contact us if these videos are not relevant.

