Related Experiment Video
Updated: Jul 2, 2025
Quantitation of Protein Expression and Co-localization Using Multiplexed Immuno-histochemical Staining and Multispectral Imaging
Published on: April 8, 2016
A deep learning based holistic diagnosis system for immunohistochemistry interpretation and molecular subtyping
Lin Fan1, Jiahe Liu2, Baoyang Ju2
1School of Integrated Circuit Science and Engineering (Industry-Education Integration School), Nanjing University of Posts and Telecommunications, Nanjing 210023, PR China; State Key Laboratory of Bioelectronics, Jiangsu Key Laboratory for Biomaterials and Devices, School of Biological Science and Medical Engineering & Collaborative Innovation Center of Suzhou Nano Science and Technology, Southeast University, Nanjing 210096, PR China; Medical School of Nanjing University, Nanjing 210093, PR China.
Background:
Breast cancer in different molecular subtypes, which is determined by the overexpression rates of human epidermal growth factor receptor 2 (HER2), estrogen receptor (ER), progesterone receptor (PR), and Ki67, exhibit distinct symptom characteristics and sensitivity to different treatment. The immunohistochemical method, one of the most common detecting tools for tumour markers, is heavily relied on artificial judgment and in clinical practice, with an inherent limitation in interpreting stability and operating efficiency. Here, a holistic intelligent breast tumour diagnosis system has been developed for tumour-markeromic analysis, combining the automatic interpretation and clinical suggestion.
Methods:
The holistic intelligent breast tumour diagnosis system included two main modules. The interpreting modules were constructed based on convolutional neural network, for comprehensively extracting and analyzing the multi-features of immunostaining. Referring to the clinical classification criteria, the interpreting results were encoded in a low-dimensional feature representation in the subtyping module, to efficiently output a holistic detecting result of the critical tumour-markeromic with diagnosis suggestions on molecular subtypes.
Results:
The overexpression rates of HER2, ER, PR, and Ki67, as well as an effective determination of molecular subtypes were successfully obtained by this diagnosis system, with an average sensitivity of 97.6 % and an average specificity of 96.1 %, among those, the sensitivity and specificity for interpreting HER2 were up to 99.8 % and 96.9 %.
Conclusion:
The holistic intelligent breast tumour diagnosis system shows improved performance in the interpretation of immunohistochemical images over pathologist-level, which can be expected to overcome the limitations of conventional manual interpretation in efficiency, precision, and repeatability.
