Immunohistochemical Index Prediction of Breast Cancer by Using Hybrid Ultrasound Data

The immunohistochemical index is significant to help the selection of treatment strategy for breast cancer patients. Existing studies that focus on conventional ultrasound features and certain types of immunohistochemistry expressions are limited to correlation exploration, and only few studies have built predictive models. In this study, a Tri-Branch deep learning network is built for prediction of the immunohistochemical HER2 using the hybrid ultrasound data, instead of relying on the invasive and biopsy-based histopathological examination. Specifically, the deep learning model uses the cross-model attention and the interactive learning approaches to obtain the strong complementarity of hybrid data comprising B-mode US, contrast-enhanced ultrasound, and optical flow motion information to enhance accuracy of immunohistochemical HER2 prediction. The proposed prediction model was evaluated using hybrid ultrasound dataset from 335 breast cancer patients. The experimental results indicated that the Tri-Branch model had a high accuracy of 86.23% for HER2 status prediction, and the HER2 status prediction for patients with different pathology grades exhibited some meaningful clinical observations.