Coupling speckle noise suppression with image classification for deep-learning-aided ultrasound diagnosis

Objective. During deep-learning-aided (DL-aided) ultrasound (US) diagnosis, US image classification is a foundational task. Due to the existence of serious speckle noise in US images, the performance of DL models may be degraded. Pre-denoising US images before their use in DL models is usually a logical choice. However, our investigation suggests that pre-speckle-denoising is not consistently advantageous. Furthermore, due to the decoupling of speckle denoising from the subsequent DL classification, investing intensive time in parameter tuning is inevitable to attain the optimal denoising parameters for various datasets and DL models. Pre-denoising will also add extra complexity to the classification task and make it no longer end-to-end.Approach. In this work, we propose a multi-scale high-frequency-based feature augmentation (MSHFFA) module that couples feature augmentation and speckle noise suppression with specific DL models, preserving an end-to-end fashion. In MSHFFA, the input US image is first decomposed to multi-scale low-frequency and high-frequency components (LFC and HFC) with discrete wavelet transform. Then, multi-scale augmentation maps are obtained by computing the correlation between LFC and HFC. Last, the original DL model features are augmented with multi-scale augmentation maps.Main results. On two public US datasets, all six renowned DL models exhibited enhanced F1-scores compared with their original versions (by 1.31%-8.17% on the POCUS dataset and 0.46%-3.89% on the BLU dataset) after using the MSHFFA module, with only approximately 1% increase in model parameter count.Significance. The proposed MSHFFA has broad applicability and commendable efficiency and thus can be used to enhance the performance of DL-aided US diagnosis. The codes are available athttps://github.com/ResonWang/MSHFFA.