Image Quality Improvement of Hand-Held Ultrasound Devices With a Two-Stage Generative Adversarial Network

As a widely used imaging modality in the medical field, ultrasound has been applied in community medicine, rural medicine, and even telemedicine in recent years. Therefore, the development of portable ultrasound devices has become a popular research topic. However, the limited size of portable ultrasound devices usually degrades the imaging quality, which reduces the diagnostic reliability. To overcome hardware limitations and improve the image quality of portable ultrasound devices, we propose a novel generative adversarial network (GAN) model to achieve mapping between low-quality ultrasound images and corresponding high-quality images. In contrast to the traditional GAN method, our two-stage GAN that cascades a U-Net network prior to the generator as a front end is built to reconstruct the tissue structure, details, and speckle of the reconstructed image. In the training process, an ultrasound plane-wave imaging (PWI) data-based transfer learning method is introduced to facilitate convergence and to eliminate the influence of deformation caused by respiratory activities during data pair acquisition. A gradual tuning strategy is adopted to obtain better results by the PWI transfer learning process. In addition, a comprehensive loss function is presented to combine texture, structure, and perceptual features. Experiments are conducted using simulated, phantom, and clinical data. Our proposed method is compared to four other algorithms, including traditional gray-level-based methods and learning-based methods. The results confirm that the proposed approach obtains the optimum solution for improving quality and offering useful diagnostic information for portable ultrasound images. This technology is of great significance for providing universal medical care.