Semisupervised Boundary Detection for Aluminum Grains Combined With Transfer Learning and Region Growing

In the manufacturing process of aluminum alloy, the size, distribution, and shape of microscopic grains indicate the mechanical characteristics and product quality. However, for metallographic images that can reveal microstructures, the cost of expert labeling at pixel level is high. To solve the problem, we propose a semisupervised learning strategy for grain boundary detection with a few labeled images and abundant unlabeled samples. To expand the helpful information, transfer learning and rule-based region growing are considered. Specifically, a deep network used for extracting multiscale features is designed. With constant training, through a few labeled metallographic images and abundant transferred natural images, pseudo annotations are generated gradually for unlabeled metallographic images iteratively by feature similarity and boundary region growing. The increased unlabeled samples with their pseudo annotations would be involved in the following training process in semisupervised self-training mode to improve the generalization ability of model, together with the domain adaptation block. In experiments, the proposed two methods named semiricher convolutional features-generative adversarial networks (SemiRCF-GAN) and semiricher convolutional features-maximum mean discrepancy (SemiRCF-MMD) can effectively detect grain boundaries with only one labeled metallographic image, and achieve F1 scores of 0.73 and 0.72, respectively, which surpass typical methods.