Unsupervised landmark detection and classification of lung infection using transporter neural networks

Supervised deep learning techniques have been very popular in medical imaging for various tasks of classification, segmentation, and object detection. However, they require a large number of labelled data which is expensive and requires many hours of careful annotation by experts. In this paper, an unsupervised transporter neural network framework with an attention mechanism is proposed to automatically identify relevant landmarks with applications in lung ultrasound (LUS) imaging. The proposed framework identifies key points that provide a concise geometric representation highlighting regions with high structural variation in the LUS videos. In order for the landmarks to be clinically relevant, we have employed acoustic propagation physics driven feature maps and angle-controlled Radon Transformed frames at the input instead of directly employing the gray scale LUS frames. Once the landmarks are identified, the presence of these landmarks can be employed for classification of the given frame into various classes of severity of infection in lung. The proposed framework has been trained on 130 LUS videos and validated on 100 LUS videos acquired from multiple centres at Spain and India. Frames were independently assessed by experts to identify clinically relevant features such as A-lines, B-lines, and pleura in LUS videos. The key points detected showed high sensitivity of 99% in detecting the image landmarks identified by experts. Also, on employing for classification of the given lung image into normal and abnormal classes, the proposed approach, even with no prior training, achieved an average accuracy of 97% and an average F1-score of 95% respectively on the task of co-classification with 3-fold cross-validation.