Contrastive self-supervised learning for diabetic retinopathy early detection

Diabetic Retinopathy (DR) is the major cause of blindness, which seriously threatens the world's vision health. Limited medical resources make early diagnosis and a large-scale screening of DR difficult. Most of the current automatic diagnostic methods are mostly based on deep learning and large-scale labeled data. However, the insufficiency of manual annotations for medical images still is a great challenge of training deep neural networks. Self-supervised learning methods are proposed to learn general features from dataset without manual annotations. Inspired by this, we proposed a deep learning based DR classification model (SimCLR-DR). In this paper, we first use contrastive self-learning algorithm to pre-train the encoder based on convolution network with unlabeled retinal images, then retrain the encoder with classifier on a small annotated training data to detect referable DR. The experimental results on Kaggle dataset show that this proposed method can overcome the training data insufficiency problem and performs better than transfer learning. SimCLR-DR is a good beginning for other deep learning based medical image detection approaches facing the challenge of insufficient annotated data. Figure presents an overview of the proposed framework, which contains three main steps: (i) Data preprocessing; (ii) Pretext task of SimCLR-DR based on contrastive learning; (iii) Downstream Task of SimCLRDR based on CNN.