A deep learning system for quantitative assessment of microvascular abnormalities in nailfold capillary images

Nailfold capillaroscopy is key to timely diagnosis of SSc, but is often not used in rheumatology clinics because the images are difficult to interpret. We aimed to develop and validate a fully automated image analysis system to fill this gap.

We mimicked the image interpretation strategies of SSc experts, using deep learning networks to detect each capillary in the distal row of vessels and make morphological measurements. We combined measurements from multiple fingers to give a subject-level probability of SSc.We trained the system using high-resolution images from 111 subjects (group A) and tested on images from subjects not in the training set: 132 imaged at high-resolution (group B); 66 imaged with a low-cost digital microscope (group C). Roughly half of each group had confirmed SSc, and half were healthy controls or had primary RP ('normal'). We also estimated the performance of SSc experts.

We compared automated SSc probabilities with the known clinical status of patients (SSc versus 'normal'), generating receiver operating characteristic curves (ROCs). For group B, the area under the ROC (AUC) was 97% (94-99%) [median (90% CI)], with equal sensitivity/specificity 91% (86-95%). For group C, the AUC was 95% (88-99%), with equal sensitivity/specificity 89% (82-95%). SSc expert consensus achieved sensitivity 82% and specificity 73%.

Fully automated analysis using deep learning can achieve diagnostic performance at least as good as SSc experts, and is sufficiently robust to work with low-cost digital microscope images.