Improving the Generalisability of Deep CNNs by Combining Multi-stage Features for Surgical Tool Classification

Dataset characteristics play an important role in training convolutional neural networks (CNNs) to evolve optimal features required to perform a specific task. Due to the high cost of recording and labelling surgical data, available datasets are relatively small in size and have been predominantly acquired at single sites. CNN-based approaches have been widely adapted to analyse surgical workflow using single-site datasets. Therefore, assessing generalised performance on data from different institutions has not been investigated. In this work, a CNN model that combines features from multiple stages to develop more accurate and generalised tool classification was introduced. An extensive evaluation of the proposed approach on three different datasets showed better generalised performance of our approach compared to base CNN models. The proposed approach achieved mAP values of 91.46%, 69.02% and 37.14% on the Cholec80, Cholec20 and Gyna05 datasets, respectively. The generalisation performance was improved on the achieved base CNN models mAP by about 7%. Clinical Relevance- In this research, we proposed a method to improve generalisation capability of CNN models which will have positive impact on developing more robust assistive systems that can support the surgeon and improve patient care.