Knowledge transfer for surgical activity prediction

Lack of annotated training data hinders automatic recognition and prediction of surgical activities necessary for situation-aware operating rooms. We propose using knowledge transfer to compensate for data deficit and improve prediction.

We used two approaches to extract and transfer surgical process knowledge. First, we encoded semantic information about surgical terms using word embedding. Secondly, we passed knowledge between different clinical datasets of neurosurgical procedures using transfer learning.

The combination of two methods provided 22% improvement of activity prediction. We also made several pertinent observations about surgical practices based on the results of the performed transfer.

Word embedding boosts learning process. Transfer learning was shown to be more effective than a simple combination of data, especially for less similar procedures.