A Touchless system for image visualization during surgery: preliminary experience in clinical settings

Today clinicians may access large medical datasets, but very few systems have been designed to allow a practical and efficient exploration of data directly in critical medical environments such as operating rooms (OR). This work aims to assess during tests in laboratory and clinical settings a Surgery Touchless System (STS). This system allows clinicians to interact with medical images by using two different approaches: a gesture recognition and a voice recognition based system. These two methods are based on the use of a Microsoft Kinect and of a selective microphone, respectively. The STS allows navigating in a specifically designed interface, to perform several tasks, among others, to manipulate biomedical images. In this article, we assessed both the recognitions approaches in laboratory with 5 users. In addition, the STS was tested using only the voice-based recognition approach in clinical settings. The assessment was performed during three procedures by two interventionalradiologists. The five volunteers and the 2 radiologists filled two questionnaires to assess the system. The system usability was positively evaluated in laboratory tests. From clinical trials emerged that the STS was considered safe and useful by both the radiologists: they used the system an averaged number of times of 10 and 15 for patients, and found the system useful. These promising results allow considering this system useful for providing information not otherwise accessible and limiting the impact of human error during the operation. Future work will be focused on the use of the STS on a high number and different types of procedure.