Effect of sensory substitution on suture manipulation forces for surgical teleoperation

Bilateral telemanipulation, which applies haptic feedback to the operator, is not yet available in most commercial robot-assisted surgical systems. We have shown in previous work that the lack of haptic (force or tactile) feedback is detrimental in applications requiring fine suture manipulation. In this paper, we study the effect of substituting direct haptic feedback with visual and auditory cues. Using the da Vinci robot from Intuitive Surgical, we observed the difference between applied forces during a knot tying procedure for four different sensory feedback substitution scenarios: no feedback, auditory feedback, visual feedback, and a combination of auditory and visual feedback. Our results indicate that visual feedback, which provides continuous force information, would improve robot-assisted performance during complex surgical tasks such as knot tying with fine sutures. Discrete auditory feedback gives additional useful support to the surgeon.