Characterizing Limits of Vision-Based Force Feedback in Simulated Surgical Tool-Tissue Interaction.

Area of Science:

• Robotics
• Surgical Simulation
• Haptic Feedback

Background:

• Haptic feedback enables real-time force interaction with simulated objects, crucial for telerobotic applications like robot-assisted minimally invasive surgery (RMIS).
• Accurate force rendering is vital in RMIS to prevent tissue damage, but direct force measurement is challenging.
• Non-contact methods, particularly vision-based deformation estimation, are promising for force sensing in RMIS.

Purpose of the Study:

• To empirically evaluate the acceptable deviation of haptic feedback from ground truth force while maintaining surgical operator performance in a simulated RMIS palpation task.
• To establish the required fidelity of non-contact force rendering for deformable interactions in surgical settings.
• To inform guidelines for vision-based tool-tissue force estimation.

Main Methods:

• A simulation platform for RMIS was developed to test haptic feedback fidelity.
• A preliminary user study was conducted to assess operator performance with varying haptic feedback accuracy.
• An adaptive thresholding method was employed to determine tolerable errors in force orientation and magnitude.

Main Results:

• The study quantifies the degree of haptic feedback deviation that still allows for acceptable teleoperated performance in a simulated RMIS palpation task.
• Preliminary user study results verified the utility of the simulation platform for evaluating haptic feedback.
• Identified minimum and maximum tolerable errors in force orientation and magnitude for haptic feedback.

Conclusions:

• The findings provide insights into the necessary precision of haptic feedback for effective RMIS.
• Results contribute to developing guidelines for vision-based force estimation techniques in surgical robotics.
• This research impacts the design of haptic systems for safer and more effective minimally invasive surgery.