A prostate seed implantation robot system based on human-computer interactions: Augmented reality and voice control

Area of Science:

• Medical Robotics
• Surgical Navigation
• Image-Guided Therapy

Background:

• Robot-assisted prostate seed implantation technology is advancing rapidly.
• Current methods face challenges with non-intuitive visualization and complex robot control.

Purpose of the Study:

• To enhance the intelligence and visualization of robot-assisted prostate seed implantation.
• To develop an augmented reality (AR) system integrated with voice control for improved surgical operations.

Main Methods:

• Prostate MRI images were denoised and segmented.
• 3D prostate models were reconstructed using surface rendering.
• An AR system was built using a holographic application.
• An improved singular value decomposition (SVD) 3D registration algorithm and a spectral subtraction-BP neural network fusion algorithm were developed.

Main Results:

• The improved SVD algorithm demonstrated enhanced 3D registration accuracy.
• The fusion algorithm achieved an average delay of 1.314 seconds.
• The integrated system exhibited an overall response time of 1.5 seconds.

Conclusions:

• The proposed fusion algorithm significantly improves the reliability of the voice control system.
• The integrated AR system with voice control meets the responsiveness requirements for prostate seed implantation, enhancing surgical precision.