A low-cost multimodal head-mounted display system for neuroendoscopic surgery

Area of Science:

• Medical Technology
• Neurosurgery
• Wearable Devices

Background:

• Head-mounted displays (HMDs) are increasingly used in medicine, from fitness tracking to surgical assistance.
• This study investigates a novel, low-cost multimodal HMD system for neuroendoscopic surgery.

Purpose of the Study:

• To assess the feasibility and practicality of a low-cost multimodal HMD system in neuroendoscopic surgery.
• To evaluate the system's utility in improving surgical visualization and navigation.

Main Methods:

• Developed a multimodal HMD system integrating displays, an action camera, and a laptop for medical image reconstruction.
• Enabled surgeons to switch between endoscopic, 3D virtual endoscopic, and environmental views.
• Incorporated a leap motion controller for real-time adjustment of 3D virtual endoscopy images.

Main Results:

• Successfully applied the HMD system in 21 neuroendoscopic surgeries for ventricular system diseases.
• All operations were completed successfully with no system-related complications.
• Surgeons reported the HMD as comfortable, easy to operate, with high screen resolution and improved lesion comprehension.
• The system demonstrated a steep learning curve with rapid skill acquisition and was cost-efficient compared to existing tools.

Conclusions:

• The multimodal HMD system is a feasible, practical, and cost-effective tool for neuroendoscopic surgery.
• The system enhances surgical understanding and offers a valuable alternative to conventional surgical instruments.