Inexpensive Monocular Pico-Projector-based Augmented Reality Display for Surgical Microscope.

Area of Science:

• Medical Technology
• Surgical Robotics
• Augmented Reality

Background:

• Microsurgery demands high precision, often challenged by surgeon hand tremor.
• Existing surgical microscopes lack integrated real-time visual guidance for instrument manipulation.

Purpose of the Study:

• To develop an inexpensive pico-projector-based augmented reality (AR) display for surgical microscopes.
• To integrate AR with an active handheld surgical tool (Micron) for tremor cancellation and enhanced accuracy.

Main Methods:

• An affordable pico-projector system was designed to overlay virtual cues onto the surgical microscope view.
• The AR display was integrated with Micron, a surgical tool providing active hand tremor cancellation.
• Virtual cues were implemented to track the instrument tip, display desired positions, and indicate positional errors.

Main Results:

• The AR display successfully injected virtual cues into the microscope view.
• The system provided real-time feedback on tool tip position, desired trajectory, and positional error.
• Boundary information and operational status (e.g., tremor cancellation) were displayable within the surgical field.

Conclusions:

• The developed AR display system offers a cost-effective solution for improving microsurgical accuracy.
• Virtual cues enhance surgeon performance by guiding instrument positioning and preventing workspace drift.
• This technology has the potential to significantly advance precision in minimally invasive surgical procedures.