Integrating Haptics with Augmented Reality in a Femoral Palpation and Needle Insertion Training Simulation

Area of Science:

• Medical Simulation
• Augmented Reality
• Haptics Technology

Background:

• Interventional radiology procedures require precise manual skills.
• Current training methods for femoral palpation and needle insertion lack realistic tactile feedback.
• A need exists for advanced simulation tools to improve procedural training.

Purpose of the Study:

• To develop and present PalpSim, a novel augmented reality virtual environment.
• To integrate advanced haptic feedback for realistic palpation and needle insertion simulation.
• To enhance the face validity of medical simulation for interventional radiology training.

Main Methods:

• Developed PalpSim, an augmented reality simulation integrating haptics.
• Combined two force feedback devices for five degrees of force feedback.
• Utilized a custom hydraulic interface for tactile pulse simulation.
• Modified a PHANTOM Omni end effector for real needle integration.
• Employed chroma-key techniques to mask haptic hardware.

Main Results:

• The simulation provides realistic force and tactile feedback for palpation.
• Trainees can use real needles within the virtual environment.
• The system effectively integrates augmented reality with haptic feedback.
• High face validity was achieved, mimicking real-world procedures.

Conclusions:

• PalpSim offers a highly realistic virtual training environment for interventional radiology.
• The integration of haptics and augmented reality significantly enhances simulation fidelity.
• This novel approach represents a significant advancement in medical simulation technology.