Bimanual Intravenous Needle Insertion Simulation Using Nonhomogeneous Haptic Device Integrated into Mixed Reality.

Area of Science:

• Medical Simulation
• Human-Computer Interaction
• Virtual Reality

Background:

• Intravenous (IV) needle insertion is a fundamental clinical skill requiring precise hand-eye coordination and tactile feedback.
• Current training methods may lack realistic simulation of diverse anatomical variations and dynamic conditions.
• Developing advanced simulation tools is crucial for effective and safe skill acquisition in healthcare education.

Purpose of the Study:

• To develop and evaluate a novel haptic-mixed reality intravenous (HMR-IV) needle insertion simulation system.
• To provide a realistic and adaptable training environment for practicing IV insertion under various clinical conditions.
• To assess the usability and effectiveness of the HMR-IV system for nursing students and healthcare professionals.

Main Methods:

• Integration of bimanual haptic devices (Dexmo, Geomagic Touch) with a mixed reality system (HoloLens 2) for synchronized simulation.
• Development of a force-profile-based haptic rendering algorithm to mimic real tactile sensations during needle insertion.
• Implementation of a global hand-tracking method using dual depth sensors for accurate virtual hand interaction and force feedback.
• Multistep calibration across multiple coordinate systems (real, virtual, mixed reality, haptic, camera) for precise hand-eye coordination.

Main Results:

• The HMR-IV system successfully integrated haptic devices and mixed reality for a cohesive simulation experience.
• Force-profile-based haptic rendering effectively replicated the tactile feel of IV needle insertion.
• The global hand-tracking method provided accurate tracking of haptic gloves and virtual hand manipulation.
• Evaluation with 20 participants (experts and novices) demonstrated the system's usability and effectiveness in varied insertion conditions.

Conclusions:

• The developed HMR-IV simulation system offers a valuable tool for training IV needle insertion skills.
• The system's realistic simulation capabilities and adaptability to different conditions enhance user performance and learning.
• This technology represents a significant advancement in medical simulation for healthcare education and professional development.