Follow, select and assemble method FSAM for VE and re assembly

Area of Science:

• Human-Computer Interaction
• Virtual Reality
• Cognitive Psychology

Background:

• Previous studies on eye-hand coordination used model copying tasks in real and virtual environments.
• Existing virtual reality (VR) tasks often rely on mouse or motion sensor control for object manipulation.

Purpose of the Study:

• To develop and evaluate a novel 1:1 scale virtual reality assembly task.
• To investigate the use of hand gestures for object interaction in VR.
• To enhance task realism with distractors and dynamic element placement.

Main Methods:

• A real-world and a VR assembly task were designed, mirroring Ballard et al. and Hayhoe et al.'s methodologies.
• The VR environment utilized a Leap Motion controller for hand gesture-based interaction, providing a virtual hand representation.
• Distractor assembly blocks and varied resource area layouts were incorporated to increase task complexity.

Main Results:

• The study successfully implemented a VR assembly task with gesture control, offering visual and auditory feedback.
• The modified task introduced challenges such as distractor elements and altered object locations.
• The system provides a virtual hand representation without haptic feedback, focusing on visual and auditory guidance.

Conclusions:

• The developed VR assembly task offers a new platform for studying eye-hand coordination and human-computer interaction.
• Gesture-based control in VR enhances immersion and provides a more natural interaction method.
• The inclusion of distractors and dynamic elements increases the ecological validity of VR-based research.