MobiTangibles: Enabling Physical Manipulation Experiences of Virtual Precision Hand-Held Tools' Miniature Control in...

Area of Science:

• Human-Computer Interaction
• Virtual Reality
• Sensor Technology

Background:

• Virtual reality (VR) skill training for precision hand-held tools requires realistic miniature control simulations.
• Current VR simulation methods for these interactions are complex, costly, and require expertise, limiting accessibility for novices.

Purpose of the Study:

• To introduce MobiTangibles, a novel system for simulating miniature control interactions in VR using smartphone magnetic field sensing.
• To provide an accessible, low-cost, and easy-to-use solution for VR skill training with precision hand-held tools.

Main Methods:

• Developed MobiTangibles utilizing smartphone-based magnetic field sensing to replicate single-axis translation and rotation.
• Conducted technical evaluations for functionality and electromagnetic interference in various indoor environments.
• Performed a user-centric evaluation comparing MobiTangibles with bare hands and VR controllers for miniature manipulation tasks.

Main Results:

• MobiTangibles successfully replicated fundamental miniature control interactions (translation, rotation).
• Technical evaluations confirmed functionality across diverse settings, including assessments of electromagnetic interference.
• User study indicated MobiTangibles provided a more realistic and less fatiguing experience compared to conventional methods.

Conclusions:

• MobiTangibles offer a practical and effective solution for enhancing VR skill training for precision hand-held tools.
• The system democratizes access to realistic VR manipulation training, overcoming limitations of existing complex and expensive approaches.