VPModel: High-Fidelity Product Simulation in a Virtual-Physical Environment

Area of Science:

• Human-Computer Interaction
• Product Design and Development
• Mixed Reality Technologies

Background:

• Existing prototyping tools offer incomplete product representations, lacking visual, tactile, or interactive fidelity.
• Limitations include physical models lacking interfaces, 3D modeling software lacking tactile realism, and interactive platforms differing from final use.

Purpose of the Study:

• To introduce VPModel, a high-fidelity prototyping tool integrating multiple methods for a comprehensive product experience.
• To enable designers and users to experience products realistically before completion.

Main Methods:

• VPModel combines 3D-printed models (3DPM) with synchronized virtual models and mixed-reality interfaces.
• Utilizes object detection, real-time matching, hand-gesture detection, and action recognition with hardware like HoloLens and Leap Motion Controller.
• Evaluated through user experience surveys, task performance analysis, and interviews with 16 participants.

Main Results:

• VPModel demonstrated significant improvements in realism and user enjoyment compared to traditional prototyping methods.
• The system effectively integrates tangible, visual, and interactive elements for a holistic product preview.
• Modular model comparison capabilities were enhanced within design practices.

Conclusions:

• VPModel effectively supports design strategy and communicates concepts fully and efficiently.
• The tool has potential to shorten product development cycles and reduce communication costs.
• High-fidelity prototyping in mixed reality offers a superior user experience for product evaluation.