Design of Virtual Hands for Natural Interaction in the Metaverse

Area of Science:

• Human-Computer Interaction
• Virtual Reality
• Fashion Technology

Background:

• The Metaverse necessitates advancements in human-machine interaction for seamless integration.
• Virtual shopping environments require intuitive and realistic user interfaces.

Purpose of the Study:

• To propose and test a technically viable virtual shopping system for the fashion industry within the Metaverse.
• To enhance user immersion and interaction through realistic virtual hand integration and motion tracking.

Main Methods:

• Integration of real-world scanned virtual hands with digital nails into a Metaverse environment.
• Utilizing infrared sensors for real-time hand posture acquisition and virtual hand mapping.
• Implementing a blockchain-based transaction mechanism using non-fungible tokens (NFTs).
• Pilot testing with the Meta Quest 2 headset for an immersive shopping experience.

Main Results:

• Achieved natural human identification and interaction within the virtual environment.
• Successfully demonstrated a feasible blockchain-based transaction system for mass audiences.
• Received extremely positive consumer reactions from both in-person and remote participants.

Conclusions:

• The developed system offers a viable solution for immersive virtual fashion shopping in the Metaverse.
• The project provides valuable technical guidelines for future Metaverse implementations.
• Positive user reception indicates strong potential for widespread adoption of such technologies.