Reconfigurable Virtual Reality Interaction Interface Based on Encoded Mechanical Array.

Area of Science:

• Materials Science
• Biomedical Engineering
• Robotics

Background:

• Virtual reality (VR) interaction interfaces require advanced stretchable strain sensors for accurate gesture recognition.
• Existing sensors face a sensitivity-operating range trade-off, limiting their use in diverse metaverse applications.

Purpose of the Study:

• To introduce a dynamic reconfiguration strategy using an encoded mechanical array (EMA) for programmable tuning of stretchable strain sensors in VR.
• To overcome the limitations of current sensors and enhance VR interaction capabilities.

Main Methods:

• Developed an encoded mechanical array (EMA) with interlocked liquid metal units inspired by mortise-and-tenon design.
• Utilized reversible fracture-healing cycles under magnetic fields and mechanical stimuli for localized strain tunability (up to 71%) via binary coding.
• Integrated the EMA with stretchable strain sensors to enable multiple operational modes.

Main Results:

• Achieved programmable tuning of sensitivity and operating range for stretchable strain sensors.
• Demonstrated a ~610% sensitivity enhancement for high-precision detection and a ~220% range extension for wide-range monitoring.
• Successfully implemented the EMA-based sensor array in a VR interaction interface for scenario-adaptive hand motion tracking.

Conclusions:

• The EMA strategy effectively addresses the sensitivity-operating range trade-off in stretchable strain sensors for VR.
• The reconfigurable VR interaction interface enables advanced hand motion tracking in complex simulations like VR medical training.
• This technology holds significant potential for enhancing immersive experiences and applications across the metaverse and beyond.