Elastic or Stiff? Light or Heavy? Pseudo-Haptic Photograph Interaction for Fabric Perception

Area of Science:

• Human-Computer Interaction
• Virtual Reality
• E-commerce Technology

Background:

• Online retail primarily uses visual information, lacking tactile feedback crucial for product assessment.
• Advancements in haptic technology offer potential solutions, but integrating them with realistic product imagery remains a challenge.
• Existing pseudo-haptic methods often rely on computer-generated graphics, which may not align with the visual realism expected in online retail.

Purpose of the Study:

• To introduce and validate a novel pseudo-haptic approach, Pseudo-Haptic Photograph Interaction (PHPI), for online retail.
• To explore the use of interactive photograph series and mouse cursor gain modulation for creating illusory haptic sensations.
• To bridge the gap between visual realism in product photography and interactive haptic simulation.

Main Methods:

• Developed PHPI, utilizing sequences of real fabric photographs and manipulating mouse cursor gain.
• Conducted user studies to assess the perception of fabric stiffness and weight through the PHPI system.
• Experiment 1: Investigated the correlation between mouse movement gain and perceived fabric properties.
• Experiment 2: Validated pseudo-haptic sensations by having users match real fabrics with PHPI-displayed digital surrogates.

Main Results:

• A significant relationship was found between mouse gain modulation and the perception of fabric stiffness and weight.
• User studies confirmed that PHPI can evoke pseudo-haptic sensations corresponding to real-world tactile properties.
• A strong correlation was observed between haptically perceived fabric attributes and their digital representation via PHPI.

Conclusions:

• PHPI offers a viable method for integrating pseudo-haptic feedback with realistic product imagery in online retail.
• The approach effectively simulates tactile properties like stiffness and weight using visual cues and interactive techniques.
• PHPI holds potential for enhancing multimodal user experiences in e-commerce and other photographic applications.