Exploring the role of haptic feedback in enabling implicit HCI-based bookmarking

Area of Science:

• Human-Computer Interaction
• Haptic Feedback Systems
• Implicit Interaction Design

Background:

• Implicit human-computer interaction (HCI) relies on detecting user states, like orienting responses via electrodermal activity.
• Automatic bookmarking in audio streams aids content resumption but can be affected by noisy data (false positives).
• Haptic feedback offers a potential modality for unobtrusive notifications and enhanced user experience in implicit HCI.

Purpose of the Study:

• To investigate the efficacy of haptic feedback in implicit HCI for audio stream bookmarking.
• To mitigate the impact of noisy data on implicit interaction systems.
• To evaluate user preferences and performance with different haptic feedback implementations.

Main Methods:

• Developing a system that monitors electrodermal activity to detect user orienting responses and automatically place bookmarks.
• Implementing two haptic feedback strategies: low-attention notification upon bookmarking and focused-attention display during navigation.
• Conducting user studies to compare navigation time and accuracy with visual-only, haptic-only, and combined haptic-visual bookmark displays.

Main Results:

• Haptic notification of bookmark placement, combined with visual display, significantly improved navigation time.
• Haptic display of bookmarks, even without visual cues, increased navigation accuracy.
• Participants preferred haptic notifications and combined haptic-visual displays for bookmark management.

Conclusions:

• Haptic feedback is a valuable tool for enhancing implicit HCI, particularly in managing noisy data and improving user experience.
• The integration of haptic notifications and displays can lead to more efficient and accurate user interactions with audio content.
• This research contributes novel approaches to implicit HCI, haptic notification design, and understanding user mental models in interrupted listening scenarios.