ConeSpeech: Exploring Directional Speech Interaction for Multi-Person Remote Communication in Virtual Reality.

Area of Science:

• Human-Computer Interaction
• Virtual Reality Technologies
• Communication Systems

Background:

• Efficient remote collaboration is crucial for geographically dispersed teams.
• Existing remote communication methods can lead to distractions and information overload.
• Virtual reality (VR) offers immersive environments for novel communication solutions.

Purpose of the Study:

• To introduce ConeSpeech, a VR-based technique for selective, directional audio communication.
• To enable users to direct speech to specific individuals, minimizing bystander disturbance.
• To enhance multi-user remote collaboration in virtual environments.

Main Methods:

• Developed ConeSpeech, a VR technique featuring directional speech delivery within a cone-shaped area.
• Implemented adjustable delivery range and multiple delivery areas for flexible communication.
• Conducted a user study to determine optimal control modalities for the directional audio cone.
• Evaluated ConeSpeech performance in multi-user communication tasks against baseline methods.

Main Results:

• ConeSpeech allows users to selectively speak to target listeners without disturbing bystanders.
• The system supports adjustable cone size and multiple simultaneous delivery areas.
• User study validated the effectiveness and usability of the ConeSpeech modality.
• Performance evaluation showed ConeSpeech balances convenience and flexibility in voice communication.

Conclusions:

• ConeSpeech provides an effective solution for private and selective communication in multi-user VR settings.
• The technique reduces unwanted noise and enhances focus during remote collaboration.
• ConeSpeech represents a significant advancement in virtual reality-based communication systems.