Perspective determines the production and interpretation of pointing gestures

Area of Science:

• Cognitive Science
• Human-Computer Interaction
• Psychology

Background:

• Pointing is a fundamental non-verbal communication method.
• Systematic misinterpretations of pointed-to locations are frequently observed between communicators.

Purpose of the Study:

• To investigate if differing viewpoints between pointers and observers contribute to communication errors in pointing.
• To differentiate the impact of perspective versus task on pointing accuracy.

Main Methods:

• Utilized a virtual reality environment for controlled pointing tasks.
• Participants either performed pointing gestures or interpreted them.
• Manipulated the assumed perspective (pointer's vs. observer's) during the task.

Main Results:

• The perspective adopted by participants significantly influenced the perceived relationship between pointing gestures and referents.
• The specific task (pointing vs. interpreting) had a minimal effect on accuracy.
• Viewer perspective is a key factor in understanding pointing gestures.

Conclusions:

• Misunderstandings in pointing communication are predominantly caused by the inherent differences in viewpoints between the pointer and the observer.
• Addressing perspective discrepancies is crucial for improving accuracy in pointing-based interactions.