Three-Dimensional Mapping of the Rotation of Interactive Virtual Objects with Eye-Tracking Data.

Area of Science:

• Human-Computer Interaction
• Cognitive Science
• Virtual Reality

Background:

• Understanding human interaction with 3D virtual objects is crucial for fields like virtual reality and cognitive science.
• Current methods often focus on task outcomes rather than the dynamic cognitive processes involved.

Purpose of the Study:

• To present a novel method for real-time recording and analysis of human interaction with 3D virtual objects.
• To associate object manipulation data with behavioral measures like eye tracking for deeper cognitive insights.

Main Methods:

• Developed a system to track real-time rotation data of an interactive 3D object (iObj) against a static target object (tObj).
• Integrated eye-tracking data synchronized with object orientation (quaternions) at high frequencies (60 Hz).
• Utilized free software (GNU Octave, Jmol) and provided all scripts for reproducibility.

Main Results:

• Enabled quantitative analysis of the task-solving process, including mental and physical rotations.
• Generated visualizations such as angular disparity, 3D rotation trajectories ('ball of rotations'), and 3D fixation heatmaps.
• Facilitated precise measurement of object part importance in task completion.

Conclusions:

• The presented method allows for detailed, quantitative studies of cognitive processes during 3D object manipulation.
• It bridges the gap between interaction data and cognitive inferences, offering insights into spatial reasoning.
• This approach can inform the design of human-machine interfaces and the study of individual cognitive abilities.