Spatiotemporal survival analysis for movement trajectory tracking in virtual reality

Area of Science:

• Cognitive Science
• Human-Computer Interaction
• Psychology

Background:

• Traditional behavioral experiments often rely on discrete measures like reaction times and accuracy.
• These discrete measures may not fully capture the complex dynamics of ongoing cognitive processes.
• Continuous response tracking offers a more nuanced approach to understanding cognition.

Purpose of the Study:

• To introduce and validate Spatiotemporal survival analysis (StSA) for analyzing continuous response trajectory data.
• To compare the utility of continuous tracking in Virtual Reality (VR) against traditional key-press responses.
• To demonstrate StSA's capability in revealing cognitive effects potentially obscured by discrete measures.

Main Methods:

• Implemented a classical N-back matching task in both traditional and VR environments.
• Analyzed discrete measures (reaction time, accuracy) using ANOVAs.
• Applied Spatiotemporal survival analysis (StSA) to continuous trajectory data from VR N-back task.

Main Results:

• Classical ANOVAs confirmed effects of working memory load but showed violations of assumptions, indicating noise.
• Survival analyses revealed frequency neglect and category frequency-tuned responses.
• StSA confirmed these effects in VR and identified trajectory corrections towards correct responses in non-Match trials.

Conclusions:

• Spatiotemporal survival analysis (StSA) is a powerful, theory-free method for exploratory analysis of continuous behavioral data.
• StSA can uncover cognitive dynamics and effects missed by traditional discrete measures.
• The study validates StSA's utility in VR environments for cognitive research and hypothesis testing.