Just-in-time: Gaze guidance in natural behavior

Area of Science:

• Cognitive Science
• Neuroscience
• Human-Computer Interaction

Background:

• Natural eye movements are well-studied in over-learned tasks with fixed action sequences.
• The activation pattern of cognitive schemas during novel, in-the-moment planning remains unclear.

Purpose of the Study:

• To investigate action-oriented gaze behavior during novel, complex tasks.
• To understand how cognitive planning influences eye and body movements in naturalistic settings.

Main Methods:

• Recorded gaze and body movements in a virtual environment during a complex object-sorting task.
• Introduced task complexity to necessitate cognitive planning and real-time decision-making.

Main Results:

• Gaze fixations were tightly coupled with action onset, aligning with the sequence of actions.
• Task complexity moderately influenced fixation proportions on relevant regions.
• Gaze fixations were allocated "just-in-time" to action-relevant targets.
• Planning involved increased visual search for task-relevant objects before action initiation.

Conclusions:

• Natural behavior utilizes frugal working memory, avoiding long-term environmental encoding for planning.
• Humans prefer "just-in-time" planning, searching for items moment-by-moment to guide actions.
• This strategy involves visual search, action execution, and sequential task progression.