Eye movement patterns of captioned television viewers.

Area of Science:

• Human-Computer Interaction
• Cognitive Psychology
• Media Studies

Background:

• Video consumption is prevalent, but the cognitive load and visual attention associated with viewing captions are not fully understood.
• Understanding how captions affect visual attention is crucial for optimizing video accessibility and viewer engagement.

Purpose of the Study:

• To investigate the impact of video captions on eye movement patterns.
• To identify how individual differences influence visual attention during captioned video viewing.
• To explore the relationship between captioning speed and viewer attention.

Main Methods:

• Recorded eye movements of six participants watching video segments with and without captions.
• Analyzed changes in gaze patterns and fixation durations.
• Correlated eye movement data with individual characteristics and captioning parameters.

Main Results:

• Video captions significantly altered eye movement patterns, shifting focus towards reading.
• Individual differences, such as speechreading experience and English proficiency, led to distinct viewing strategies.
• Preliminary findings suggest a correlation between higher captioning speed and increased time spent reading captions.

Conclusions:

• Captions fundamentally change the visual processing of videos, prioritizing reading over other visual cues.
• Viewer behavior during captioned video playback is influenced by a combination of caption presence and individual cognitive and linguistic factors.
• Further research into captioning speed and its cognitive impact is warranted to enhance video accessibility.