Effect of Subtitles on Gaze Behavior during Shot Changes: An Eye-tracking Study

Area of Science:

• Film Studies
• Cognitive Psychology
• Human-Computer Interaction

Background:

• Subtitles are crucial for accessibility in film.
• Understanding subtitle impact on visual attention is key for optimizing viewer experience.
• Previous research has not fully explored subtitle effects across different editing styles.

Purpose of the Study:

• To investigate how subtitles influence gaze behavior in non-native English speakers watching films.
• To compare the effects of subtitles on gaze during continuity versus discontinuity editing.
• To determine viewer preference between visual content and subtitles.

Main Methods:

• Eye-tracking was used to record gaze behavior (entry time, dwell time, fixation duration, scan path).
• Participants viewed three types of video clips: continuity editing with/without subtitles, and discontinuity editing with/without subtitles.
• Data were analyzed using repeated measures two-way ANOVA and paired t-tests.

Main Results:

• Subtitles altered eye movement patterns, particularly during shot transitions.
• The timing of subtitle appearance relative to cuts influenced gaze behavior.
• Editing style did not significantly affect gaze behavior when subtitles were present.
• Participants showed a preference for reading subtitles over viewing images.

Conclusions:

• Subtitles redirect visual attention, impacting how viewers process cinematic content.
• Subtitle timing and presence are more influential than editing style on gaze.
• Viewer preference suggests subtitles play a dominant role in information intake during film consumption.