Related Experiment Videos
What the eyes say about speaking
1University of Illinois at Urbana-Champaign, USA. griffin@psych.stanford.edu
Psychological Science
|March 29, 2001
Summary
Speakers rapidly extract scene information for sentence formulation, selecting subjects based on comprehension, not just visual salience. Eye movements show incremental lexical encoding and anticipate word order during spontaneous speech.
Area of Science:
- Cognitive Psychology
- Psycholinguistics
- Neuroscience
Background:
- Understanding sentence formulation is key to psycholinguistics.
- Theories of sentence production often debate the role of visual perception versus linguistic processing.
Purpose of the Study:
- To investigate the temporal dynamics of sentence formulation.
- To determine how speakers extract information from visual scenes to construct spoken descriptions.
- To test Wundt's theory of sentence production.
Main Methods:
- Monitoring speakers' eye movements while they described simple visual events.
- Analyzing the timing of visual fixations in relation to spoken word production.
- Comparing eye movement patterns to those of observers performing event comprehension tasks.
Main Results:
- Speakers' initial eye movements correlated with event comprehension, suggesting rapid information extraction.
- Visual fixations on elements occurred less than a second before their mention, supporting incremental lexical encoding.
- Eye movements predicted the order of mentioned elements, even with manipulated scene elements and sentence structures.
Conclusions:
- Sentence formulation involves rapid, comprehension-driven information extraction from scenes.
- Spontaneous speech production is incremental, with eye movements reflecting early stages of lexical access.
- Findings support Wilhelm Wundt's theory of sentence production, emphasizing the interplay between perception and language.