Speechreading: illusion or window into pattern recognition
Related Experiment Video
Updated: Oct 19, 2026

Eye-tracking to Distinguish Comprehension-based and Oculomotor-based Regressive Eye Movements During Reading
Published on: October 18, 2018
1University of California, Santa Cruz, CA 95060, USA.
Abstract:
In the Fuzzy Logical Model of Perception (FLMP) perceivers are conceptualized as forming perceptual judgments by evaluating and integrating multiple ambiguous sources of information, in an optimal manner based on relative goodness of match. This model has been tested favorably against a variety of competing theories and models. Recent extensions of the FLMP are described in this article along with empirical applications and verification, and progress in the study of speech perception by ear and eye is reviewed within this general theoretical framework. The model illuminates the differences that are observed across different languages in terms of information as opposed to information-processing. Pattern recognition of bimodal speech is representative of pattern recognition in a variety of other domains, such as emotion perception, and there are several domain-dependent reasons why multimodal presentation of audible and visible speech is particularly conducive to accurate pattern recognition. We believe that the positive outcome of this research provides a framework for the development of computer-animated agents, which can serve as language tutors and as conversational characters in other domains, easing the interaction of humans and machines.
Related Concept Videos
Perceiving Language Sounds and Structure During Infancy
Parallel Processing
Gestalt Principles of Perception
Visual System
Once through the pupil, the light passes through the lens, a...
Prosopagnosia
Depth Perception and Spatial Vision

