Speech perception in perceivers with hearing loss: synergy of multiple modalities

Although we would expect that the role of visible speech in multimodal speech perception would have the greatest relevance to individuals with hearing impairment, relatively few analytic studies have been done with these participants. Their adequate understanding of spoken language usually requires information from several modalities or other sources of information. The framework of the fuzzy logical model of perception (FLMP) is used to assess how individuals with hearing impairment evaluate and integrate multiple sources of information. Given this framework, a distinction can be made between information and information processing. Within this framework, we can ask what information differences and information-processing differences exist among individuals with normal hearing and those with hearing impairment. Four experimental studies from the literature are analyzed to address these questions. Test items are presented under both unimodal and bimodal conditions. Of central interest is the nature of the bimodal performance as a function of the unimodal performance. The findings show that, although information differences obviously exist across different populations, their information processing involved in pattern recognition appears to be the same and is well described by the FLMP.