Related Experiment Video
Updated: Jun 19, 2026

Interaction between Phonological and Semantic Processes in Visual Word Recognition using Electrophysiology
Published on: June 29, 2021
[Experimental formation of visual-auditory associations in phoneme recognition]
Abstract:
In this study we investigated a question about a possibility to form auditory-visual associations during discrimination of speech sounds (phonemes) when they presented simultaneously with visual stimuli. It was used two types of static images--geometrical figures and images of hand gestures. We judge about formation of auditory-visual association by behavioural disturbance (reaction time, percentage of wrong reactions) after changes in experimental protocol viz. partial substitution of preceiding pairs of stimuli for the new combinations of previous images and sounds. It seems possible to get pronounced auditory-visual association when using images of hand gestures in combinnation with phoneme sounds. On the contrary, employment of images of geometrical figures instead of gestures produced only traces of auditory-visual association. We suggest that it is possible to explain the observed differencies by involvement of additional neuronal populations in auditory-visual assosiation that are preferentially responsive to biological motion.
Related Concept Videos
Auditory Perception
Auditory Pathway
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
Perception of Sound Waves
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Chunking and Rehearsal in Sensory Memory
Associative Learning
Classical conditioning, also known...
Perceiving Loudness, Pitch, and Location
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
