Related Experiment Video
Updated: Sep 7, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Blind subjects construct conscious mental images of visual scenes encoded in musical form
J Cronly-Dillon1, K C Persaud, R Blore
1Department of Optometry and Neuroscience, University of Manchester Institute of Science and Technology, Manchester M60 1QD, UK. john.cronly-dillon@umist.ac.uk
Abstract:
Blind (previously sighted) subjects are able to analyse, describe and graphically represent a number of high-contrast visual images translated into musical form de novo. We presented musical transforms of a random assortment of photographic images of objects and urban scenes to such subjects, a few of which depicted architectural and other landmarks that may be useful in navigating a route to a particular destination. Our blind subjects were able to use the sound representation to construct a conscious mental image that was revealed by their ability to depict a visual target by drawing it. We noted the similarity between the way the visual system integrates information from successive fixations to form a representation that is stable across eye movements and the way a succession of image frames (encoded in sound) which depict different portions of the image are integrated to form a seamless mental image. Finally, we discuss the profound resemblance between the way a professional musician carries out a structural analysis of a musical composition in order to relate its structure to the perception of musical form and the strategies used by our blind subjects in isolating structural features that collectively reveal the identity of visual form.
More Related Videos
Related Concept Videos
Auditory Perception
Subliminal Perception
Parallel Processing
Visual Agnosia
Synesthesia
Encoding
Automatic processing involves the encoding of details like time, space, frequency, and the meaning of words, usually done without conscious...

