Psychophysical and physiological evidence for viewer-centered object representations in the primate

Area of Science:

• Neuroscience
• Cognitive Science
• Computer Vision

Background:

• Understanding 3D object perception is crucial for explaining rapid visual recognition.
• The brain may use stored 3D models, viewpoint-invariant features, or 2D template interpolation for recognition.
• The spatial reference frame for object representation remains a key question.

Purpose of the Study:

• To investigate the nature of object representation in the primate brain.
• To combine psychophysical and electrophysiological methods to study 3D object recognition.
• To examine how the brain generalizes recognition across different viewpoints.

Main Methods:

• Monkeys were trained to recognize novel 3D objects from specific viewpoints.
• Recognition generalization was tested for objects rotated around arbitrary axes.
• Electrophysiological recordings were made from inferotemporal cortex neurons during psychophysical tasks.

Main Results:

• Object perception was dependent on the retinal projection; recognition difficulty increased with rotation from a familiar view.
• Generalization fields extended approximately +/- 40 degrees for novel objects.
• Inferotemporal cortex neurons exhibited view-selective responses, with tuning curves showing systematic changes with rotation in depth.

Conclusions:

• Primate 3D object recognition relies on view-dependent representations, not purely viewpoint-invariant features.
• The brain can interpolate between learned views, enabling recognition across a range of orientations.
• Specific neurons in the inferotemporal cortex are tuned to particular object views, contributing to 3D object perception.