Human Object-Similarity Judgments Reflect and Transcend the Primate-IT Object Representation

Area of Science:

• Neuroscience
• Cognitive Science
• Vision Science

Background:

• The inferior temporal (IT) cortex is crucial for high-level object recognition, bridging visual perception and semantic understanding.
• The representation of objects in IT cortex is hypothesized to predict perceived object similarity.

Purpose of the Study:

• To investigate whether object similarity in human IT (hIT) representations predicts human similarity judgments.
• To compare the predictive power of hIT representations against other visual brain regions and computational models.

Main Methods:

• fMRI data analysis of human IT cortex activity patterns.
• Comparison of hIT representations with human similarity judgments.
• Evaluation against early visual cortex, other ventral-stream regions, and computational models.

Main Results:

• Objects with similar hIT activity patterns were judged as more similar by humans.
• hIT representations provided a better account of human judgments than other brain regions or models.
• Human judgments reflected IT-based categories (animate/inanimate, face/body) but also included human-specific divisions (human/non-human, man-made/natural).
• hIT representations were more similar to monkey IT than to human judgments.

Conclusions:

• The IT cortex encodes fundamental visual features relevant across primate species, such as animacy and body form.
• Human-specific semantic processing introduces additional layers of object categorization beyond core visual features.
• Discrepancies suggest evolutionarily conserved visual processing in IT and more flexible, species-specific semantic interpretation in other brain systems.