Modality-Independent Coding of Scene Categories in Prefrontal Cortex

Area of Science:

• Neuroscience
• Cognitive Science
• Sensory Integration

Background:

• Natural environments provide multisensory information crucial for perception.
• Previous studies decoded visual or auditory scene information from brain activity.
• Understanding cross-modal scene representation in the brain remains a challenge.

Purpose of the Study:

• To investigate how the brain represents scene categories across different sensory modalities.
• To identify brain regions involved in modality-independent scene representation.
• To link neural representations of scene categories to behavioral categorization.

Main Methods:

• Functional magnetic resonance imaging (fMRI) was used to measure brain activity in healthy human subjects.
• Participants viewed images and listened to sounds of real-world environments.
• Machine learning decoders were trained to identify scene categories from neural activity patterns.

Main Results:

• Scene categories were decoded from both modality-specific areas and broader regions including the temporal, parietal, and prefrontal cortex (PFC).
• The PFC exhibited similar activation patterns for both visual and auditory scene categories, indicating modality-independent representation.
• Neural decoder error patterns correlated with behavioral categorization errors, particularly in the middle and superior frontal gyri.

Conclusions:

• The prefrontal cortex (PFC) acts as a hub for integrating multisensory information.
• Scene information is represented abstractly in the PFC, independent of the sensory modality.
• Neural representations in the PFC are closely linked to human categorization behavior.