Behaviorally-relevant features of observed actions dominate cortical representational geometry in natural vision
View abstract on PubMed
Summary
This summary is machine-generated.Understanding how the brain processes actions relies on social content and purpose. Behavioral judgments of action similarity better predict neural representations than semantic or visual models.
Area Of Science
- Neuroscience
- Cognitive Science
- Computer Vision
Background
- Humans excel at interpreting actions from visual input.
- Understanding the neural basis of action perception is crucial.
Purpose Of The Study
- To model and understand the neural representational geometries of action understanding.
- To compare behavioral, semantic, and visual models in predicting neural data.
Main Methods
- fMRI data collected while participants viewed 90 diverse action videos.
- Developed five behavioral models (transitivity, sociality, people, objects, scene).
- Compared behavioral models against semantic (verb/nonverb embeddings) and visual (gaze/motion) models.
Main Results
- Behavioral judgments of similarity significantly predicted neural representational geometry across the cortex.
- Sociality and transitivity models explained unique variance in the action observation network.
- Neural representations extended beyond traditional action perception regions, including ventral temporal cortex.
Conclusions
- Behavioral similarity, particularly social content and purpose, is key to cortical action representation.
- Findings expand the known neural network for action observation.
- The brain prioritizes social context and action goals in visual perception.
Related Concept Videos
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
Light is absorbed by the rod and cone...
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
The eye is a spherical, hollow structure composed of three tissue layers. The outer layer — the fibrous tunic, comprises the sclera — a white structure — and the cornea, which is transparent. The sclera encompasses some of the ocular surface, most of which is not visible. However, the 'white of the eye' is distinctively visible in humans compared to other species. The cornea, a clear covering at the front of the eye, enables light penetration. The eye's middle...

