Seeing a Three-Dimensional World in Motion: How the Brain Computes Object Motion and Depth During Self-Motion

Area of Science:

• Neuroscience
• Computational Vision
• Perception Psychology

Background:

• Self-motion generates complex visual signals that challenge perception.
• These signals, however, provide crucial information about self-motion and environmental structure.
• Existing models often struggle to integrate various visual cues during movement.

Purpose of the Study:

• To review recent advances in depth and motion perception during self-motion.
• To explore the neural mechanisms underlying these perceptual processes.
• To propose a unified framework integrating optic flow, motion parallax, and coordinate transformation.

Main Methods:

• Literature review of recent studies on visual self-motion perception.
• Analysis of computational and neural mechanisms.
• Synthesis of findings into a comprehensive theoretical framework.

Main Results:

• Recent research has significantly advanced our understanding of how the visual system handles self-generated motion signals.
• Key neural computations involve optic flow parsing, depth from motion parallax, and coordinate transformation.
• These processes work together to infer object motion, self-motion, and environmental depth.

Conclusions:

• A comprehensive framework is proposed to integrate diverse visual phenomena related to self-motion.
• The visual system performs complex computations to jointly infer motion and depth during self-movement.
• Further research can refine this framework for a more complete understanding of visual perception.