在物质感知中探测视觉和语言之间的联系,使用心理物理学和无监督学习
Chenxi Liao1, Masataka Sawayama2, Bei Xiao3
1American University, Department of Neuroscience, Washington DC, 20016, USA.
bioRxiv : the preprint server for biology
|February 8, 2024
概括
人类的视觉和语言在物质感知中相对应适度. 虽然语言捕获了广泛的材料质量,但细微的视觉细节和个体差异更好地被视觉捕获,特别是当与文本导向模型保持一致时.
科学领域:
- 认知科学 认知科学
- 计算机视觉 计算机视觉
- 语言学的语言学.
背景情况:
- 人类擅长在视觉上辨别材料并用语言描述它们.
- 了解视觉感知和语言之间的相互作用对于物质识别至关重要.
- 现有的模型往往侧重于视觉或语义特征,而不是它们的整合.
结论:
- 语言捕捉到粗的材料质量,但不是所有的精细的光学特征.
- 人类视觉相似性结构与以文本为导向的视觉语义模型比仅视觉模型更好地对齐.
- 语义和非语义视觉特征对于细粒度物质歧视至关重要.
相关概念视频
Visual System
582
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
582
Vision
53.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
53.3K
Parallel Processing
151
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
151
Depth Perception and Spatial Vision
651
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
651
Color Vision
578
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
578
Gestalt Principles of Perception
303
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
303


