相关实验视频
Updated: May 11, 2026
13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
19.9K
MixImages:一种基于极化多模式的城市感知AI方法
Yan Mo1,2, Wanting Zhou1, Wei Chen3
1School of Information Engineering, Nanchang Hangkong University, Nanchang 330063, China.
Sensors (Basel, Switzerland)
|August 10, 2024
概括
本研究介绍了MixImages,这是一种新的语义细分模型,通过将偏振数据与RGB图像集成来增强城市感知. 该模型显著提高了准确性,特别是在具有挑战性的阴影区域,超过了传统的RGB-only方法.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 遥感 遥感 遥感 遥感
背景情况:
- 城市感知模型通常仅依赖RGB图像,限制了复杂的照明和阴影场景中的性能.
- 现有的方法在与由光影相互作用引起的特征混作斗争,减少感知精度.
- 极化数据提供了RGB之外的补充信息,这对于增强阴影区域表示至关重要.
研究的目的:
- 开发一种新的语义细分模型,MixImages,以改善城市场景的感知.
- 为了利用多式极化数据与RGB图像一起克服单式极化方法的局限性.
- 加强影子地区的代表性,改善城市环境中的像素级感知.
主要方法:
- 提出了一个新的语义细分模型,命名为MixImages.
- 集成的多模式偏振数据与传统的RGB图像输入.
- 使用了变压器架构,因为它的有效受体场可以捕获歧视性线索.
- 在城市场景的专用偏振数据集上进行了实验.
主要成果:
- 在单模基准测试中,MixImages在仅使用RGB的模型上获得了3.43%的精度优势.
- 该模型在多式联运基准测试中显示出4.29%的性能改善.
- 对不同极化组合的分析为下游任务优化提供了洞察力.
结论:
- 拟议的MixImages模型通过有效地结合RGB和偏振数据,在城市场景感知方面取得了重大进展.
- 集成偏振数据增强了模型的稳定性,特别是在具有挑战性的照明条件下,如阴影.
- 在复杂的城市环境中,MixImages为像素级感知任务提供了一个有希望的新方法.
相关概念视频
01:28Perception
Perception is a fundamental psychological process that enables individuals to organize, interpret, and consciously experience sensory information. This process is crucial for understanding and interacting with the world around us. It includes both bottom-up and top-down processing, each playing a distinct role in how we perceive our environment.
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
Bottom-up processing begins at the sensory level, where receptors detect external environmental stimuli. These could include the tactile sensation of...
01:15Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
01:21Gestalt Principles of Perception
Gestalt principles provide a framework for understanding how humans perceive objects as unified wholes within their context. These principles are essential in explaining the cognitive processes that make sense of complex visual stimuli by organizing them into coherent groups. One fundamental principle is proximity, which posits that objects located close to each other are perceived as a collective group. For instance, when dots are positioned near one another, the visual system interprets them...
01:25Factors Affecting Perception
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
01:12Perceptual Constancy
Perceptual constancy is the ability to recognize that objects remain consistent and unchanged even when their appearance varies due to changes in sensory input. There are four main types of perceptual constancy: size constancy, shape constancy, color constancy, and brightness constancy.
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...
Size constancy is the recognition that an object remains the same size, even when its image on the retina changes. For instance, a bus is perceived to be large enough to carry people, even if it looks tiny from...