MMFormer:在遥感图像分类中的多模式半监控视觉变压器
Daixun Li1, Weiying Xie1, Leyuan Fang2
1State Key Laboratory of Integrated Services Networks, Xidian University, Xi'an, 710071, Shannxi, China.
概括
MMFormer是一个新的半监督算法,通过利用功能互补性和一致性来增强多式联络融合. 这种方法提高了高维数据的准确性,即使注释很少.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 变压器架构正在推进多式联运任务.
- 当前的融合方法忽视了特征的互补性和一致性,导致冗余的融合和不完整的表示.
研究的目的:
- 介绍MMFormer,这是一种用于高维多态融合的新型半监督算法.
- 增强模态映射之间的互动性,以实现全面的表示.
- 解决高维度多式数据中稀疏注释的挑战.
主要方法:
- 灵感来自拓类同类组,MMFormer使用完整的字典查找和同类空间来实现表示一致性.
- 使用专属性意识的映射来突出补充的模式信息.
- 引入了一个一致性联合规范化术语,以减轻稀疏注释问题.
主要成果:
- 在三个基准指标 (休斯顿2013,奥格斯堡,MUUFL) 中,MMFormer表现出优越性.
- 实现了3.12% (休斯顿2013),1.86% (奥格斯堡) 和1.66% (MUUFL) 的精度改进.
- 在稀疏注释条件下证实了稳定性和有效性.
结论:
- MMFormer提供了一个统一的端到端优化框架,用于高维的多式融合.
- 代表了半监督视觉转换器在这个领域的首次应用.
- 有效地提高多式联运特征解释和融合精度.
相关概念视频
Vision
60.0K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
60.0K
Sensory Modalities
3.9K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
3.9K
Color Vision
1.5K
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
1.5K
The Sense of Self: Reflected Self-Appraisal and Social Comparison
56.0K
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
56.0K
Bacterial Transformation
59.8K
In 1928, bacteriologist Frederick Griffith worked on a vaccine for pneumonia, which is caused by Streptococcus pneumoniae bacteria. Griffith studied two pneumonia strains in mice: one pathogenic and one non-pathogenic. Only the pathogenic strain killed host mice.
Griffith made an unexpected discovery when he killed the pathogenic strain and mixed its remains with the live, non-pathogenic strain. Not only did the mixture kill host mice, but it also contained living pathogenic bacteria that...
Griffith made an unexpected discovery when he killed the pathogenic strain and mixed its remains with the live, non-pathogenic strain. Not only did the mixture kill host mice, but it also contained living pathogenic bacteria that...
59.8K
Introduction to Special Senses
7.5K
Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive...
7.5K


