FGCN:图像融合点云语义细分与融合图形卷积网络
Kun Zhang1, Rui Chen1, Zidong Peng2
1College of Information Science and Engineering, Hebei University of Science and Technology, Shijiazhuang 050018, China.
Sensors (Basel, Switzerland)
|October 14, 2023
概括
本研究介绍了融合图卷积网络 (FGCN),用于使用多模式数据增强语义细分. 在FGCN提高了像自动驾驶这样的应用场景解释的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 机器人技术 机器人技术 机器人技术
背景情况:
- 语义细分对于自主系统中场景理解至关重要.
- 与单模式方法相比,多模式数据融合增强了特征提取.
- 现有的方法难以从图像和点云数据的组合中高效准确地提取特征.
研究的目的:
- 提出一种新的融合图卷积网络 (FGCN),用于多模式语义细分.
- 通过整合图像数据来提高点云语义细分的准确性和效率.
- 增强细分网络的概括能力和特征区分.
主要方法:
- 开发了一个融合图卷积网络 (FGCN),集成图像和点云数据.
- 实现了一个双通道的k-最近邻居 (KNN) 模块,用于从图像数据中高效地提取特征.
- 在FGCN中利用了空间注意力机制和多尺度特征融合.
主要成果:
- 在自制的SSKIT数据集上实现了88.06%的工会平均交叉点 (MIoU).
- 在公共S3DIS数据集上达到78.55%的MIoU,优于现有方法.
- 在细分精度和数据特征增强方面取得了显著的改进.
结论:
- 拟议的FGCN有效地融合多模式数据,以改善语义细分.
- 该方法增强了特征表示,并在基准数据集上实现了最先进的性能.
- 验证了FGCN在需要精确场景解释的应用程序中的有效性.
相关概念视频
Tagging and Fusion Proteins
6.7K
Proteins are involved in several cellular processes and biochemical reactions. Analyzing a specific protein of interest requires it to be isolated from the other proteins in the cell. This is achieved by overexpressing the specific gene in a suitable host to produce large quantities of the target protein. A tag or label is recombined with the gene to produce a fusion protein containing the target protein and the tag. The tags on these fusion proteins can then be used for easy detection and...
6.7K
Association Areas of the Cortex
5.4K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.4K


