空间遗忘道注意力准课内多样性的特点学习特征
Honggui Han1, Qiyu Zhang2, Fangyu Li1
1Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China; Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing 100124, China; Engineering Research Center of Digital Community Ministry of Education, Beijing University of Technology, Beijing 100124, China; Beijing Artificial Intelligence Institute and Beijing Laboratory for Intelligent Environmental Protection, Beijing 100124, China.
概括
一种新的空间遗忘通道注意力 (SOCA) 方法增强了卷积神经网络 (CNN) 的图像分类. SOCA通过专注于详细的图像区域来改进特征学习,提高各种数据集的准确性.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 卷积神经网络 (CNN) 在图像分类方面表现出色,但在类内样本多样性方面扎.
- 不同的功能可以干扰CNN,限制有效的功能学习和整体性能.
研究的目的:
- 引入一个新的空间遗忘通道注意力 (SOCA) 模块,以改善课内多样性特征的学习.
- 增强CNN学习详细图像特征的能力,而无冗余.
主要方法:
- 拟议的SOCA在每个通道的卷积后执行空间结构遗忘和渐进的规范化.
- SOCA逐步重新分配道重量,以有序的方式专注于详细的特征.
- 在标准数据集 (CIFAR-10/100) 和专门的垃圾数据集上实施和测试SOCA.
主要成果:
- 在各种CNN架构中,SOCA的平均准确性得到了改善,包括SqueezeNet,MobileNet,BN-VGG-19,Inception和ResNet-50.
- 具体的平均准确度增长在1.18%至2.27%之间,取决于网络架构.
- 类激活地图证实SOCA激活了更多本地细节特征区域,验证了其可解释性.
结论:
- 拟议的SOCA模块有效地解决了基于CNN的图像分类中的类内多样性挑战.
- 通过专注于区域细节和防止特征冗余,SOCA增强了特征学习,从而显著提高了准确性.
相关概念视频
01:27Associative Learning
441
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
441
01:15Depth Perception and Spatial Vision
718
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
718
01:12Observational Learning
209
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
209
01:12Differential Leveling
212
Differential leveling is a precise method in surveying used to determine the elevation difference between two points. Its primary goal is to establish accurate vertical measurements to create level surfaces or grade lines critical for designing and constructing infrastructures such as roads, bridges, and buildings.The procedure for differential leveling begins with setting up and leveling the instrument at a point where the benchmark can be seen. The level rod is held on the benchmark (BM), and...
212
01:21Frequency-dependent Selection
22.1K
When the fitness of a trait is influenced by how common it is (i.e., its frequency) relative to different traits within a population, this is referred to as frequency-dependent selection. Frequency-dependent selection may occur between species or within a single species. This type of selection can either be positive—with more common phenotypes having higher fitness—or negative, with rarer phenotypes conferring increased fitness.
22.1K
01:27Uniform Depth Channel Flow
96
Uniform depth channel flow keeps fluid depth consistent along channels such as irrigation canals. In natural channels, such as rivers, approximate uniform flow is often assumed. This condition occurs when the channel’s bottom slope matches the energy slope, balancing potential energy lost from gravity with head loss due to shear stress. This balance prevents depth changes along the channel length, resulting in a steady, uniform flow.Uniform flow in open channels with a constant cross-section...
96