紧的CNN模块在功能多样性和冗余性之间进行平衡
Huihuang Zhang1, Haigen Hu1, Deming Zhou1
1College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, 310023, China; Key Laboratory of Visual Media Intelligent Processing Technology of Zhejiang Province, Hangzhou, 310023, China.
概括
我们介绍BDRConv,这是一款新的卷积神经网络 (CNN) 模块,可以平衡功能多样性和冗余性. 这种紧的设计提高了模型的准确性,同时大大降低了用于改进CNN应用程序的计算成本和参数.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 功能多样性和冗余性对于模型性能至关重要,但在网络设计中未被充分探索.
- 现有的卷积神经网络 (CNN) 模块往往需要高的计算成本.
研究的目的:
- 介绍BDRConv,一个紧的CNN模块,旨在平衡功能多样性和冗余性.
- 为了降低计算成本,同时提高功能生成和保留.
主要方法:
- BDRConv将输入特征划分为主要部分和扩展部分,用于不同的特征提取.
- 该模块旨在生成具有中等冗余性和高多样性的特征.
主要成果:
- 配备BDRConv的网络在CIFAR10,ImageNet和MS COCO数据集上表现出卓越的准确性.
- 与最先进的方法相比,观察到浮动点操作 (FLOP) 和参数的显著减少.
结论:
- BDRConv提供了一种有效的方法来平衡CNN的功能多样性和冗余性.
- 它的plug-and-play性质允许简单的集成,显示广泛的CNN应用程序的潜力.
相关概念视频
Design Example: Capacitance Multiplier Circuit
627
In integrated circuit technology, a capacitance multiplier is often utilized to produce a larger capacitance value when a small physical capacitance falls short. This is achieved by a circuit that multiplies capacitance values by a factor of up to 1000, such that a 10-pF capacitor can replicate the performance of a 100-nF capacitor.
The circuit illustrated in Figure 1 below incorporates two op-amps, with the first operating as a voltage follower and the second acting as an inverting amplifier.
The circuit illustrated in Figure 1 below incorporates two op-amps, with the first operating as a voltage follower and the second acting as an inverting amplifier.
627
Distribution Reliability and Automation
93
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
93
Buffers: Buffer Capacity
1.2K
Buffer capacity is the quantitative measure of a buffer to resist the change in pH. As shown in the following equation, the buffer capacity, denoted by 'beta', is expressed as the number of moles of acid or base needed to change the pH of a one-liter buffer solution by 1 unit. Here, Ca and Cb indicate the number of moles of acid and base, respectively. Note that dpH represents the change in pH.
In the graph, pH is plotted as a function of the number of moles of base (Cb) added to a weak...
In the graph, pH is plotted as a function of the number of moles of base (Cb) added to a weak...
1.2K
Reducing Line Loss
134
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
134
Cable Subjected to a Distributed Load
604
The analysis of suspension bridges is a complex and critical process that involves multiple factors, including the shape and tension of the main cables. The main cables of suspension bridges are subjected to distributed loads, which result in changes in tensile forces and deformation of the cable. These loads must be carefully considered to ensure that the bridge is safe and capable of supporting the weight of different loads.
604
Differential Relays
85
Differential relays are used to protect generators, buses, and transformers by comparing electrical quantities at different points. When a fault occurs, the difference in current between the two points triggers the relay to operate, opening the circuit breaker. Under normal conditions, the current entering (i1) and leaving (i2) a generator are equal. When a fault occurs, however, these currents become unequal, and the difference current flows in the relay operating coil, causing the relay to...
85


