TbsNet:微分支结构在CNN中的重要性
Xiujian Hu1, Guanglei Sheng2, Piao Shi3
1Department of Electronics and Information Engineering, Bozhou University, Bozhou, AnHui, China.
PeerJ. Computer science
|June 22, 2023
概括
本研究介绍了TbsNet,这是一个新的卷积神经网络 (CNN) 架构,旨在提高效率. 使用轻量级操作员,TbsNet最大限度地减少了计算和冗余,在图像识别和医疗图像细分任务中实现了高精度.
科学领域:
- 计算机视觉 计算机视觉
- 深度学习 (Deep Learning) 是一种深度学习.
- 神经网络架构设计神经网络架构设计
背景情况:
- 卷积神经网络 (CNN) 的性能是复杂的,取决于诸如深度,宽度和结构等因素.
- 为高效的CNN架构设计优化这些因素是一个重大挑战.
研究的目的:
- 分析影响CNN业绩的关键因素.
- 为高效的卷积网络建设提出战略.
- 介绍TbsNet,一种新的,简化的网络架构.
主要方法:
- 实施了轻量级运算符 (不对称,点向,深度向,组卷积),以减少计算和特征冗余.
- 设计的TbsNet具有简单,简化的结构,避免重构和外来分支.
- 进行了广泛的实验,评估网络深度和宽度.
主要成果:
- TbsNet获得了高的Top 1准确率:在CIFAR-10上达到97.02%,在CIFAR-100上达到83.56%,在ImageNet-1K上达到86.17%.
- 在 Synapse 数据集上,Tbs-UNet 显示了 78.39% 的 Dice 相似系数 (DSC),表现优于 TransUNet.
- 与ResNet,ConvNeXt和MobileNet.Net等最先进的网络相比,TbsNet显示出具有竞争力的性能.
结论:
- TbsNet为计算机视觉任务提供了一种高效和有效的架构.
- 简化,细分支结构最大限度地降低了计算成本和功能冗余.
- TbsNet适用于下游应用,包括医疗图像细分.
相关概念视频
01:25Neural Circuits
1.3K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.3K
01:20Convolution Properties I
188
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
188
01:17Convolution Properties II
239
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
239
01:24Convolution: Math, Graphics, and Discrete Signals
305
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
305
01:30Neuron Structure
13.1K
Neurons are the main type of cell in the nervous system that generate and transmit electrochemical signals. They primarily communicate with each other using neurotransmitters at specific junctions called synapses. Neurons come in many shapes that often relate to their function, but most share three main structures: an axon and dendrites that extend out from a cell body.
Structure and Function of Neurons
The neuronal cell body—the soma— houses the nucleus and organelles vital to...
Structure and Function of Neurons
The neuronal cell body—the soma— houses the nucleus and organelles vital to...
13.1K
01:18Reducing Line Loss
176
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
176