在卷积神经网络中集成概率定量化编码,用于对数值变量的信息保存
Ki Yup Nam1,2, Hyun-Woong Park3, Yeongseop Lee4
1Department of Ophthalmology, Chungnam National University Hospital, Daejeon, Republic of Korea.
Scientific reports
|February 11, 2025
概括
整体概率定量化编码保留了在一热编码中丢失的定量数据,改善了卷积神经网络 (CNN) 的性能. 这种新的方法通过保留关键的数字信息来增强CNN,特别是在有限的班级中.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 数据科学数据科学数据科学
背景情况:
- 一次性编码是将数字数据转换为分类数据的标准,但丢失了定量信息.
- 这种数据丢失会对卷积神经网络 (CNN) 的性能产生负面影响.
研究的目的:
- 介绍和评估集合概率定量化编码,以提高CNN性能.
- 将这种新方法与一次性编码,标签光滑和平均平方误差进行比较.
主要方法:
- 开发了集合概率量子化编码,将类视为协作量子.
- 利用交叉损失以获得稳定性,以及集体协作以获得丰富的结果.
- 在同一数据集和CNN模型结构上比较编码技术.
主要成果:
- 量化信息丢失显著降低了CNN的功能.
- 总的概率定量化证明对类数的依赖性较小.
- 新方法保持了有效性,即使与替代方法相比,类数更少.
结论:
- 有效地传输定量信息对于最佳的CNN性能至关重要.
- 整体概率定量化有效地传达了使用较少类数的多样化定量信息.
- 这种方法的性能优于一次性编码和标签光滑,特别是在低等级的场景中.
相关概念视频
Propagation of Uncertainty from Random Error
627
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
627
Convolution: Math, Graphics, and Discrete Signals
223
In any LTI (Linear Time-Invariant) system, the convolution of two signals is denoted using a convolution operator, assuming all initial conditions are zero. The convolution integral can be divided into two parts: the zero-input or natural response and the zero-state or forced response, with t0 indicating the initial time.
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
To simplify the convolution integral, it is assumed that both the input signal and impulse response are zero for negative time values. The graphical convolution process...
223
Propagation of Uncertainty from Systematic Error
455
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
455
Convolution Properties I
134
Convolution computations can be simplified by utilizing their inherent properties.
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
The commutative property reveals that the input and the impulse response of an LTI (Linear Time-Invariant) system can be interchanged without affecting the output:
134
Probability in Statistics
12.3K
Probability is the likelihood of an event occurring. The term event is defined as a collection of results of a procedure. An event is a simple event when an outcome cannot be divided into simpler parts.
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
12.3K
Convolution Properties II
166
The important convolution properties include width, area, differentiation, and integration properties.
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
The width property indicates that if the durations of input signals are T1 and T2, then the width of the output response equals the sum of both durations, irrespective of the shapes of the two functions. For instance, convolving two rectangular pulses with durations of 2 seconds and 1 second results in a function with a width of 3 seconds.
The area property asserts that the area under the...
166


