相关实验视频
Updated: Jun 1, 2025

13:19
Deep Neural Networks for Image-Based Dietary Assessment
Published on: March 13, 2021
8.9K
一般化交叉透损失用于训练带有噪音标签的深度神经网络
1Electrical and Computer Engineering, Meinig School of Biomedical Engineering Cornell University.
Advances in neural information processing systems
|January 22, 2025
概括
新的噪声强度损失函数将深度神经网络 (DNN) 的平均绝对误差 (MAE) 和分类交叉 (CCE) 概括为一般. 这些新的功能提高了带有噪音标签的数据集的性能,解决了现有方法的局限性.
科学领域:
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
- 计算机视觉 计算机视觉
背景情况:
- 深度神经网络 (DNN) 在各种应用中表现出色,但需要大型,准确标记的数据集.
- 训练标签中的错误可以显著降低DNN的性能.
- 平均绝对误差 (MAE) 被提出作为对分类交叉 (CCE) 的噪声强大的替代方案,但可以用DNNs表现不佳.
研究的目的:
- 为DNN开发理论上有基础的,对噪声强大的损失函数.
- 将MAE和CCE等现有的损失函数泛化.
- 提供适用于各种DNN架构和算法的多功能解决方案.
主要方法:
- 提出了一套全新的通用损失函数.
- 在CIFAR-10,CIFAR-100和FASHION-MNIST数据集上评估了性能.
- 利用合成生成的噪音标签来模拟现实世界的数据缺陷.
主要成果:
- 拟议的损失函数在噪音标签条件下在不同的数据集中显示出强大的性能.
- 新功能在具有挑战性的场景中表现优于MAE.
- 与带有噪音标签的标准CCE损失相比,这种泛化提供了更好的准确性.
结论:
- 开发的噪声强度损失功能为训练带有不完善标签的DNN提供了显著的改进.
- 这些功能易于应用,在有标签噪声的情况下提高模型性能.
- 这项研究为强大的机器学习实践提供了宝贵的贡献.
相关概念视频
Propagation of Uncertainty from Random Error
633
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
633
Mean Absolute Deviation
2.6K
The mean absolute deviation is also a measure of the variability of data in a sample. It is the absolute value of the average difference between the data values and the mean.
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
2.6K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Detection of Gross Error: The Q Test
5.6K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
5.6K
Margin of Error
4.0K
The margin of error is also called the maximum error of an estimate. The margin of error is the maximum possible or expected difference between the observed sample parameter value and the actual population parameter value. For proportion, it is the maximum difference between the value of sample proportion obtained from the data and the true value of population proportion. As the true value of the population parameter is not known, the margin of error is calculated using the sample statistic.
4.0K
Reducing Line Loss
143
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
143

