相关实验视频
Updated: Sep 9, 2025

13:19
Deep Neural Networks for Image-Based Dietary Assessment
Published on: March 13, 2021
9.3K
在增量学习中重新思考软max
Zheng Zhai1, Jiali Zhang2, Haiyu Wang3
1Department of Statistics, Faculty of Arts and Sciences, Beijing Normal University, Zhuhai, Guangdong, China.
概括
这项研究通过引入新的蒸损失来解决渐进学习中的灾难性遗忘问题. 我们的方法提高了机器学习模型的准确性,
科学领域:
- 机器学习
- 人工智能
- 深度学习
背景情况:
- 灾难性遗忘是渐进式学习的一个主要障碍,模型在接受新数据训练时会忘记先前学到的信息.
- 标准软交叉蒸损失无法识别,阻碍了有效的增量学习.
研究的目的:
- 提出新的策略来缓解渐进式学习中的灾难性遗忘.
- 解决软最大交叉蒸损失的不可识别问题.
主要方法:
- 引入了不平衡不变的蒸损失,以抵消蒸过程中不平衡的重量.
- 规范化预测/蒸损失与变化敏感的替代方案来识别问题.
- 在LWF,LWM和LUCIR等现有框架中开发了五种新方法.
主要成果:
- 在多个增量学习框架中显示出一致的预测准确性.
- 在广泛的数值实验中, 遗忘率大幅降低.
- 在CIFAR-100中,平均精度提高了11%以上,LWF,LWM和LUCIR的遗忘率降低了16%以上.
结论:
- 建议的策略有效地缓解了渐进式学习中的灾难性遗忘.
- 这些新方法提高了基于蒸的增量学习方法的性能.
- 这项研究为建立更强大的增量学习系统提供了实际解决方案.
相关概念视频
Residuals and Least-Squares Property
7.8K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.8K
Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149
Associative Learning
569
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
569
Observational Learning
310
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
310
Improving Translational Accuracy
11.8K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.8K
Regression Toward the Mean
6.5K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.5K
