达到涅:最大化欧几里德空间和角空间中的边际,用于深度神经网络分类
IEEE transactions on neural networks and learning systems
|August 12, 2024
概括
这项研究引入了一种新的分类损失函数,通过同时最大化欧几里德空间和角空间的边缘来提高深度神经网络的准确性. 这种方法提高了标准分类和开放集识别任务的性能.
科学领域:
- 机器学习 机器学习
- 计算机视觉 计算机视觉
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 深度神经网络中的分类损失函数通常在欧几里德空间或角度空间中优化边缘.
- 现有的方法单独使用欧几里德距离或共弦相似度,导致潜在的不一致性.
研究的目的:
- 引入一种新的分类损失函数,同时在欧几里德空间和角空间中最大化边缘.
- 通过确保一致的距离指标来提高分类的准确性和稳定性.
主要方法:
- 拟议的损失函数将样本聚集在超球上的类中心周围.
- 班级中心位于正规简单的顶点,以相当的对距离.
- 一个单一的,易于配置的超参数简化了实现.
主要成果:
- 新的损失函数在欧几里德和小距离之间取得一致的结果,提高了准确性.
- 该方法有效地集群数据,提高了经典分类中的性能.
- 通过有效拒绝不熟悉的样本,在开放式集识别中表现出卓越的性能.
结论:
- 拟议的损失函数为欧几里德空间和角空间的边际最大化提供了一个统一的方法.
- 它在经典和开放式集识别任务中提供了显著的改进.
- 该方法的简单性和有效性使其非常适合实际应用.
相关概念视频
Margin of Error
4.0K
The margin of error is also called the maximum error of an estimate. The margin of error is the maximum possible or expected difference between the observed sample parameter value and the actual population parameter value. For proportion, it is the maximum difference between the value of sample proportion obtained from the data and the true value of population proportion. As the true value of the population parameter is not known, the margin of error is calculated using the sample statistic.
4.0K
Reducing Line Loss
150
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
150
Aggregates Classification
310
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
310
Mean Absolute Deviation
2.6K
The mean absolute deviation is also a measure of the variability of data in a sample. It is the absolute value of the average difference between the data values and the mean.
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
2.6K
Dot Product: Problem Solving
364
The dot product is a powerful tool in problem-solving involving vectors, given that the dot product of two vectors is the product of their magnitudes and the cosine of the angle between them measured anti-clockwise. Solving problems involving the dot product requires understanding its properties and developing a step-by-step process to solve them. Here are the main steps to follow when solving any general problem involving the dot product:
Identify the problem: Start by reading the problem and...
Identify the problem: Start by reading the problem and...
364
Routh-Hurwitz Criterion II
208
In the application of the Routh-Hurwitz criterion, two specific scenarios can arise that complicate stability analysis.
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
208


