超越规模和阶级平衡:阿尔法作为深度学习的新数据集质量指标
Josiah Couch1, Rima Arnaout2, Ramy Arnaout3
1Department of Pathology at Beth Israel Deaconess Medical Center (BIDMC), Boston, MA 02215.
ArXiv
|January 20, 2025
概括
最大限度地提高数据集的多样性,而不仅仅是大小或平衡,可以改善医学成像的深度学习. 生态多样性的测量,如通用,比传统指标更好地预测模型性能.
科学领域:
- 计算机科学 计算机科学
- 机器学习 机器学习
- 医疗成像医学成像
背景情况:
- 图像分类深度学习的高性能依赖于多样化的训练数据集.
- 目前最大化数据集大小和类平衡的做法不确保足够的多样性.
- 数据集的多样性对于强大的模型性能至关重要,特别是在医学成像应用中.
研究的目的:
- 调查是否直接最大化数据集多样性可以提高深度学习模型的性能.
- 为量化图像数据集多样性引入和评估生态多样性措施.
- 将多样性指标的预测能力与传统的大小和平衡指标进行比较.
主要方法:
- 开发了一个生态多样性测量框架,将香农概括为图像相似性.
- 分析了来自七个医学成像数据集的数千个子集.
- 与模型性能指标如平衡精度相关的多样性测量 (特别是一般化的,标记为"大阿尔法") .
主要成果:
- 一般化度 ("大阿尔法") 是比数据集大小或类平衡更强的性能预测指标.
- 一个特定的测量方法,数学,解释了67%的平衡精度差异,超过了类平衡 (54%) 和大小 (39%).
- 将数据集大小与数学结合起来,产生了最高的性能预测 (79%),超过了大小加类平衡 (74%).
结论:
- 使用诸如通用的生态指标来最大化数据集多样性是提高医学成像中的深度学习性能的一个有希望的策略.
- 与传统指标相比,拟议的"大阿尔法"措施提供了一种更有效的方法来评估和改善培训体系质量.
- 未来的工作应该集中在实施多样性最大化技术,以改善医疗人工智能模型.
相关概念视频
Mean Absolute Deviation
2.6K
The mean absolute deviation is also a measure of the variability of data in a sample. It is the absolute value of the average difference between the data values and the mean.
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
2.6K
Improving Translational Accuracy
8.6K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
8.6K
Aggregates Classification
300
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
300
Confidence Coefficient
7.5K
The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under...
7.5K
Accuracy, limits, and approximation
437
Accuracy, limits, and approximations are common in many fields, especially in engineering calculations. These concepts are imperative for ensuring that a given value is as close as possible to its true value.
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
437
Testing a Claim about Standard Deviation
2.4K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.4K


