一种新的信息复杂性方法来得分接收器操作特征 (ROC) 曲线建模
Aylin Gocoglu1, Neslihan Demirel2, Hamparsum Bozdogan3
1Department of Statistics, The Graduate School of Natural and Applied Sciences, Dokuz Eylul University, Izmir 35390, Turkey.
Entropy (Basel, Switzerland)
|November 27, 2024
概括
一个新的信息复杂性-接收器操作特征 (ICOMP-ROC) 标准提供了一种可靠的方法来选择最佳的ROC曲线模型和机器学习算法. 这种方法有效地平衡了模型的复杂性和合适性,在复杂的数据集中表现优于传统指标.
科学领域:
- 统计 统计 统计 统计
- 机器学习 机器学习
- 生物统计学 生物统计学
背景情况:
- 对于分类模型的传统性能指标存在局限性,因为没有一个单一的指标能够捕捉到性能的所有方面.
- 信息标准为模型选择提供了定量方法,平衡复杂性和合适度.
研究的目的:
- 引入和开发一种新的信息复杂性-接收器操作特征 (ICOMP-ROC) 标准,用于评估ROC曲线模型.
- 将ICOMP-ROC标准的性能与模拟和现实数据集中的传统指标进行比较.
主要方法:
- 为16个双分布式ROC模型构建并推导通用ROC (UROC),最小化ICOMP-ROC标准.
- 进行大规模的蒙特卡洛模拟,使用正常-正常和韦布尔-马对作为伪真实ROC模型.
- 将ICOMP-ROC标准和传统指标应用于高维磁共振成像 (MRI) 和威斯康星乳腺癌 (WBC) 数据集,使用机器学习算法和遗传算法进行特征选择.
主要成果:
- 在模拟中,ICOMP-ROC标准显示出了显著的恢复率,这表明其在模型选择中的有效性.
- 数字结果显示了ICOMP-ROC标准与传统指标相比的一致性和可靠性,特别是对于复杂和高维数据集.
- 该研究使用ICOMP-ROC标准确定了最适合的双分布式ROC模型和分类算法.
结论:
- ICOMP-ROC标准是用于ROC曲线建模和模型选择的通用和强大的方法.
- 这种新的标准有效地解决了传统绩效指标在多样化和复杂的数据场景中的局限性.
- ICOMP-ROC标准为在统计和机器学习应用中选择最佳模型和算法提供了卓越的方法.
相关概念视频
Receiver Operating Characteristic Plot
82
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
82
Region of Convergence of Laplace Tarnsform
488
The Region of Convergence (ROC) is a fundamental concept in signal processing and system analysis, particularly associated with the Laplace transform. The ROC represents an area in the complex plane where the Laplace transform of a given signal converges, determining the transform's applicability and utility.
Consider a decaying exponential signal that begins at a specific time. When deriving its Laplace transform, the time-domain variable is replaced with a complex variable. This...
Consider a decaying exponential signal that begins at a specific time. When deriving its Laplace transform, the time-domain variable is replaced with a complex variable. This...
488
Sensitivity, Specificity, and Predicted Value
192
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
192
z Scores and Area Under the Curve
10.4K
z scores are the standardized values obtained after converting a normal distribution into a standard normal distribution. A z score is measured in units of the standard deviation. The z score tells you how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a z score of...
10.4K
Region of Convergence
381
The z-transform is a powerful mathematical tool used in the analysis of discrete-time signals and systems. It is a crucial tool in the analysis of discrete-time systems, but its convergence is limited to specific values of the complex variable z. This range of values, known as the Region of Convergence (ROC), is fundamental in determining the behavior and stability of a system or signal. The ROC defines the region in the complex plane where the z-transform converges, which can take various...
381
Calibration Curves: Correlation Coefficient
1.5K
In a linear calibration curve, there is a value called the calibration coefficient, denoted by 'r,' which measures the strength and the direction of association between two variables. The correlation coefficient value ranges from −1 to +1. A value of +1 indicates a perfect positive linear correlation, −1 denotes a perfect negative correlation, and 0 implies no correlation between the two variables. A positive correlation value establishes that as one variable increases, the...
1.5K


