在层次数据集中的错误严重程度
Satwik Srivastava1, Deepak Mishra2
1Department of Mathematics, Indian Institute of Technology Jodhpur, Jodhpur, India. srivastava.23@iitj.ac.in.
Scientific reports
|December 11, 2023
概括
医疗人工智能分类器需要更好的评估,而不仅仅是准确性. 本研究介绍了错误严重程度作为高风险医疗保健应用的关键指标,突出了对专门方法的需求.
科学领域:
- 人工智能的人工智能
- 医疗信息学 医疗信息学
- 机器学习 机器学习
背景情况:
- 在医学分类任务中,分层数据集很常见.
- 当前的分类器越来越准确,但可能无法解释错误的后果.
- 对于高风险的医疗应用,准确性和AUROC等标准指标可能不足.
研究的目的:
- 探索并将错误严重程度的概念扩展到医学领域.
- 为了证明准确性和AUROC在高风险的医学分类中的局限性.
- 评估减少医学AI错误分类严重性的方法.
主要方法:
- 在分类模型中的错误严重性的探索.
- 将错误严重性概念扩展到医疗数据集和应用程序.
- 对各种方法进行比较评估,以减少分类错误的严重程度.
主要成果:
- 仅靠精度和AUROC就不足以在高风险场景中评估医疗AI.
- 现有的减少错误严重性的方法可能不适合医疗领域.
- 该研究强调了当错误分类产生严重后果时,传统指标的不足.
结论:
- 错误严重程度是医疗AI部署的关键考虑因素.
- 需要针对医疗领域独特挑战的新技术.
- 开发专门的方法对于将医疗保健中的AI推进到可部署状态至关重要.
相关概念视频
Accuracy and Errors in Hypothesis Testing
201
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
201
Systematic Error: Methodological and Sampling Errors
1.5K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
1.5K
Types of Errors: Detection and Minimization
1.6K
Error is the deviation of the obtained result from the true, expected value or the estimated central value. Errors are expressed in absolute or relative terms.
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
1.6K
Detection of Gross Error: The Q Test
6.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.1K
Random Error
893
Random or indeterminate errors originate from various uncontrollable variables, such as variations in environmental conditions, instrument imperfections, or the inherent variability of the phenomena being measured. Usually, these errors cannot be predicted, estimated, or characterized because their direction and magnitude often vary in magnitude and direction even during consecutive measurements. As a result, they are difficult to eliminate. However, the aggregate effect of these errors can be...
893
Survival Tree
87
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
87


