可视化诊断测试和预测模型的价值,第三部分. 数字示例与离散的风险组和错误校准
Michael A Kohn1, Thomas B Newman1
1Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, USA.
Journal of clinical epidemiology
|January 26, 2025
概括
这项研究表明,风险模型的错误校准如何影响肺栓塞 (PE) 诊断的净益 (NB) 图. 校准错误可能会导致NB的意外跳跃,影响诊断测试评估.
科学领域:
- 医学诊断 医学诊断 医学诊断
- 临床决策的过程
- 医疗服务研究 医疗服务研究
背景情况:
- 肺栓塞 (PE) 诊断依赖于风险模型和D-二次体检测.
- 风险分层模型对于有效的诊断管理至关重要.
- 评估模型性能需要强大的方法,如净收益分析.
研究的目的:
- 用净益 (NB) 图来评估肺栓塞 (PE) 的风险模型.
- 为了证明风险模型校准错误对NB图的影响.
- 为了说明校准错误如何影响诊断测试值的解释.
主要方法:
- 利用了来自5项PE诊断管理研究的6013名参与者的聚合数据.
- 通过评估适当的治疗与过度治疗,加权治疗值几率 (w) 来计算NB.
- 分析的NB图表,x轴与汇率 (w) 线性缩放.
主要成果:
- 风险模型的错误校准导致NB图的垂直移动.
- 模型对风险的高估导致NB上升.
- 这些跳跃发生在治疗值超过过高估计的预测风险时,从而减少过度治疗.
结论:
- 净收益 (NB) 计算是量化诊断测试或风险模型实用性的有效方法.
- 较高的NB表示在特定数据集和值内具有优越的风险模型.
- 应考虑与测试应用相关的危害,如果显著,应从NB中减去.
相关概念视频
Receiver Operating Characteristic Plot
72
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
72
Sensitivity, Specificity, and Predicted Value
174
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
174
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
115
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
115
Comparing the Survival Analysis of Two or More Groups
134
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
134
Testing a Claim about Standard Deviation
2.4K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.4K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K


