在使用专家小组作为参考标准时,诊断测试准确度估计中的偏差驱动因素:模拟研究研究
B E Kellerhuis1, K Jenniskens2, E Schuit2
1Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands. b.e.kellerhuis@umcutrecht.nl.
BMC medical research methodology
|April 24, 2025
概括
在没有黄金标准的情况下,专家小组对于诊断测试准确性研究至关重要. 模拟结果显示,较不准确的组件参考测试显著增加了准确性估计的偏差.
科学领域:
- 医学诊断 医学诊断 医学诊断
- 生物统计学 生物统计学
- 卫生研究方法论 卫生研究方法论
背景情况:
- 专家小组作为诊断测试准确性研究的参考标准,特别是在没有明确的黄金标准的情况下.
- 影响诊断准确性估计的关键研究和专家小组特征仍然不完全理解.
- 本研究解决了需要澄清影响诊断准确性估计可靠性的因素,来自专家小组.
研究的目的:
- 评估各种研究和专家小组特征对指数诊断测试准确性估计的影响.
- 在诊断测试准确性研究中量化不同模拟场景引入的偏差.
- 在使用专家小组作为参考时,确定有助于可靠或不可靠的准确性估计的因素.
主要方法:
- 使用专家小组作为参考标准进行模拟,以评估指数诊断测试的灵敏度和特异性.
- 通过从四个组成部分的参考测试中汇总专家概率估计来确定诊断准确性.
- 场景变化了目标条件的流行率,组件测试的准确性,小组规模,研究群体规模和专家间的变化.
主要成果:
- 准确性估计中的偏见受到研究人群规模或专家小组规模的影响很小.
- 目标状况的患病率显著影响了偏差;较低的患病率 (0.2) 与较高的患病率 (0.5) 相比,导致更广泛,往往更低的灵敏度和特异性估计.
- 组件参考测试的准确性提高 (80%相对于70%的灵敏度/特异性) 显然减少了索引测试准确性估计的偏差.
结论:
- 组件参考测试的准确性是基于专家小组的诊断准确性估计中的偏差的关键决定因素;不那么准确的测试增加了偏差.
- 虽然流行率和专家间的变化也会影响偏见,但它们的影响在不同情景中可能因大小和方向而异.
- 了解这些因素对于提高基于专家共识的诊断测试准确性研究的可靠性至关重要.
相关概念视频
Bias in Epidemiological Studies
92
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
92
Bias
3.7K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
3.7K
Accuracy and Errors in Hypothesis Testing
153
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
153
Sensitivity, Specificity, and Predicted Value
135
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
135
Receiver Operating Characteristic Plot
64
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
64
Testing a Claim about Standard Deviation
2.4K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.4K


