相关实验视频
Updated: Jun 28, 2025

09:36
Assessment of Child Anthropometry in a Large Epidemiologic Study
Published on: February 2, 2017
27.1K
评估选拔程序的质量:虚假阳性率的下限作为评审者之间的可靠性的函数
František Bartoš1,2, Patrícia Martinková1,3
1Department of Statistical Modelling, Institute of Computer Science of the Czech Academy of Sciences, Prague, Czech Republic.
概括
评审者之间的可靠性 (IRR) 可以预测申请人选择的准确性. 这项研究将IRR与二进制分类联系起来,提供计算选择错误率的方法,并改善各种领域的决策.
科学领域:
- 心理测量 心理测量 心理测量
- 统计建模 统计建模
- 决策科学 决策科学 决策科学
背景情况:
- 评级者之间的可靠性 (IRR) 评估了评级质量,但忽视了最终的选择结果.
- 申请人选择往往导致二元决策 (选择/不选择),这是传统的IRR没有捕捉到的重点.
研究的目的:
- 将IRR测量模型与二进制分类框架连接起来.
- 开发方法来近似正确的选择概率和计算错误率 (错误阳性/负).
主要方法:
- 概述了IRR的测量模型和二进制分类之间的关系.
- 开发了一个对正确选择概率的近似值.
- 计算错误概率及其下限.
- 通过模拟和赠款同行评审对绩效进行评估的例子.
主要成果:
- 证明二元分类指标仅取决于IRR系数和选定的申请人的比例.
- 对选择准确性的近似方法进行了验证.
结论:
- 该研究建立了IRR和选择程序的二进制分类指标之间的直接联系.
- 这些发现有助于改进授予同行评审,教育测试,心理评估和健康测量中的选择流程.
- 为实现计算提供了一个R包 (IRR2FPR).
相关概念视频
Accuracy and Errors in Hypothesis Testing
198
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
198
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Bonferroni Test
2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K
Errors In Hypothesis Tests
4.2K
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
4.2K
Receiver Operating Characteristic Plot
150
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
150
Sensitivity, Specificity, and Predicted Value
305
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
305

