两个评级者之间的一致系数,以类别的流行率进行校正:可替代kappa
1College of Education, Sultan Qaboos University.
Psychological methods
|August 21, 2025
概括
这项研究引入了一个新的协议系数,该系数解释了类别的流行情况,超越了随机机会假设. 它通过解决Cohen中的局限性来提供更准确的互评测可靠性.
科学领域:
- 统计数据
- 心理测量
- 行为科学
背景情况:
- 科恩的卡帕是使用分类尺度进行评估的标准统计量.
- 卡帕会根据偶然的结果进行调整, 但它的解释受随机的假设所限制.
- 现有的局限性源于对偶然性和潜在悖论的估计.
研究的目的:
- 提出一个新的协议系数,以考虑流行协议效应.
- 在评价者之间的可靠性中超越随机机会的假设.
- 通过考虑类别特征来提供更准确的协议度量.
主要方法:
- 通过去除普遍性-协议效应来推导出新的协议系数.
- 提出了一种新的统计方法,不假设随机的评级者分配.
- 分析了类别流行和特征对协议的影响.
主要成果:
- 新的系数有效地消除了观察到的协议的流行效应.
- 这种修订后的方法提供了更细致的对互评级可靠性的理解.
- 该研究讨论了新系数的意义,解释和估计稳定性.
结论:
- 普遍性-一致性效应,而不是随机机会,影响观察到的一致性.
- 建议的系数可以更准确地评估评价者之间的可靠性.
- 这项工作完善了评估分类数据一致性的统计方法.
相关概念视频
Kendall's Coefficient of Concordance
528
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
528
Calibration Curves: Correlation Coefficient
2.3K
In a linear calibration curve, there is a value called the calibration coefficient, denoted by 'r,' which measures the strength and the direction of association between two variables. The correlation coefficient value ranges from −1 to +1. A value of +1 indicates a perfect positive linear correlation, −1 denotes a perfect negative correlation, and 0 implies no correlation between the two variables. A positive correlation value establishes that as one variable increases, the...
2.3K
Coefficient of Correlation
6.4K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable x and the dependent variable y.
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the...
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the...
6.4K
Calculating and Interpreting the Linear Correlation Coefficient
6.4K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable, x, and the dependent variable, y. Hence, it is also known as the Pearson product-moment correlation coefficient. It can be calculated using the following equation:
6.4K
Kendall's Tau Test
815
Kendall's tau test, also known as the Kendall rank coefficient test, is a nonparametric method for assessing association between two variables. This test is particularly useful for identifying significant correlations when the distributions of the sample and population are unknown. Developed in 1938 by the British statistician Sir Maurice George Kendall, the tau coefficient (denoted as τ) serves as a rank correlation coefficient, with values ranging from -1 to +1.
A τ value...
A τ value...
815
Spearman's Rank Correlation Test
1.0K
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates...
Spearman's test calculates...
1.0K


