在多个评价者之间达成的互评价者协议的Lambda系数:为类别流行率进行校正
1Sultan Qaboos University, Muscat, Oman.
Educational and psychological measurement
|November 6, 2025
概括
弗莱斯的卡帕 (Fleiss's Kappa) 是衡量评价者之间协议的标准,但由于偶然的假设,它面临着挑战. 本研究引入了一种新型系数,用于计算类别的流行率,以更准确地评估可靠性.
科学领域:
- 统计 统计 统计 统计
- 心理测量 心理测量 心理测量
- 生物统计学 生物统计学
背景情况:
- 弗莱斯的卡帕扩展了科恩的卡帕多个评级者,但有解释性的挑战.
- 随机机会协议的假设和评级者数量灵敏度限制了它的应用.
- 类别的流行率和特征影响的协议超出了随机的机会.
研究的目的:
- 为了解决弗莱斯·卡帕的局限性.
- 引入一个新的协议系数.
- 为不平衡的类别分布提供更准确的interrater可靠性测量.
主要方法:
- 开发了一个新的协议系数,根据类别的流行情况进行调整.
- 从随机评级者分配假设转移.
- 检查了理论上的理由,可解释性和标准错误.
主要成果:
- 新型系数提供了一个更准确的测量器之间的可靠性.
- 它解释了类别的流行,改善了不平衡数据的解释.
- 模拟和实际应用证明了它的稳定性.
结论:
- 拟议的系数增强了评价者之间的可靠性评估.
- 它通过考虑类别的流行,提供了对协议的更细致的理解.
- 这种方法在统计分析中提供了更好的解释性和准确性.
相关概念视频
Kendall's Coefficient of Concordance
936
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
936
Coefficient of Correlation
8.2K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable x and the dependent variable y.
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the...
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the...
8.2K
Calibration Curves: Correlation Coefficient
4.5K
In a linear calibration curve, there is a value called the calibration coefficient, denoted by 'r,' which measures the strength and the direction of association between two variables. The correlation coefficient value ranges from −1 to +1. A value of +1 indicates a perfect positive linear correlation, −1 denotes a perfect negative correlation, and 0 implies no correlation between the two variables. A positive correlation value establishes that as one variable increases, the...
4.5K
Calculating and Interpreting the Linear Correlation Coefficient
7.7K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable, x, and the dependent variable, y. Hence, it is also known as the Pearson product-moment correlation coefficient. It can be calculated using the following equation:
7.7K
Confidence Coefficient
10.3K
The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under...
10.3K
Coefficient of Variation
8.1K
The coefficient of variation measures the dispersion of the data points or distribution around the mean. Using the coefficient of variation, we can compare two data series with drastically different means or different units of measurement. The coefficient of variation for a sample and a population is expressed as a percentage of the ratio of standard deviation to the mean.
The coefficient of variation is a practical statistical tool in finance. It allows investors to assess the volatility or...
The coefficient of variation is a practical statistical tool in finance. It allows investors to assess the volatility or...
8.1K


