协议兰巴达对与顺序尺度加权不一致的权衡:为类别流行率进行校正
1Sultan Qaboos University, Muscat, Oman.
Educational and psychological measurement
|November 13, 2025
概括
一个新的加权兰巴达系数可以更好地测量评价者之间的一致性,特别是在顺序数据上. 这种方法考虑了流行协议效应,优于加权卡帕等传统系数.
科学领域:
- 统计 统计 统计 统计
- 心理测量 心理测量 心理测量
- 社会科学 社会科学 社会科学
背景情况:
- 对顺序数据而言,加权的分级间协议至关重要.
- 现有的方法 (例如,加权卡帕) 对评级者边际和类别流行情况敏感.
- 这些方法经常调整随机协议,这可能不合适.
研究的目的:
- 引入一种新的加权兰巴达系数,用于评估者之间的协议.
- 解决现有的加权卡帕式系数的局限性.
- 开发用于加权Lambda的统计推理方法 (标准误差,假设测试,置信区间).
主要方法:
- 开发了一个新的加权兰巴达系数,该系数修改了观察到的协议,并纳入了流行-协议效应.
- 建议用于估计采样标准误差,假设测试和置信区间的技术.
- 进行蒙特卡洛模拟并提出数值示例,以比较加权兰巴达与现有系数.
主要成果:
- 权重的兰巴达有效地衡量了权重的关税人间协议,特别是在考虑流行度-协议效应时.
- 新的系数在各种协议场景中显示出相对于传统方法的优势.
- 模拟证实了加权Lambda的实用性和性能.
结论:
- 权重的兰巴达为衡量权重的评价者间协议提供了一个强大的替代方案.
- 这个系数可以更好地处理类别的流行率和不同意见权重.
- 提出的推断方法促进了加权兰巴达的实际应用.
相关概念视频
Ordinal Level of Measurement
31.9K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
31.9K
Weighted Mean
6.2K
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
6.2K
Kendall's Coefficient of Concordance
936
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
936
Friedman Two-way Analysis of Variance by Ranks
475
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
475
Nominal Level of Measurement
36.9K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. Not every statistical operation can be used with every set of data. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
The data that cannot be measured but can be grouped into categories fall under the nominal level of measurement. Data that is measured using a nominal...
The data that cannot be measured but can be grouped into categories fall under the nominal level of measurement. Data that is measured using a nominal...
36.9K
Testing a Claim about Standard Deviation
2.9K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.9K


