在二进制尺度上,多个评级者之间达成协议的统计推断
1Department of Methodology and Statistics, CAPHRI, Maastricht university, Maastricht, The Netherlands.
The British journal of mathematical and statistical psychology
|January 17, 2024
概括
本研究引入了对多个评级者进行协议研究的改进统计方法. 新程序为可靠的协议分析提供了更好的统计性能和样本大小计算.
科学领域:
- 统计 统计 统计 统计
- 生物统计学 生物统计学
- 心理测量 心理测量 心理测量
背景情况:
- 协议研究对于评估各种领域的可靠性至关重要.
- 传统的协议措施往往在两个以上的评级者或重复测量时遇到困难.
- 对于复杂的协议场景,现有的方法可能缺乏可靠的统计推理程序.
研究的目的:
- 为了将二进制尺度的协议措施泛化为具有多个评分器的研究.
- 建议和评估用于增强协议分析的新型统计推理程序.
- 为在多级协议研究中确定最佳样本大小提供工具.
主要方法:
- 使用德尔塔法来估计标准错误的沃尔德置信区间的开发.
- 在不需要专门的贝叶斯软件的情况下实现贝叶斯统计推理.
- 根据评级人员的数量来确定样本大小的分析公式的推导.
主要成果:
- 提出的沃尔德和贝叶斯方法与之前建议的置信区间相比,显示出优越的统计行为.
- 新的程序在多级别设置中提供了更可靠的协议评估.
- 分析公式通过确定所需的最低样本大小来促进有效的研究规划.
结论:
- 新的统计推断程序提供了一个更强大的框架,用于分析多个评级者的研究中的一致性.
- 开发的方法和附带的R包 (simpleagree) 和Shiny应用程序增强了协议研究的实际应用.
- 这项工作有助于更准确,更可靠地评估评估者间或重复测量协议.
相关概念视频
Kendall's Coefficient of Concordance
339
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
339
Ratio Level of Measurement
18.0K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
18.0K
Friedman Two-way Analysis of Variance by Ranks
198
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
198
Calibration Curves: Correlation Coefficient
1.6K
In a linear calibration curve, there is a value called the calibration coefficient, denoted by 'r,' which measures the strength and the direction of association between two variables. The correlation coefficient value ranges from −1 to +1. A value of +1 indicates a perfect positive linear correlation, −1 denotes a perfect negative correlation, and 0 implies no correlation between the two variables. A positive correlation value establishes that as one variable increases, the...
1.6K
Statistical Analysis: Overview
6.6K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.6K
Ordinal Level of Measurement
23.7K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
23.7K


