カテゴリーの流行度で修正された2つの評価者間の合意係数:カッパの代替
1College of Education, Sultan Qaboos University.
Psychological methods
|August 21, 2025
まとめ
この研究は,ランダムな確率の仮定を超えて,カテゴリーの流行を考慮する新しい合意係数を導入します. コーエンにおける限界に対処することによって,より正確な評価者間の信頼性を測定できます.
科学分野:
- 統計について
- サイコメトリック
- 行動科学
背景:
- コエンのカッパは,カテゴリ的なスケールを用いてインターレーター合意のための標準的な統計的尺度です.
- カッパは偶然の合意に 適応しますが その解釈は ランダムな偶然の仮定によって 制限されています
- 既存の制限は,偶然の合意と潜在的なパラドックスの見積もりから生じる.
研究 の 目的:
- 流行-合意効果を考慮した新しい合意係数を提案する.
- ランダムな確率の仮定を超えて 評価者間の信頼性について
- カテゴリーの特徴を考慮して,より正確な合意の尺度を提供する.
主な方法:
- 新規の合意係数を導き出しました.
- ランダムな評価者の割り当てを想定しない新しい統計的アプローチを提案しました.
- 分類の流行と特徴が合意に与える影響を分析した.
主要な成果:
- 新しい係数は,観察された合意から有病率合意効果を効果的に排除します.
- この改訂されたアプローチは,評価者間の信頼性のより微妙な理解を提供します.
- この研究では,新しい係数の重要性,解釈,および推定の安定性について論じています.
結論:
- ランダムな偶然ではなく,流行度-合意効果が観察された合意に影響します.
- 提案された係数は,評価者間の信頼性のより正確な評価を提供します.
- この研究は,カテゴリデータにおける一致を評価するための統計的方法の精錬を図る.
関連する概念動画
Kendall's Coefficient of Concordance
528
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
528
Calibration Curves: Correlation Coefficient
2.3K
In a linear calibration curve, there is a value called the calibration coefficient, denoted by 'r,' which measures the strength and the direction of association between two variables. The correlation coefficient value ranges from −1 to +1. A value of +1 indicates a perfect positive linear correlation, −1 denotes a perfect negative correlation, and 0 implies no correlation between the two variables. A positive correlation value establishes that as one variable increases, the...
2.3K
Coefficient of Correlation
6.4K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable x and the dependent variable y.
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the...
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the...
6.4K
Calculating and Interpreting the Linear Correlation Coefficient
6.4K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable, x, and the dependent variable, y. Hence, it is also known as the Pearson product-moment correlation coefficient. It can be calculated using the following equation:
6.4K
Kendall's Tau Test
815
Kendall's tau test, also known as the Kendall rank coefficient test, is a nonparametric method for assessing association between two variables. This test is particularly useful for identifying significant correlations when the distributions of the sample and population are unknown. Developed in 1938 by the British statistician Sir Maurice George Kendall, the tau coefficient (denoted as τ) serves as a rank correlation coefficient, with values ranging from -1 to +1.
A τ value...
A τ value...
815
Spearman's Rank Correlation Test
1.0K
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates...
Spearman's test calculates...
1.0K


