Related Experiment Video
Updated: Jun 27, 2026
07:10
Application of Biochip Microfluidic Technology to Detect Serum Allergen-specific Immunoglobulin E (sIgE)
Published on: April 21, 2019
Relationships between statistical measures of agreement: sensitivity, specificity and kappa
Martin Feuerman1, Allen R Miller
1Biostatisticians, Winthrop University Hospital, Academic Affairs Mineola, NY, USA. mfeuerma@winthrop.org
Journal of Evaluation in Clinical Practice
|November 21, 2008
Summary
This study presents analytic formulas and a graph to connect Cohen
Area of Science:
- Biostatistics
- Medical Diagnostics
Background:
- Cohen's kappa coefficient is a standard metric for assessing agreement between two binary outcomes in clinical studies.
- Sensitivity and specificity are crucial measures for evaluating diagnostic test performance.
- A clear analytic relationship between kappa, sensitivity, and specificity is beneficial for interpreting agreement in clinical research.
Purpose of the Study:
- To elaborate on existing work and discuss analytic formulas connecting specificity, sensitivity, and Cohen's kappa.
- To provide a graphical representation of minimal sensitivity and specificity pairs for various kappa values.
Main Methods:
- Review and extension of previous analytical work on agreement measures.
- Development of formulas linking diagnostic test agreement metrics.
- Graphical illustration of the relationship between kappa, sensitivity, and specificity.
Main Results:
- Analytic formulas are presented that relate Cohen's kappa to sensitivity and specificity.
- A graph visualizes the minimal pairs of sensitivity and specificity for kappa values ranging from good to excellent agreement.
- The findings provide a quantitative link between these commonly used agreement and performance metrics.
Conclusions:
- The derived analytic formulas and graph offer a valuable tool for clinicians and biostatisticians.
- These resources aid in the interpretation of diagnostic test results when sensitivity, specificity, and kappa are used concurrently.
- Improved understanding of agreement and performance metrics can lead to better clinical decision-making.
Related Concept Videos
01:20Kendall's Coefficient of Concordance
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects or...
01:13Sensitivity, Specificity, and Predicted Value
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Sensitivity is the...
01:15Receiver Operating Characteristic Plot
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
01:16Kendall's Tau Test
Kendall's tau test, also known as the Kendall rank coefficient test, is a nonparametric method for assessing association between two variables. This test is particularly useful for identifying significant correlations when the distributions of the sample and population are unknown. Developed in 1938 by the British statistician Sir Maurice George Kendall, the tau coefficient (denoted as τ) serves as a rank correlation coefficient, with values ranging from -1 to +1.
A τ value of +1 indicates that...
A τ value of +1 indicates that...
01:20Spearman's Rank Correlation Test
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates correlation by...
Spearman's test calculates correlation by...
01:10Calibration Curves: Correlation Coefficient
In a linear calibration curve, there is a value called the calibration coefficient, denoted by 'r,' which measures the strength and the direction of association between two variables. The correlation coefficient value ranges from −1 to +1. A value of +1 indicates a perfect positive linear correlation, −1 denotes a perfect negative correlation, and 0 implies no correlation between the two variables. A positive correlation value establishes that as one variable increases, the other increases, and...