Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Statistical Analysis: Overview01:11

Statistical Analysis: Overview

6.3K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.3K
Calibration Curves: Correlation Coefficient01:10

Calibration Curves: Correlation Coefficient

1.6K
In a linear calibration curve, there is a value called the calibration coefficient, denoted by 'r,' which measures the strength and the direction of association between two variables. The correlation coefficient value ranges from −1 to +1. A value of +1 indicates a perfect positive linear correlation, −1 denotes a perfect negative correlation, and 0 implies no correlation between the two variables. A positive correlation value establishes that as one variable increases, the...
1.6K
Kendall's Coefficient of Concordance01:20

Kendall's Coefficient of Concordance

294
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
294
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

106
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
106
Calculating and Interpreting the Linear Correlation Coefficient01:11

Calculating and Interpreting the Linear Correlation Coefficient

5.9K
The correlation coefficient, r, developed by Karl Pearson in the early 1900s, is numerical and provides a measure of strength and direction of the linear association between the independent variable, x, and the dependent variable, y. Hence, it is also known as the Pearson product-moment correlation coefficient. It can be calculated using the following equation:
5.9K
Ratio Level of Measurement00:54

Ratio Level of Measurement

17.5K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
17.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Axial spondyloarthritis patients with comorbid fibromyalgia feel worse, work less and more often try multiple biological therapies: results from a population-based, cross-sectional study investigating the discriminative capacity of pressure algometry.

Rheumatology international·2026
Same author

Can the current radiation dose, in chest tomosynthesis, be reduced with retained image quality? A study in the context of lung cancer screening programs.

PloS one·2026
Same author

Assessing the influence of kernel selection on chest computed tomography image quality across varying dose levels using TrueFidelity reconstruction.

Radiation protection dosimetry·2026
Same author

Optimisation in X-ray and molecular imaging 2025-editorial.

Radiation protection dosimetry·2026
Same author

From digital chest tomosynthesis to 3D CT.

Radiation protection dosimetry·2026
Same author

Modelling the relative precision of whole-kidney dosimetry in molecular radiotherapy using a power law approach.

Radiation protection dosimetry·2026

Related Experiment Video

Updated: Jun 16, 2025

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly
12:50

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly

Published on: April 14, 2014

40.2K

Some common statistical methods for assessing rater agreement in radiological studies.

Mats Geijer1,2,3, Magnus Båth4,5, Catrin Wessman6

  • 1Department of Radiology, Institute of Clinical Sciences, Sahlgrenska Academy, University of Gothenburg, Gothenburg, Sweden.

Acta Radiologica (Stockholm, Sweden : 1987)
|February 24, 2025
PubMed
Summary

Choosing the right rater agreement method is crucial for radiologic studies. This guide reviews practical techniques like intraclass correlation and kappa statistics for assessing image quality agreement.

Keywords:
Statistical methodsimage quality assessmentobserver agreementobserver variationradiological studies

More Related Videos

Software-Assisted Quantitative Measurement of Osteoarthritic Subchondral Bone Thickness
08:52

Software-Assisted Quantitative Measurement of Osteoarthritic Subchondral Bone Thickness

Published on: March 18, 2022

2.9K
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

7.4K

Related Experiment Videos

Last Updated: Jun 16, 2025

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly
12:50

Lesion Explorer: A Video-guided, Standardized Protocol for Accurate and Reliable MRI-derived Volumetrics in Alzheimer's Disease and Normal Elderly

Published on: April 14, 2014

40.2K
Software-Assisted Quantitative Measurement of Osteoarthritic Subchondral Bone Thickness
08:52

Software-Assisted Quantitative Measurement of Osteoarthritic Subchondral Bone Thickness

Published on: March 18, 2022

2.9K
Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
08:40

Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity

Published on: June 12, 2019

7.4K

Area of Science:

  • Radiology and Medical Imaging
  • Biostatistics
  • Research Methodology

Background:

  • Rater agreement is essential for evaluating image quality in radiology.
  • Multiple statistical methods exist for measuring rater agreement.
  • Selecting the correct method depends on the data's scale and study design.

Purpose of the Study:

  • To provide an overview of rater agreement measurement methods in radiologic studies.
  • To guide researchers in selecting appropriate statistical techniques for their studies.
  • To highlight practical and commonly used methods for assessing agreement.

Main Methods:

  • Review of statistical methods for rater agreement.
  • Focus on intraclass correlation, Svensson method, kappa statistics variants.
  • Discussion of Gwet's agreement coefficient (AC1/AC2) and Krippendorff's alpha.
  • Inclusion of methods not primarily for agreement but sometimes applied.

Main Results:

  • Several statistical methods are available for assessing rater agreement.
  • The choice of method is influenced by the outcome variable's scale and study design.
  • Practical methods include intraclass correlation, kappa variants, AC1/AC2, and Krippendorff's alpha.

Conclusions:

  • Researchers must carefully consider study design and data scale when selecting a rater agreement method.
  • Understanding available methods ensures reliable assessment of image quality and other radiologic outcomes.
  • This overview aids in choosing the most suitable statistical approach for radiologic research.