The Problems with the Kappa Statistic as a Metric of Interobserver Agreement on Lesion Detection Using a Third-reader

Joanna H Shih1, Matthew D Greer2, Baris Turkbey2

  • 1Biometric Research Program, NCI, NIH, 9609 Medical Center Drive, Room 5W124, MSC 9735, Bethesda, MD 20892.

Academic Radiology
|March 20, 2018
PubMed
Abstract

Related Concept Videos

Statistical Significance01:50

Statistical Significance

Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
22.2K
Probability in Statistics01:14

Probability in Statistics

Probability is the likelihood of an event occurring. The term event is defined as a collection of results of a procedure. An event is a simple event when an outcome cannot be divided into simpler parts.
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
23.5K
Introduction to Statistics01:17

Introduction to Statistics

The science of statistics involves collecting, analyzing, interpreting, and presenting data. The method of collecting, organizing, and summarizing data is called descriptive statistics. The systematic method of drawing inferences from the sample data and predicting unknown characteristics of a population is called inferential statistics.
In statistics, the collection of individuals or objects under study is called population. The idea of sampling is to select a portion of the larger population...
64.7K
Location and Orientation of the Heart01:13

Location and Orientation of the Heart

The human heart, despite its modest size and weight, is an organ of remarkable strength and endurance. Roughly the size of a fist, the heart weighs between 250 and 350 grams and is nestled within the mediastinum, the medial cavity of the thorax. It extends obliquely for about 12 to 14 cm, resting on the superior surface of the diaphragm. The heart is positioned anterior to the vertebral column and posterior to the sternum, with two-thirds of its mass lying to the left of the midsternal line.
10.8K
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
16.6K
Identifying Statistically Significant Differences: The F-Test01:14

Identifying Statistically Significant Differences: The F-Test

The F-test is used to compare two sample variances to each other or compare the sample variance to the population variance. It is used to decide whether an indeterminate error can explain the difference in their values. The underlying assumptions that allow the use of the F-test include the data set or sets are normally distributed, and the data sets are independent of each other. The test statistic F is calculated by dividing one variance by another. In other words, the square of one standard...
3.9K