Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Response Surface Methodology

Response Surface Methodology

Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:

Receiver Operating Characteristic Plot

Receiver Operating Characteristic Plot

A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...

Regression Toward the Mean

Regression Toward the Mean

Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when researchers try to extrapolate results...

Multiple Comparison Tests

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...

Mechanistic Models: Compartment Models in Individual and Population Analysis

Mechanistic Models: Compartment Models in Individual and Population Analysis

Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least squares (OLS)...

McNemar's Test

McNemar's Test

McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Low-temperature sintering of silver nanoparticles on paper by surface modification.

Nanotechnology·2019

Same author

Two-Staged Versus Three-Staged Laparoscopic Anorectoplasty for Patients with Rectoprostatic and Bladder Neck Fistulas: A Comparative Study.

Journal of laparoendoscopic & advanced surgical techniques. Part A·2019

Same author

Genome Sequence of a Novel HIV-1 Circulating Recombinant Form (CRF103_01B) Identified from Hebei Province, China.

AIDS research and human retroviruses·2019

Same author

Identification of a Novel HIV-1 Second-Generation (CRF01_AE/B) Among Men Who Have Sex with Men in Tianjin, China.

AIDS research and human retroviruses·2019

Same author

Characterization of a Novel HIV-1 Recombinant Form (CRF01_AE/CRF07_BC/CRF08_BC) Identified from Guangxi, China.

AIDS research and human retroviruses·2019

Same author

Event-Triggered Multiagent Optimization for Two-Layered Model of Hybrid Energy System With Price Bidding-Based Demand Response.

IEEE transactions on cybernetics·2019

Search research articles

Related Experiment Video

Updated: May 17, 2026

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

Statistical methods for MRMC ROC studies.

Annie Skaron¹, Kang Li, Xiao-Hua Zhou

¹HSR&D Center of Excellence, VA Puget Sound Health Care System, Seattle, WA 98101, USA.

Academic Radiology

|November 6, 2012

Summary

Four methods for analyzing multireader, multicase (MRMC) receiver-operating characteristic studies perform well with continuous data. The Dorfman-Berbaum-Metz method is recommended for its practicality in various scenarios for diagnostic imaging evaluation.

More Related Videos

Functional Magnetic Resonance Spectroscopy at 7 T in the Rat Barrel Cortex During Whisker Activation

Functional Magnetic Resonance Spectroscopy at 7 T in the Rat Barrel Cortex During Whisker Activation

Published on: February 8, 2019

An R-Based Landscape Validation of a Competing Risk Model

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

Related Experiment Videos

Last Updated: May 17, 2026

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

Functional Magnetic Resonance Spectroscopy at 7 T in the Rat Barrel Cortex During Whisker Activation

Functional Magnetic Resonance Spectroscopy at 7 T in the Rat Barrel Cortex During Whisker Activation

Published on: February 8, 2019

An R-Based Landscape Validation of a Competing Risk Model

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

Area of Science:

Radiology
Medical Imaging Analysis
Statistical Methods in Medicine

Background:

Multireader, multicase (MRMC) receiver-operating characteristic studies are crucial for evaluating diagnostic imaging accuracy.
Analyzing MRMC data presents challenges due to complex correlation structures.
Four common statistical methods exist to address these correlations.

Purpose of the Study:

To conduct an extensive simulation study assessing the performance of four common MRMC data analysis methods.
To evaluate these methods' effectiveness in finite sample sizes.
To provide recommendations for the practical application of these methods.

Main Methods:

A comprehensive simulation study was performed using continuous data.
The performance of four distinct MRMC analysis methods was assessed.
The study illustrated the application of these methods in predicting extracapsular extension of prostate tumors using MRI.

Main Results:

All four evaluated methods demonstrated strong performance in estimating the difference in areas under the curves for two diagnostic tests.
The methods performed well when test outcomes were continuous or pseudocontinuous.
The simulation indicated that these approaches are suitable for analyzing MRMC datasets.

Conclusions:

The Dorfman-Berbaum-Metz method is identified as the most practical for implementation across diverse MRMC study scenarios.
Radiologists are encouraged to utilize the full rating scale in MRMC studies, moving beyond binary decisions.
This research offers guidance on selecting appropriate statistical methods for MRMC studies in diagnostic imaging.