Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

McNemar's Test01:23

McNemar's Test

1.0K
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...
1.0K
Mechanistic Models: Compartment Models in Individual and Population Analysis01:23

Mechanistic Models: Compartment Models in Individual and Population Analysis

337
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
337
Group Design02:01

Group Design

11.0K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
11.0K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

556
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
556
Study Design in Statistics01:15

Study Design in Statistics

10.3K
A study design is a set of techniques that allow a researcher to collect and analyze data from different variables defined for a specific research problem. Statistics is commonly for effective study design and more robust experiments,
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
10.3K
Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

711
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
711

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Methodological considerations for evaluating deep learning segmentation models in digital pathology whole-slide images.

Journal of medical imaging (Bellingham, Wash.)·2026
Same author

Physics-informed data augmentation to simulate low dose CT scans: Application to lung nodule detection.

Medical physics·2026
Same author

Detecting dataset bias in medical AI using a generalized and modality agnostic auditing approach.

NPJ digital medicine·2026
Same author

Evaluating Time Occupancy and Time-Scales in Interference Testing with Pulse-Modulated Noise.

IEEE transactions on electromagnetic compatibility·2026
Same author

Data Representativeness with Hyperdimensional Computing.

Journal of imaging informatics in medicine·2026
Same author

Statistical testing of agreement in overlap-based performance between an AI segmentation device and a multi-expert human panel without requiring a reference standard.

Journal of medical imaging (Bellingham, Wash.)·2025
Same journal

Literature Reviews After AI.

Journal of medical imaging (Bellingham, Wash.)·2026
Same journal

Illustration of transfer learning from breast cancer detection to risk prediction: adaptation to local data and local objectives.

Journal of medical imaging (Bellingham, Wash.)·2026
Same journal

RadGazeGen: radiomics and gaze-guided chest X-ray generation using diffusion models.

Journal of medical imaging (Bellingham, Wash.)·2026
Same journal

DDARes-U<sup>2</sup>Net: a dual-decoder adversarial residual U<sup>2</sup>Net algorithm for segmentation of COVID-19 pneumonia lesions.

Journal of medical imaging (Bellingham, Wash.)·2026
Same journal

High-speed optical tracking and augmented reality platform for image-guided interventions.

Journal of medical imaging (Bellingham, Wash.)·2026
Same journal

Transplant-ready? Evaluating AI lung segmentation models in candidates with severe lung disease.

Journal of medical imaging (Bellingham, Wash.)·2026
See all related articles

Related Experiment Video

Updated: Apr 7, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

8.1K

Multireader multicase reader studies with binary agreement data: simulation, analysis, validation, and sizing.

Weijie Chen1, Adam Wunderlich1, Nicholas Petrick1

  • 1Food and Drug Administration, Center for Devices and Radiological Health , Office of Science and Engineering Laboratories, Division of Imaging, Diagnostics, and Software Reliability, 10903 New Hampshire Avenue, Silver Spring, Maryland 20993, United States.

Journal of Medical Imaging (Bellingham, Wash.)
|July 10, 2015
PubMed
Summary
This summary is machine-generated.

We developed a mathematical model to simulate binary multireader multicase (MRMC) reader study data. This model aids in validating statistical methods and sizing hypothesis tests for diagnostic accuracy studies.

Keywords:
Monte Carlo simulationbinary datamultireader multicasereader studysizing

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.5K

Related Experiment Videos

Last Updated: Apr 7, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

8.1K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.5K

Area of Science:

  • Medical Imaging Analysis
  • Statistical Modeling
  • Diagnostic Accuracy Studies

Background:

  • Multireader multicase (MRMC) studies are crucial for evaluating diagnostic performance.
  • Analyzing binary agreement data in MRMC studies presents unique statistical challenges.
  • Existing methods require robust validation and simulation tools for accurate assessment.

Purpose of the Study:

  • To present a novel mathematical model for simulating binary MRMC data.
  • To enable validation of statistical methods like confidence intervals and hypothesis tests.
  • To facilitate the sizing of noninferiority hypothesis tests in reader studies.

Main Methods:

  • Developed a simulation model for binary MRMC data with controlled correlation structures.
  • Assumed equal expected probability of agreement across two modalities.
  • Adapted the Obuchowski-Rockette-Hillis (ORH) method for binary agreement data analysis.

Main Results:

  • The simulation model successfully generates binary MRMC data with specified correlations.
  • Validated coverage probabilities of confidence intervals and type I error rates for superiority tests.
  • Demonstrated the utility of the model for sizing noninferiority hypothesis tests.

Conclusions:

  • The proposed simulation model is a valuable tool for MRMC reader studies with binary agreement.
  • The model aids in validating statistical analyses and ensuring appropriate study sizing.
  • A publicly available software package supports the application of this model.