Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Assumptions of Survival Analysis01:15

Assumptions of Survival Analysis

Survival models analyze the time until one or more events occur, such as death in biological organisms or failure in mechanical systems. These models are widely used across fields like medicine, biology, engineering, and public health to study time-to-event phenomena. To ensure accurate results, survival analysis relies on key assumptions and careful study design.
Observational Studies01:11

Observational Studies

Observational studies are a type of analytical study where researchers observe events without any interventions. In other words, the researcher does not influence the response variable or the experiment's outcome.
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...
Naturalistic Observations02:30

Naturalistic Observations

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Censoring Survival Data01:09

Censoring Survival Data

Survival analysis is a statistical method used to analyze time-to-event data, often employed in fields such as medicine, engineering, and social sciences. One of the key challenges in survival analysis is dealing with incomplete data, a phenomenon known as "censoring." Censoring occurs when the event of interest (such as death, relapse, or system failure) has not occurred for some individuals by the end of the study period or is otherwise unobservable, and it might have many different reasons...
Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This number is...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Methodological considerations for evaluating deep learning segmentation models in digital pathology whole-slide images.

Journal of medical imaging (Bellingham, Wash.)·2026
Same author

Finding the optimal recall rate in breast cancer screening: results from the ROCS study.

European radiology·2026
Same author

Correlation of Automated in Vivo Image Quality With Radiologist's Performance in Abdomen Computed Tomography Across Conventional and Deep Learning Reconstructions.

Journal of computer assisted tomography·2026
Same author

Use of Expected Utility to Evaluate Artificial Intelligence-Enabled Rule-out Devices for Mammography Screening.

Medical decision making : an international journal of the Society for Medical Decision Making·2025
Same author

Consistent performance between medical experts and non-expert readers in forced-choice lesion-detection tasks with PET images.

Medical physics·2025
Same author

Convolutional neural network model observers discount signal-like anatomical structures during search in virtual digital breast tomosynthesis phantoms.

Journal of medical imaging (Bellingham, Wash.)·2025
Same journal

Deep Learning for Opportunistic Vertebral Fracture Detection on Routine Thoraco-abdominal Computed Tomography: A Systematic Review and Hierarchical Summary Receiver Operating Characteristic Meta-analysis of Patient-level Diagnostic Test Accuracy.

Academic radiology·2026
Same journal

"Where are They Now?": A Single Institution's 10-Years Experience with an Integrated Nuclear Radiology Fellowship.

Academic radiology·2026
Same journal

Dual-layer Spectral Detector CT Quantitative Parameters for Predicting Tumor Budding Grade and Prognosis in Stage Ⅱ Colorectal Cancer.

Academic radiology·2026
Same journal

Promotion from Associate Professor to Full Professor Should Not Be Monolithic: A National Bibliometric Study by Radiology Subspecialty.

Academic radiology·2026
Same journal

Technological Lag of Digitization for Patient Image Transfer.

Academic radiology·2026
Same journal

Prognostic Value of Coronary Sinus Flow and Aortic Pressure Gradient Quantified by 4D Flow CMR in AMI.

Academic radiology·2026
See all related articles

Related Experiment Video

Updated: May 12, 2026

Making Record-efficiency SnS Solar Cells by Thermal Evaporation and Atomic Layer Deposition
14:01

Making Record-efficiency SnS Solar Cells by Thermal Evaporation and Atomic Layer Deposition

Published on: May 22, 2015

Statistical power considerations for a utility endpoint in observer performance studies.

Craig K Abbey1, Frank W Samuelson, Brandon D Gallas

  • 1Department of Psychological and Brain Sciences, University of California, Santa Barbara, CA, USA. abbey@psych.ucsb.edu

Academic Radiology
|April 25, 2013
PubMed
Summary
This summary is machine-generated.

The expected utility (EU) endpoint demonstrates superior statistical power compared to the area under the ROC curve (AUC) in observer performance studies. EU achieved higher power in 95% of simulations, offering a more efficient measure for diagnostic tasks.

More Related Videos

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
08:33

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

Measuring Light-Switching Behavior Using an Occupancy and Light Data Logger
05:50

Measuring Light-Switching Behavior Using an Occupancy and Light Data Logger

Published on: January 16, 2020

Related Experiment Videos

Last Updated: May 12, 2026

Making Record-efficiency SnS Solar Cells by Thermal Evaporation and Atomic Layer Deposition
14:01

Making Record-efficiency SnS Solar Cells by Thermal Evaporation and Atomic Layer Deposition

Published on: May 22, 2015

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
08:33

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

Measuring Light-Switching Behavior Using an Occupancy and Light Data Logger
05:50

Measuring Light-Switching Behavior Using an Occupancy and Light Data Logger

Published on: January 16, 2020

Area of Science:

  • Medical Imaging Analysis
  • Diagnostic Performance Evaluation
  • Statistical Modeling in Healthcare

Background:

  • Observer performance studies are crucial for evaluating diagnostic technologies.
  • Area under the ROC curve (AUC) is a common but potentially suboptimal performance measure.
  • Statistical power analysis is essential for designing robust observer studies.

Purpose of the Study:

  • To compare the statistical power of expected utility (EU) against AUC for observer performance.
  • To evaluate the impact of observer and experimental design parameters on power.
  • To provide evidence for adopting EU in diagnostic task evaluations.

Main Methods:

  • Modified Roe and Metz simulation procedure for ROC studies.
  • Investigated effects of observer properties (iso-utility slope, variance, action bias).
  • Assessed impact of experimental design (readers, cases, positive fraction).

Main Results:

  • EU generally exhibited higher statistical power than AUC across simulations (95% of conditions).
  • EU power was ≥5% higher than AUC in 246 simulated conditions.
  • EU achieved equivalent power to AUC with fewer readers (9-28%) or cases (18-41%).

Conclusions:

  • Simulation results support considering EU for screening mammography technology studies.
  • Findings motivate further investigation of utility measures in diverse diagnostic tasks.
  • EU offers a potentially more powerful and efficient endpoint for observer performance studies.