Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Naturalistic Observations02:30

Naturalistic Observations

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Blind Procedures02:07

Blind Procedures

Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
Observational Studies01:11

Observational Studies

Observational studies are a type of analytical study where researchers observe events without any interventions. In other words, the researcher does not influence the response variable or the experiment's outcome.
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One example of...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Mammo-GAN-Assisted Deep Network Training Scheme for Lesion Detection.

Journal of imaging informatics in medicine·2025
Same author

A combined genomic arrhythmia propensity score delineates cumulative risk.

Cell reports. Medicine·2025
Same author

Breast Cancer Screening Interval: Effect on Rate of Late-Stage Disease at Diagnosis and Overall Survival.

Journal of clinical oncology : official journal of the American Society of Clinical Oncology·2024
Same author

Organizational Breast Cancer Data Mart: A Solution for Assessing Outcomes of Imaging and Treatment.

JCO clinical cancer informatics·2024
Same author

Using the Medical Audit to Improve Practice Performance.

Journal of breast imaging·2024
Same author

Selection, optimization and validation of ten chronic disease polygenic risk scores for clinical implementation in diverse US populations.

Nature medicine·2024
Same journal

Evaluating the Impact of Embolization on Outcomes in Iliopsoas Hematomas: A Multicenter Retrospective Propensity-matched Study.

Academic radiology·2026
Same journal

Comparison of Iterative Metal Artifact Reduction Presets In Ultra-high-resolution Photon-counting CT Angiography of Patients with Total Knee Endoprosthesis.

Academic radiology·2026
Same journal

Deep Learning for Opportunistic Vertebral Fracture Detection on Routine Thoraco-abdominal Computed Tomography: A Systematic Review and Hierarchical Summary Receiver Operating Characteristic Meta-analysis of Patient-level Diagnostic Test Accuracy.

Academic radiology·2026
Same journal

"Where are They Now?": A Single Institution's 10-Years Experience with an Integrated Nuclear Radiology Fellowship.

Academic radiology·2026
Same journal

Dual-layer Spectral Detector CT Quantitative Parameters for Predicting Tumor Budding Grade and Prognosis in Stage Ⅱ Colorectal Cancer.

Academic radiology·2026
Same journal

Promotion from Associate Professor to Full Professor Should Not Be Monolithic: A National Bibliometric Study by Radiology Subspecialty.

Academic radiology·2026
See all related articles

Related Experiment Video

Updated: May 11, 2026

A Protocol of Manual Tests to Measure Sensation and Pain in Humans
07:28

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

Published on: December 19, 2016

Estimating sensitivity and specificity for technology assessment based on observer studies.

Robert M Nishikawa1, Lorenzo L Pesce

  • 1Department of Radiology, The University of Chicago, 5841 South Maryland Avenue, MC-2026, Chicago, IL 60637, USA. r-nishikawa@uchicago.edu

Academic Radiology
|May 11, 2013
PubMed
Summary
This summary is machine-generated.

Estimating sensitivity and specificity using receiver operating characteristic rating scales can be inaccurate for individual readers due to variability. Pooling data improves agreement, but direct biopsy recommendations offer a more accurate measure of performance.

Related Experiment Videos

Last Updated: May 11, 2026

A Protocol of Manual Tests to Measure Sensation and Pain in Humans
07:28

A Protocol of Manual Tests to Measure Sensation and Pain in Humans

Published on: December 19, 2016

Area of Science:

  • Radiology and Medical Imaging
  • Diagnostic Accuracy Studies
  • Statistical Methods in Medicine

Background:

  • Accurate estimation of diagnostic test performance, specifically sensitivity and specificity, is crucial in medical research.
  • Receiver operating characteristic (ROC) rating scales are commonly used, but their precision in estimating these metrics can be variable.
  • Understanding interreader and intrareader variability is key to interpreting diagnostic performance data.

Purpose of the Study:

  • To evaluate the accuracy and precision of using ROC rating scale scores for estimating sensitivity and specificity.
  • To compare ROC rating scale-derived estimates with direct biopsy recommendations as a measure of truth.

Main Methods:

  • Utilized data from a prior study on radiologist performance in classifying mammographic microcalcification clusters.
  • Estimated sensitivity and specificity by thresholding ROC rating data and by using direct radiologist biopsy recommendations.
  • Analyzed data with and without a computer-aided diagnosis scheme.

Main Results:

  • Individual reader estimates of sensitivity and specificity using ROC rating data showed significant error (up to 100%) compared to biopsy data due to reader variability.
  • Pooled ROC rating data estimates demonstrated good agreement with estimates derived from biopsy recommendation data.
  • Statistical power was reduced when using ROC rating data compared to biopsy recommendation data.

Conclusions:

  • Directly soliciting explicit observer recommendations (e.g., biopsy or no biopsy) provides a more accurate measure of sensitivity and specificity.
  • This direct method better captures empirical variability and maximizes statistical power in diagnostic accuracy studies.
  • Simplifying the assessment of diagnostic performance can lead to more reliable and powerful study outcomes.