Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

454
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
454
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

545
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
545
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

1.2K
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
1.2K
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

14.0K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
14.0K
Testing a Claim about Standard Deviation01:19

Testing a Claim about Standard Deviation

2.9K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.9K
Critical Region, Critical Values and Significance Level01:16

Critical Region, Critical Values and Significance Level

13.2K
The critical region, critical value, and significance level are interdependent concepts crucial in hypothesis testing.
In hypothesis testing, a sample statistic is converted to a test statistic using z, t, or chi-square distribution. A critical region is an area under the curve in  probability distributions demarcated by the critical value. When the test statistic falls in this region, it suggests that the null hypothesis must be rejected. As this region contains all those values of the...
13.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Latent Class Log-Linear Models for Estimating Diagnostic Test Accuracy Without a Gold Standard: A Simulation Study.

Statistics in medicine·2026
Same author

ASSESSING COST EFFECTIVENESS IN ONCOLOGY TREATMENT SEQUENCES: A REVIEW OF PATHWAY MODELLING METHODS FOR HEALTH TECHNOLOGY ASSESSMENT.

International journal of technology assessment in health care·2026
Same author

Treatments for metastatic non-small cell lung cancer: a pathways pilot with systematic review, evidence synthesis and economic model.

Health technology assessment (Winchester, England)·2026
Same author

Treatment recommendations based on network meta-analysis: Rules for risk-averse decision-makers.

Research synthesis methods·2026
Same author

Quantitative bias analysis for unmeasured confounding in unanchored population-adjusted indirect comparisons.

Research synthesis methods·2026
Same author

Synthesis of depression outcomes reported on different scales: A comparison of methods for modelling mean differences.

Research synthesis methods·2026

Related Experiment Video

Updated: Jan 6, 2026

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.2K

Quantifying how diagnostic test accuracy depends on threshold in a meta-analysis.

Hayley E Jones1, Constantine A Gatsonsis2,3, Thomas A Trikalinos3

  • 1Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK.

Statistics in Medicine
|October 2, 2019
PubMed
Summary

This study introduces a new meta-analysis model for diagnostic test accuracy. It quantifies how accuracy depends on the chosen threshold, improving upon standard methods by using all available data for better threshold selection.

Keywords:
Box-Cox transformationROC curveevidence synthesissensitivityspecificitytest cutoff

More Related Videos

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
06:16

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease

Published on: August 9, 2024

779
Methodology for Accurate Detection of Mitochondrial DNA Methylation
12:11

Methodology for Accurate Detection of Mitochondrial DNA Methylation

Published on: May 20, 2018

13.9K

Related Experiment Videos

Last Updated: Jan 6, 2026

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.2K
Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
06:16

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease

Published on: August 9, 2024

779
Methodology for Accurate Detection of Mitochondrial DNA Methylation
12:11

Methodology for Accurate Detection of Mitochondrial DNA Methylation

Published on: May 20, 2018

13.9K

Area of Science:

  • Biostatistics
  • Medical Diagnostics
  • Epidemiology

Background:

  • Diagnostic tests yield continuous measures, requiring a threshold (C) to classify results as positive or negative.
  • Test accuracy metrics like sensitivity and specificity are highly dependent on the selected threshold (C).
  • Optimal threshold selection is critical for clinical practice, but standard meta-analysis methods have limitations.

Purpose of the Study:

  • To develop a novel multinomial meta-analysis model for diagnostic test accuracy.
  • To quantify the relationship between test accuracy (sensitivity, specificity) and the threshold (C).
  • To enable the selection of optimal thresholds by utilizing all available data.

Main Methods:

  • A multinomial meta-analysis model is proposed, accommodating multiple sensitivity/specificity pairs per study.
  • The model assumes transformed test results in diseased and disease-free populations follow a logistic distribution.
  • The Box-Cox transformation allows flexibility in underlying distributions, with parameters estimated from data.

Main Results:

  • The model provides pooled sensitivity and specificity estimates across various thresholds with credible and prediction intervals.
  • It explicitly quantifies accuracy dependence on threshold C.
  • Demonstrated utility in meta-analyses for acute heart failure and preeclampsia diagnostic tests.

Conclusions:

  • The developed model offers a more comprehensive approach to meta-analysis of diagnostic test accuracy.
  • It facilitates optimal threshold selection by explicitly modeling accuracy's dependence on C.
  • The model can be extended to investigate heterogeneity using study-level covariates.