Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Testing a Claim about Standard Deviation01:19

Testing a Claim about Standard Deviation

A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
Chemical Shift: Internal References and Solvent Effects01:17

Chemical Shift: Internal References and Solvent Effects

In an NMR sample, precise measurement of the absolute absorption frequencies of nuclei is difficult. A standard internal reference compound is added, and the frequency difference between the reference signal and sample signals is measured.
The internal reference compound generally used in NMR spectroscopy is tetramethylsilane (TMS). TMS is preferred because it is chemically inert, soluble in NMR solvents, and easily removable. Also, the highly shielded methyl protons in TMS yield an intense...
Standard Solutions01:14

Standard Solutions

Standard solutions refer to solutions with a precisely known concentration or composition. A primary standard is a highly pure, high molar mass, stable substance that is entirely soluble in water, the most commonly used solvent in analytical chemistry. The primary standard solution can be used to standardize secondary standards, which are substances with known concentrations but are less pure and stable. Standard solutions are essential for achieving accurate and reliable results in analytical...
Testing Water Quality01:14

Testing Water Quality

When the quality of water for concrete preparation is uncertain, its impact on the setting time of cement and compressive strength of mortar is assessed by comparison with de-ionized or distilled water benchmarks. American Society for Testing and Materials (ASTM) C1602 requires the setting times to be within 90 minutes of the control, British Standard (BS) 3146:1980 allows a 30-minute variance in the initial setting, while British Standards European Norm (BS EN) 1008 specifies initial setting...
Clinically Relevant Drug Product Specifications: Methods of Establishment01:29

Clinically Relevant Drug Product Specifications: Methods of Establishment

Product specifications define the acceptable quality of a pharmaceutical product by ensuring identity, purity, potency, and strength. These specifications serve as benchmarks during development, manufacturing, and post-approval quality control. Clinically relevant specifications are particularly important because they directly relate to a drug's safety and efficacy in clinical use.Dissolution studies are critical biopharmaceutic tools that link in vitro behavior to in vivo performance. They...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Plain balloon angioplasty +/- bare metal stenting versus drug-coated balloon angioplasty +/- bare metal stenting versus primary drug-eluting stenting in patients with chronic limb-threatening ischaemia: BASIL-3, an open-label, three-arm, randomised, multi-centre, phase 3 trial.

Health technology assessment (Winchester, England)·2026
Same author

Sample Size Guidance and Justification for Studies of Biological Variability.

The journal of applied laboratory medicine·2026
Same author

Characteristics of Participants Screened and Randomized to the Melanoma Self Surveillance Trial.

JAMA dermatology·2026
Same author

QUADAS-3 Explanation and Elaboration: Guidance for Quality Assessment of Diagnostic Test Accuracy Studies.

Annals of internal medicine·2026
Same author

QUADAS-3: A Revised Tool for the Quality Assessment of Diagnostic Test Accuracy Studies.

Annals of internal medicine·2026
Same author

Diagnostic tests for ovarian cancer in premenopausal women with non-specific symptoms (ROCkeTS): prospective, multicentre, cohort study.

BMJ (Clinical research ed.)·2026
Same journal

Correction to I.M. Matters News: Sleep medicine for seniors.

Annals of internal medicine·2026
Same journal

Adverse Events After Same-Day COVID-19 and Influenza Vaccination Versus Influenza Vaccination Alone : A Target Trial Emulation.

Annals of internal medicine·2026
Same journal

Leveraging Real-World Evidence to Inform Regulatory, Clinical, and Coverage Decisions Related to Glucagon-Like Peptide-1-Based Therapies: Synopsis of a National Institute of Diabetes and Digestive and Kidney Diseases Workshop.

Annals of internal medicine·2026
Same journal

Methodological Approaches to Real-World Evidence Generation for Glucagon-like Peptide-1-Based Therapies: Synopsis of a National Institute of Diabetes and Digestive and Kidney Diseases Workshop.

Annals of internal medicine·2026
Same journal

Weekly and Biweekly Treatment With Bofanglutide Versus Semaglutide in Chinese Patients With Type 2 Diabetes : A Phase 2b Randomized Clinical Trial.

Annals of internal medicine·2026
Same journal

Grappling with GLP-1 prescribing.

Annals of internal medicine·2026
See all related articles

Related Experiment Video

Updated: Jun 1, 2026

Design and Construction of an Urban Runoff Research Facility
13:48

Design and Construction of an Urban Runoff Research Facility

Published on: August 8, 2014

When should a new test become the current reference standard?

Paul Glasziou1, Les Irwig, Jonathan J Deeks

  • 1Centre for Evidence-Based Medicine, Department of Primary Health Care, University of Oxford, Oxford, United Kingdom. paul.glasziou@dphpc.ox.ac.uk

Annals of Internal Medicine
|December 3, 2008
PubMed
Summary
This summary is machine-generated.

Evaluating new diagnostic tests is challenging without a perfect reference. Focusing on clinical consequences using a "fair umpire" test offers a practical solution for assessing test value.

More Related Videos

Standardization of Transfer across Labs between Flow Cytometers for Detection of Lymphocytes in Japanese Encephalitis Vaccinated Children
06:22

Standardization of Transfer across Labs between Flow Cytometers for Detection of Lymphocytes in Japanese Encephalitis Vaccinated Children

Published on: February 10, 2023

Reproducibility and Harmonization in Research Using Biological Standards: The Example of Platelet Agonist Collagen-Related Peptide
04:50

Reproducibility and Harmonization in Research Using Biological Standards: The Example of Platelet Agonist Collagen-Related Peptide

Published on: August 4, 2023

Related Experiment Videos

Last Updated: Jun 1, 2026

Design and Construction of an Urban Runoff Research Facility
13:48

Design and Construction of an Urban Runoff Research Facility

Published on: August 8, 2014

Standardization of Transfer across Labs between Flow Cytometers for Detection of Lymphocytes in Japanese Encephalitis Vaccinated Children
06:22

Standardization of Transfer across Labs between Flow Cytometers for Detection of Lymphocytes in Japanese Encephalitis Vaccinated Children

Published on: February 10, 2023

Reproducibility and Harmonization in Research Using Biological Standards: The Example of Platelet Agonist Collagen-Related Peptide
04:50

Reproducibility and Harmonization in Research Using Biological Standards: The Example of Platelet Agonist Collagen-Related Peptide

Published on: August 4, 2023

Area of Science:

  • Medical Diagnostics
  • Clinical Decision Making
  • Health Technology Assessment

Background:

  • Evaluating new diagnostic tests against gold standards is difficult due to the absence of a perfect reference standard.
  • Traditional accuracy estimation methods are limited when a definitive truth is unavailable.

Purpose of the Study:

  • To propose a framework for evaluating new diagnostic tests by focusing on clinical consequences rather than solely on accuracy.
  • To introduce the concept of a "fair umpire" test for resolving disagreements between diagnostic tests.

Main Methods:

  • Examining clinical consequences in cases where the new test and the current gold standard disagree.
  • Utilizing a "fair umpire" test, which can distinguish disease from nondisease without bias, to resolve discrepancies.
  • Incorporating diverse factors into umpire tests, including prognosis, treatment response, causal exposures, and other test results.

Main Results:

  • Clinical consequences provide a viable alternative to accuracy estimation for evaluating new diagnostic tests.
  • A fair umpire test, though not necessarily perfect, can effectively discriminate between disease states and guide decision-making.
  • Disagreements between tests are critical junctures for assessing the real-world impact of diagnostic innovations.

Conclusions:

  • Focusing on clinical consequences and employing a fair umpire test can overcome limitations in evaluating new diagnostic tests.
  • This approach allows for a more pragmatic assessment of a test's value by considering its impact on patient outcomes.
  • The framework emphasizes a holistic evaluation, integrating various clinical factors beyond simple diagnostic accuracy.