Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

13.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.7K
Data Validation01:03

Data Validation

6.3K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
6.3K
Data Validation01:15

Data Validation

579
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
579
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

474
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
474
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

1.2K
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
1.2K
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

6.9K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Standard Error Estimation for Subpopulation Non-invariance.

Applied psychological measurement·2025
Same author

Invited Commentary: Bayesian Inference with Multiple Tests.

Neuropsychology review·2023
Same author

Investigating the Latent Structure of Executive Function in the Delis-Kaplan Executive Function System Using Cattell-Horn-Carroll Theory.

Assessment·2023
Same author

Integrating the switching, inhibition, and updating model of executive function with the Cattell-Horn-Carroll model.

Journal of experimental psychology. General·2015
Same author

A description of mixed group validation.

Assessment·2013
Same author

Considerations underlying the use of mixed group validation.

Psychological assessment·2012

Related Experiment Video

Updated: Jan 19, 2026

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.2K

Diagnostic Test Score Validation With a Fallible Criterion.

Paul A Jewsbury1

  • 1Educational Testing Service, Princeton, NJ, USA.

Applied Psychological Measurement
|September 26, 2019
PubMed
Summary
This summary is machine-generated.

Criterion-related validation of diagnostic tests is challenging due to unobservable constructs. The new Method of Bounds-Test Validation offers robust interval estimates, outperforming traditional point-estimate methods when assumptions are violated.

Keywords:
diagnostic testsgold standardmixed group validationsensitivityspecificitytest validation

More Related Videos

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
06:16

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease

Published on: August 9, 2024

813
Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.3K

Related Experiment Videos

Last Updated: Jan 19, 2026

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.2K
Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease
06:16

Signal Acquisition, Score Interpretation, and Economics of a Non-Invasive Point-of-Care Test for Coronary Artery Disease

Published on: August 9, 2024

813
Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.3K

Area of Science:

  • Psychometrics
  • Statistical validation
  • Diagnostic test development

Background:

  • Criterion-related validation of diagnostic tests is complex due to the direct unavailability of the construct of interest.
  • Existing methods like Known Group Validation and Mixed Group Validation rely on strong assumptions, often unmet in practice.

Purpose of the Study:

  • To evaluate the Neighborhood model and adapt the Method of Bounds for diagnostic test validation.
  • To introduce the Method of Bounds-Test Validation as a novel approach to address limitations of existing methods.

Main Methods:

  • Adaptation and evaluation of the Neighborhood model for diagnostic test validation.
  • Adaptation of the Method of Bounds and introduction of the Method of Bounds-Test Validation.
  • Simulation studies comparing point-estimate methods (Neighborhood, Known Group, Mixed Group) with interval-estimate methods (Method of Bounds-Test Validation).

Main Results:

  • Point-estimate methods (Neighborhood, Known Group, Mixed Group) make strong assumptions and lack robustness to assumption violations.
  • The Method of Bounds-Test Validation demonstrates robust performance across various simulated datasets where point-estimate methods failed.

Conclusions:

  • Point-estimate methods for diagnostic test validation are recommended only when their strong assumptions are justifiable.
  • Interval-estimate methods, particularly the Method of Bounds-Test Validation, are more generally appropriate for diagnostic test validation due to their robustness.