Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
Multiple Comparison Tests01:13

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Classification of Illness01:17

Classification of Illness

The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe and...
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Bclaf1 drives heart failure by recruiting Srsf2 to enhance Hand2 pre-mRNA splicing and pathological hypertrophy.

Nature communications·2026
Same author

Efficient semi-supervised estimation of optimal individualized treatment regimes with survival outcome.

Statistical methods in medical research·2026
Same author

MXene/RGO/Si Schottky Junction for a High-Performance Self-Powered Broadband Photodetector.

Langmuir : the ACS journal of surfaces and colloids·2026
Same author

Hippocampal GFAP in aging: Associations with AD and LATE-NC pathologies and cognitive decline in older adults.

Alzheimer's & dementia : the journal of the Alzheimer's Association·2026
Same author

Preoperative dermatomal somatosensory evoked potentials in risk prediction of early postoperative neurological deterioration after thoracic spine surgery: a retrospective cohort study.

Journal of orthopaedic surgery and research·2026
Same author

Synergistic Design of ZnCo-MnO@NPC Cathode and ZIF-8@Zn Anode for High-Performance Aqueous Zinc-Ion Batteries.

Molecules (Basel, Switzerland)·2026

Related Experiment Video

Updated: May 16, 2026

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

Multicategory reclassification statistics for assessing improvements in diagnostic accuracy.

Jialiang Li1, Binyan Jiang, Jason P Fine

  • 1Department of Statistics and Applied Probability, National University of Singapore, Singapore117546,Singapore. stalj@nus.edu.sg

Biostatistics (Oxford, England)
|December 1, 2012
PubMed
Summary

This study extends accuracy improvement measures, net reclassification improvement (NRI) and integrated discrimination improvement (IDI), to multicategory classification. These enhanced methods offer improved accuracy assessment for complex diagnostic scenarios.

More Related Videos

Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

Related Experiment Videos

Last Updated: May 16, 2026

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

Area of Science:

  • Biostatistics
  • Medical Informatics
  • Statistical Modeling

Background:

  • Existing measures like net reclassification improvement (NRI) and integrated discrimination improvement (IDI) are primarily for binary diagnostic tests.
  • These measures, proposed by Pencina et al. (2008), offer advantages over traditional ROC curve analyses.
  • There is a need to extend these accuracy assessment tools for multiclass classification problems.

Purpose of the Study:

  • To extend the definitions and applications of net reclassification improvement (NRI) and integrated discrimination improvement (IDI) to multicategory classification settings.
  • To provide robust estimation and inference procedures for these extended multiclass measures.
  • To evaluate the performance of the proposed estimators using simulations and real-world medical data.

Main Methods:

  • Development of novel statistical methodologies for multiclass net reclassification improvement (NRI) and integrated discrimination improvement (IDI).
  • Derivation of asymptotic distributional results for the proposed estimators.
  • Conducting simulation studies to assess the finite-sample properties and reliability of the new methods.
  • Application of the extended NRI and IDI measures to analyze two illustrative medical datasets.

Main Results:

  • The paper successfully extends the NRI and IDI metrics to accommodate multicategory classification outcomes.
  • Estimation and inference procedures for the multiclass NRI and IDI are established, supported by asymptotic theory.
  • Simulation results demonstrate the favorable finite-sample performance of the proposed estimators.
  • The methodology is validated through practical application in medical diagnostic scenarios.

Conclusions:

  • The extended multiclass NRI and IDI provide valuable quantitative assessments of predictive accuracy improvement in complex classification tasks.
  • These enhanced measures offer a more comprehensive approach to evaluating diagnostic test performance beyond binary outcomes.
  • The proposed statistical framework facilitates the reliable application of these metrics in biostatistical research and clinical practice.