Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Bootstrapping01:24

Bootstrapping

904
The term "bootstrap" originated in the 19th century as a metaphor for self-improvement or achieving something independently, without external assistance. This concept extends to statistical bootstrapping, a self-contained method for estimating population parameters through resampling, even though it can be computationally intensive. Developed by the American statistician Dr. Bradley Efron in 1979, bootstrapping provides a robust way to perform inference when the original sample size is...
904
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

569
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
569
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

568
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
568
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test01:09

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

7.0K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
7.0K
Introduction to Nonparametric Statistics01:28

Introduction to Nonparametric Statistics

1.6K
Nonparametric statistics offer a powerful alternative to traditional parametric methods, useful when assumptions about the population distribution cannot be made. Unlike parametric tests, which require data to follow a specific distribution with well-defined parameters (such as the mean and standard deviation), nonparametric tests do not require such constraints. This makes them particularly valuable when dealing with small sample sizes, skewed data, or ordinal and categorical variables.
One of...
1.6K
One-Way ANOVA: Unequal Sample Sizes01:15

One-Way ANOVA: Unequal Sample Sizes

6.9K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
6.9K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Input Space Coverage Matters.

Computer·2025
Same author

Combinatorial Test Generation for Multiple Input Models with Shared Parameters.

IEEE transactions on pattern analysis and machine intelligence·2024
Same author

Estimating <i>t</i>-way Fault Profile Evolution During Testing.

Proceedings : Annual International Computer Software and Applications Conference. COMPSAC·2024
Same author

Removing divergence of JCGM documents from the GUM ( 1993) and repairing other defects.

Measurement : journal of the International Measurement Confederation·2022
Same author

Monte Carlo studies of bootstrap variability in ROC analysis with data dependency.

Communications in statistics: Simulation and computation·2020
Same author

The Impact of Data Dependence on Speaker Recognition Evaluation.

IEEE/ACM transactions on audio, speech, and language processing·2017

Related Experiment Video

Updated: Mar 16, 2026

An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.7K

Validation of Nonparametric Two-Sample Bootstrap in ROC Analysis on Large Datasets.

Jin Chu Wu1, Alvin F Martin1, Raghu N Kacker1

  • 1National Institute of Standards and Technology, Gaithersburg, MD 20899.

Communications in Statistics: Simulation and Computation
|August 9, 2016
PubMed
Summary

The nonparametric bootstrap method accurately estimates uncertainties in ROC analysis for large datasets when analytical methods fail. Validation confirms its reliability, matching established statistical techniques for biometrics and speaker recognition.

Keywords:
ROC analysisbiometricsbootstraplarge datasetsspeaker recognitionuncertaintyvalidation

More Related Videos

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

43.8K
Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model
07:13

Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model

Published on: April 18, 2025

844

Related Experiment Videos

Last Updated: Mar 16, 2026

An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.7K
Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns
13:44

Detection of Architectural Distortion in Prior Mammograms via Analysis of Oriented Patterns

Published on: August 30, 2013

43.8K
Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model
07:13

Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model

Published on: April 18, 2025

844

Area of Science:

  • Statistics
  • Machine Learning
  • Biometrics

Background:

  • Receiver Operating Characteristic (ROC) analysis is crucial for evaluating classifier performance.
  • Large datasets in biometrics and speaker recognition often preclude traditional analytical methods for uncertainty quantification.

Purpose of the Study:

  • To validate the nonparametric two-sample bootstrap method for computing uncertainties in ROC analysis.
  • To compare bootstrap results with established analytical methods like the Mann-Whitney statistic.

Main Methods:

  • Nonparametric two-sample bootstrap applied to large datasets for ROC analysis.
  • Calculation of standard error (SE) for the area under the ROC curve (AUC).
  • Comparison using relative errors and hypothesis testing against the Mann-Whitney-statistic method.

Main Results:

  • Bootstrap and analytical methods produced comparable results for AUC uncertainty.
  • Bootstrap results showed a probability distribution due to inherent stochasticity.
  • Relative errors and hypothesis testing confirmed strong agreement between the two methods.

Conclusions:

  • The nonparametric bootstrap is a validated and reliable method for estimating uncertainties in ROC analysis.
  • This provides a sound foundation for using bootstrap in biometrics and speaker recognition with large datasets.