Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

734
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
734
Classification of Systems-II01:31

Classification of Systems-II

658
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
658
Classification of Systems-I01:26

Classification of Systems-I

750
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
750
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test01:09

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

6.2K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
6.2K
Multiple Comparison Tests01:13

Multiple Comparison Tests

3.5K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.5K
Aggregates Classification01:29

Aggregates Classification

1.0K
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
1.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Expression of a recombinant DIVA antigen for differential diagnosis of H7N9 subtype avian influenza virus infected and vaccinated chickens.

Protein expression and purification·2026
Same author

Effects of mind-body training on upper-limb function in stroke patients: a multilevel dose-response meta-analysis.

Frontiers in medicine·2026
Same author

Regulation of EIF5A and hypusination by p53 determines colorectal cancer cell fitness.

Cancer letters·2026
Same author

One case of facial salivary gland secretory carcinoma and a literature review.

International journal of surgery case reports·2026
Same author

Terminal-Edge-Cloud Collaborative Computation Offloading and Resource Allocation Strategy Based on Improved Mayfly Algorithm for District Heating Systems.

Sensors (Basel, Switzerland)·2026
Same author

Fe-Enhanced Proton Capture on Boron Nitride Surfaces for Improved Photocatalytic Methane Conversion to C1 Chemicals.

Small science·2026
Same journal

A Model-Free Reinforcement Learning Implementation of Decision Making Under Uncertainty by Sequential Sampling.

Neural computation·2026
Same journal

DROP: Distributional and Regular Optimism and Pessimism for Reinforcement Learning.

Neural computation·2026
Same journal

Hierarchical Active Inference Using Successor Representations.

Neural computation·2026
Same journal

W-Kernel and Its Principal Space for Frequentist Evaluation of Bayesian Estimators.

Neural computation·2026
Same journal

A Hidden Markov Model-Inspired Sequence Classification Method for Hyperdimensional Computing.

Neural computation·2026
Same journal

Sparse Graphical Modeling for Electrophysiological Phase-Based Connectivity Using Circular Statistics.

Neural computation·2026
See all related articles

Related Experiment Video

Updated: May 7, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

21.0K

Blocked 3×2 cross-validated t-test for comparing supervised classification learning algorithms.

Wang Yu1, Wang Ruibo, Jia Huichen

  • 1Computer Center of Shanxi University, Taiyuan 030006, P.R.C. wangyu@sxu.edu.cn.

Neural Computation
|October 10, 2013
PubMed
Summary
This summary is machine-generated.

A new blocked 3×2 cross-validation method improves generalization error estimation for machine learning classification. This approach offers comparable performance to existing methods with reduced computational complexity.

More Related Videos

Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model
07:13

Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model

Published on: April 18, 2025

898
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.0K

Related Experiment Videos

Last Updated: May 7, 2026

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

21.0K
Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model
07:13

Comparison of Predictive Performance of Three Lymph Node Staging Systems in Colorectal Signet Ring Cell Carcinoma Based on Machine Learning Model

Published on: April 18, 2025

898
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.0K

Area of Science:

  • Machine Learning
  • Statistical Modeling
  • Computer Science

Background:

  • Comparing machine learning algorithm performance is crucial for classification tasks.
  • Statistical significance tests for generalization error are commonly used.
  • Cross-validation methods are susceptible to randomness in data partitioning.

Purpose of the Study:

  • To propose a novel blocked 3×2 cross-validation technique for estimating generalization error.
  • To introduce a conservative variance estimator accounting for correlations in cross-validation.
  • To present a new statistical test for comparing algorithm performance using the proposed method.

Main Methods:

  • Development of a blocked 3×2 cross-validation estimator.
  • Analysis of variance for the blocked 3×2 cross-validated estimator.
  • Introduction of a conservative variance estimator for two-fold cross-validations.
  • Formulation of a statistical test based on the new variance estimator.

Main Results:

  • The proposed blocked 3×2 cross-validation method effectively estimates generalization error.
  • The new variance estimator addresses previously neglected correlations.
  • Simulated results demonstrate the test's performance is comparable to 5×2 cross-validated tests.
  • The proposed test exhibits lower computational complexity than existing methods.

Conclusions:

  • The blocked 3×2 cross-validation offers an efficient and reliable method for comparing machine learning algorithms.
  • The developed statistical test provides a statistically sound and computationally advantageous alternative for performance evaluation.
  • This research contributes to more robust and efficient model selection in machine learning classification.