Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Confidence Coefficient

Confidence Coefficient

The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under...

Prediction Intervals

Prediction Intervals

The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.

Accuracy and Precision

Accuracy and Precision

Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value. Highly accurate...

Weighted Mean

Weighted Mean

While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...

Sensitivity, Specificity, and Predicted Value

Sensitivity, Specificity, and Predicted Value

In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...

Uncertainty in Measurement: Accuracy and Precision

Uncertainty in Measurement: Accuracy and Precision

Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

The great multivariate time series classification bake off: a review and experimental evaluation of recent algorithmic advances.

Data mining and knowledge discovery·2021

Same author

The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances.

Data mining and knowledge discovery·2019

Same journal

Topology only pre-training: towards generalised multi-domain graph models.

Data mining and knowledge discovery·2026

Same journal

Detection and evaluation of clusters within sequential data.

Data mining and knowledge discovery·2025

Same journal

Universal representation learning for multivariate time series using the instance-level and cluster-level supervised contrastive learning.

Data mining and knowledge discovery·2025

Same journal

Missing value replacement in strings and applications.

Data mining and knowledge discovery·2025

Same journal

Robust explainer recommendation for time series classification.

Data mining and knowledge discovery·2024

Same journal

Somtimes: self organizing maps for time series clustering and its application to serious illness conversations.

Data mining and knowledge discovery·2024

See all related articles

Search research articles

Related Experiment Video

Updated: Jan 5, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

A probabilistic classifier ensemble weighting scheme based on cross-validated accuracy estimates.

James Large¹, Jason Lines¹, Anthony Bagnall¹

¹School of Computing Sciences, University of East Anglia, Norwich, UK.

Data Mining and Knowledge Discovery

|October 22, 2019

Summary

This summary is machine-generated.

Building ensembles of diverse, strong classifiers using cross-validation accuracy weighting (CAWPE) offers superior classification performance for real-world problems. This approach rivals larger ensembles and improves state-of-the-art methods, especially with limited training data.

Keywords:

Classification Ensemble Heterogeneous Weighted

More Related Videos

An R-Based Landscape Validation of a Competing Risk Model

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Related Experiment Videos

Last Updated: Jan 5, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

An R-Based Landscape Validation of a Competing Risk Model

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

Cross-Modal Multivariate Pattern Analysis

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

Area of Science:

Machine Learning
Data Science
Artificial Intelligence

Background:

Effective classification is crucial for real-world data analysis.
Heterogeneous ensembles often outperform homogeneous ones but require careful construction.
Existing methods for combining classifiers have limitations in performance and complexity.

Purpose of the Study:

To propose and evaluate a novel method for building small, heterogeneous ensembles of strong classifiers.
To demonstrate the superiority of this method over existing weighting, selection, and meta-classifier approaches.
To assess the generalizability and impact of the proposed ensemble technique on diverse datasets, including time series classification.

Main Methods:

Developed a heterogeneous ensemble method using exponential weighting of base classifier probability estimates.
Accuracy estimates for weighting were derived using cross-validation on training data.
Extensive experimentation was conducted on UCI archive datasets and the UCR time series classification archive.

Main Results:

The proposed cross-validation accuracy weighted probabilistic ensemble (CAWPE) demonstrated measurable benefits over alternative ensemble methods.
A small ensemble of five classifiers achieved performance comparable to large homogeneous ensembles and tuned individual classifiers.
CAWPE significantly improved state-of-the-art performance on time series classification, particularly for datasets with smaller training set sizes.

Conclusions:

Ensembling strong classifiers with a robust weighting scheme like CAWPE is generally more effective than extensive individual classifier tuning.
CAWPE provides a sensible and effective starting point for combining diverse classifiers, offering improved generalization and performance.
The method's robustness and the significant contribution of its design elements were confirmed through sensitivity analysis and ablation studies.