Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Videos

Effective neural network ensemble approach for improving generalization performance.

Jing Yang, Xiaoqin Zeng, Shuiming Zhong

IEEE Transactions on Neural Networks and Learning Systems

|May 9, 2014

Summary

This summary is machine-generated.

Related Concept Videos

Generalization, Discrimination, and Extinction

Generalization, Discrimination, and Extinction

Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...

Survival Tree

Survival Tree

Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

[Effects of a glucocorticoid on development of kidney deficiency syndrome in a rat model of asthma].

Zhong xi yi jie he xue bao = Journal of Chinese integrative medicine·2010

Same author

[A case of respiratory epithelial adenomatoid hamartoma in nasal cavity.].

Zhonghua er bi yan hou tou jing wai ke za zhi = Chinese journal of otorhinolaryngology head and neck surgery·2010

Same author

[Construct cosmid libraries by isolating large genomic DNA fragments from Monascus ruber].

Wei sheng wu xue bao = Acta microbiologica Sinica·2010

Same author

Retinal tissue engineering using mouse retinal progenitor cells and a novel biodegradable, thin-film poly(e-caprolactone) nanowire scaffold.

Journal of ocular biology, diseases, and informatics·2010

Same author

[Correlation between MR diffusion weighted imaging with malignant degree of rabbit liver VX2 tumor models].

Zhonghua yi xue za zhi·2010

Same author

[Immune response in BALB/c mice immunized with BCG expressing HBV truncated C gene and preS1 gene].

Xi bao yu fen zi mian yi xue za zhi = Chinese journal of cellular and molecular immunology·2010

Same journal

Hidden Data Recovery and Forecasting via Next-Generation Reservoir Computing With Multiscale Delay Selection.

IEEE transactions on neural networks and learning systems·2026

Same journal

CAFF-CIL: Causality-Aware Freedom Forgetting Approach for Class-Incremental Learning.

IEEE transactions on neural networks and learning systems·2026

Same journal

Harmonic Autoencoding Framework for Multiple Tasks in Magnetic Particle Imaging Reconstruction.

IEEE transactions on neural networks and learning systems·2026

Same journal

A Survey on Human-Centric Voice-Face Multimodal Learning.

IEEE transactions on neural networks and learning systems·2026

Same journal

Vision-Assisted Foundation Model for Solving Multitask Vehicle Routing Problems.

IEEE transactions on neural networks and learning systems·2026

Same journal

FP3O: Enabling Proximal Policy Optimization in Multiagent Cooperation With Parameter-Sharing Versatility.

IEEE transactions on neural networks and learning systems·2026

See all related articles

This study introduces a novel neural network ensemble method to enhance generalization performance. The approach selects diverse neural networks and assigns complementary weights, outperforming individual networks and simple averaging.

Area of Science:

Artificial Intelligence
Machine Learning
Deep Learning

Background:

Improving the generalization performance of neural networks is crucial for real-world applications.
Ensemble methods are widely used to enhance model robustness and accuracy.
Existing ensemble techniques may not fully leverage the diversity of well-trained neural networks.

Purpose of the Study:

To propose an effective neural network ensemble approach to improve generalization performance.
To introduce novel methods for selecting diverse neural network individuals and assigning complementary combination weights.

Main Methods:

Utilizing neural network output sensitivity to measure output diversity near training samples.
Selecting diverse neural network individuals from a pool of well-trained networks.

Related Experiment Videos

Employing a learning mechanism to assign complementary weights for ensemble combination.

Main Results:

The proposed ensemble approach achieved better generalization performance compared to individual networks.
The ensemble significantly outperformed models combining all individuals.
The approach demonstrated superior performance over ensembles using simply averaged weights.

Conclusions:

The novel ensemble method effectively improves neural network generalization.
Measuring output sensitivity is a viable strategy for selecting diverse neural network components.
Complementary weight assignment enhances ensemble performance beyond simple averaging.