Related Experiment Video
Updated: May 20, 2026

07:35
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
A quasi-optimal channel selection method for bioelectric signal classification using a partial Kullback-Leibler
Taro Shibanoki1, Keisuke Shima, Toshio Tsuji
1Graduate school of Engineering, Hiroshima University, Hiroshima, Japan. shibanoki@bsys.hiroshima-u.ac.jp
IEEE Transactions on Bio-Medical Engineering
|July 4, 2012
Summary
This study introduces a new method using partial Kullback-Leibler (KL) information to select effective variables for classification. The approach significantly reduces data dimensions while maintaining high classification accuracy.
Area of Science:
- Machine Learning
- Data Science
- Biomedical Engineering
Background:
- Effective variable selection is crucial for accurate classification in high-dimensional datasets.
- Existing methods may not efficiently identify the most informative variables for specific tasks.
Purpose of the Study:
- To propose a novel variable selection method utilizing a new metric, the partial Kullback-Leibler (KL) information measure.
- To evaluate the contribution of each variable (dimension) in the data for improved classification.
Main Methods:
- Estimated probability density functions using a multidimensional probabilistic neural network trained on KL information theory.
- Defined partial KL information measure as a ratio before and after dimension elimination.
- Selected effective dimensions by iteratively eliminating ineffective ones based on the partial KL information.
Main Results:
- Applied the method to channel selection for nine subjects, reducing channels by 54.3 ±19.1%.
- Achieved an average classification rate of 96.6 ±2.8% using only three or four selected channels.
- Demonstrated high classification performance with reduced data dimensionality.
Conclusions:
- The proposed partial KL information measure is effective for variable and channel selection.
- The method enables significant data reduction while ensuring optimal or quasi-optimal classification accuracy.
- This approach is valuable for applications requiring efficient and accurate classification from high-dimensional data.
Related Concept Videos
Classification of Signals
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Frequency-dependent Selection
When the fitness of a trait is influenced by how common it is (i.e., its frequency) relative to different traits within a population, this is referred to as frequency-dependent selection. Frequency-dependent selection may occur between species or within a single species. This type of selection can either be positive—with more common phenotypes having higher fitness—or negative, with rarer phenotypes conferring increased fitness.
