Related Experiment Video
Updated: Jul 7, 2026
07:35
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
Performance and generalization of the classification figure of merit criterion function
1Dept. of Electron. and Comput. Eng., Pretoria Univ.
IEEE Transactions on Neural Networks
|January 1, 1991
Summary
The classification figure of merit (CFM) offers optimal training-set performance for neural networks. While not guaranteeing superior generalization, CFM
Area of Science:
- Machine Learning
- Artificial Intelligence
- Neural Networks
Background:
- The classification figure of merit (CFM) is a criterion function for training neural networks.
- Introduced by Hampshire and Waibel in 1990, CFM has desirable properties for classifier training.
Purpose of the Study:
- To analyze the properties of the classification figure of merit (CFM).
- To evaluate CFM's effectiveness in training neural networks and its impact on generalization.
Main Methods:
- Theoretical analysis of the CFM criterion function.
- Comparison of CFM with standard criterion functions for neural network training.
Main Results:
- CFM demonstrates optimal performance on the training set, linked to its monotonicity.
- No inherent advantage of CFM over standard criteria for generalization is expected.
- CFM's effectiveness in classifying training data suggests potential for improved test-set performance.
Conclusions:
- CFM is a preferable criterion function due to its strong training-set classification ability.
- Improved test-set performance may be achieved with CFM when using a detailed training set.
- Further research could explore CFM's generalization capabilities in various contexts.
Related Concept Videos
01:15Receiver Operating Characteristic Plot
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
02:13The Representativeness Heuristic
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
01:24Generalization, Discrimination, and Extinction
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
01:30Classification of Signals
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
01:22Force Classification
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
01:16Goodness-of-Fit Test
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...