An epsilon-margin nonlinear classifier based on fuzzy if-then rules

This paper introduces a new classifier design methods that are based on a modification of the classical Ho-Kashyap procedure. First, it proposes a method to design a linear classifier using the absolute loss rather than the squared loss that results in a better approximation of the misclassification error and robustness of outliers. Additionally, easy control of the generalization ability is obtained by minimization of the Vapnik-Chervonenkis dimension. Next, an extension to a nonlinear classifier by an ensemble averaging technique is presented. Each classifier is represented by a fuzzy if-then rule in the Takagi-Sugeno-Kang form. Two approaches to the estimation of parameters value are used: local, where each of the if-then rule parameters are determined independently and global where all rules are obtained simultaneously. Finally, examples are given to demonstrate the validity of the introduced methods.