Related Experiment Video
Updated: Sep 20, 2025

07:05
Visualization Method for Proprioceptive Drift on a 2D Plane Using Support Vector Machine
Published on: October 27, 2016
9.3K
Training Dataset Curation by L1-Norm Principal-Component Analysis for Support Vector Machines
Summary
This study introduces a novel data curation method using L1-norm principal-component analysis to filter mislabeled data before training Support Vector Machines (SVMs). This approach enhances SVM model robustness against noisy training datasets.
Area of Science:
- Machine Learning
- Data Science
- Computational Statistics
Background:
- Support Vector Machines (SVMs) are widely used for classification but are sensitive to mislabeled training data.
- Mislabeled examples can negatively impact SVM decision boundaries and performance on new data.
Purpose of the Study:
- To develop a novel, data-driven method for filtering atypical data instances prior to SVM training.
- To enhance the robustness of SVM classifiers against noisy datasets.
Main Methods:
- A new method based on L1-norm principal-component analysis and geometry is proposed.
- The method filters atypical data instances on a class-by-class basis in an unsupervised manner.
- The approach is computationally efficient and data-driven (touch-free).
Main Results:
- The L1-norm curation method effectively identifies and filters out atypical data instances.
- Experimental studies on real datasets demonstrate the method's efficacy.
- Protected SVM models show improved performance by mitigating the impact of data faults.
Conclusions:
- The proposed L1-norm based data curation method provides robust support-vector candidates for SVMs.
- This unsupervised, efficient technique enhances SVM performance by ensuring cleaner training data.
- The method offers a practical solution for improving classifier reliability in real-world applications.
Related Concept Videos
Quantifying and Rejecting Outliers: The Grubbs Test
2.2K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
2.2K
One-Way ANOVA
8.1K
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
8.1K
Vector Algebra: Method of Components
15.8K
It is cumbersome to find the magnitudes of vectors using the parallelogram rule or using the graphical method to perform mathematical operations like addition, subtraction, and multiplication. There are two ways to circumvent this algebraic complexity. One way is to draw the vectors to scale, as in navigation, and read approximate vector lengths and angles (directions) from the graphs. The other way is to use the method of components.
In many applications, the magnitudes and directions of...
In many applications, the magnitudes and directions of...
15.8K
One-Way ANOVA: Unequal Sample Sizes
5.9K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.9K
One-Way ANOVA: Equal Sample Sizes
3.5K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.5K
Goodness-of-Fit Test
4.1K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
4.1K

