Related Experiment Videos
A class of single-class minimax probability machines for novelty detection
James T Kwok1, Ivor Wai-hung Tsang, Jacek M Zurada
1Institute of Systems Science, the Polish Academy of Sciences, Warsaw, Poland. jamesk@cs.ust.hk
IEEE Transactions on Neural Networks
|May 29, 2007
Summary
This study introduces a refined single-class minimax probability machine (MPM) for improved novelty detection. The enhanced MPM balances false negatives and false positives, offering better performance on real-world datasets.
Area of Science:
- Machine Learning
- Artificial Intelligence
- Data Mining
Background:
- Single-class minimax probability machines (MPMs) provide robust novelty detection with distribution-free worst-case bounds.
- Traditional MPMs exhibit a high false negative rate (FNR) due to their conservative nature in identifying outliers.
Purpose of the Study:
- To develop a more aggressive single-class MPM to address the high FNR of existing methods.
- To bound the best-case probability of a pattern falling within the normal region for improved outlier detection.
Main Methods:
- Proposed a novel, more aggressive single-class MPM.
- Utilized a pair of MPMs (traditional and aggressive) to define the solution space.
- Employed a middle hyperplane between the two MPMs for optimal classification.
Main Results:
- The proposed aggressive MPM effectively reduces the false negative rate.
- The combined approach achieves a better balance between false positives (FPs) and FNs.
- Experiments on real-world datasets demonstrate encouraging improvements in novelty detection accuracy.
Conclusions:
- The enhanced single-class MPM offers a superior compromise between precision and recall.
- This method provides a more effective solution for novelty detection tasks with high-stakes applications.
- The dual-MPM approach refines outlier identification by carefully delimiting the normal region.
Related Concept Videos
Classification of Signals
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Classification of Systems-I
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Classification of Systems-II
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
Machines: Problem Solving II
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
Probability Histograms
A probability histogram is a visual representation of a probability distribution. Similar a typical histogram, the probability histogram consists of contiguous (adjoining) boxes. It has both a horizontal axis and a vertical axis. The horizontal axis is labeled with what the data represents. The vertical axis is labeled with probability. Each rectangular bar in the histogram is 1 unit wide, which suggests that the area under each bar equals the probability, P(x), where x is 1, 2, 3, and so on.
Difference from Background: Limit of Detection
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...