Related Experiment Videos
Slow feature analysis: unsupervised learning of invariances.
Laurenz Wiskott1, Terrence J Sejnowski
1Computational Neurobiology Laboratory, Salk Institute for Biological Studies, San Diego, CA 92168, USA. l.wiskott@biologie.hu-berlin.de
Neural Computation
|April 9, 2002
Summary
Slow Feature Analysis (SFA) learns invariant features from signals for classification. This method, using nonlinear expansion and principal component analysis, extracts ordered, decorrelated features for robust object recognition.
Area of Science:
- Computational Neuroscience
- Machine Learning
- Signal Processing
Background:
- Invariant features are crucial for analyzing and classifying time-varying signals.
- Existing methods may not efficiently extract a diverse set of invariant features.
Purpose of the Study:
- To introduce and evaluate Slow Feature Analysis (SFA) for learning invariant features from vectorial input signals.
- To demonstrate SFA's hierarchical application for complex feature extraction and modeling the visual system.
- To assess SFA's ability to learn various invariances for object recognition.
Main Methods:
- Nonlinear expansion of the input signal.
- Application of Principal Component Analysis (PCA) to the expanded signal and its time derivative.
- Hierarchical application of SFA modules to process high-dimensional data.
Main Results:
- SFA optimally extracts decorrelated features ordered by invariance.
- A hierarchical SFA network models the visual system, learning translation, size, rotation, and contrast invariance.
- Few training objects yield good generalization for object recognition.
Conclusions:
- SFA is an effective method for learning invariant features, suitable for object recognition.
- Hierarchical SFA provides a viable model for visual system processing.
- Simultaneous learning of multiple invariances reduces performance.