Related Experiment Video
Updated: Aug 12, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
The VC dimension for mixtures of binary classifiers
1Department of Statistics, Northwestern University, Evanston, IL 60208, USA.
Abstract:
The mixtures-of-experts (ME) methodology provides a tool of classification when experts of logistic regression models or Bernoulli models are mixed according to a set of local weights. We show that the Vapnik-Chervonenkis dimension of the ME architecture is bounded below by the number of experts m and above by O(m4s2), where s is the dimension of the input. For mixtures of Bernoulli experts with a scalar input, we show that the lower bound m is attained, in which case we obtain the exact result that the VC dimension is equal to the number of experts.
Related Concept Videos
Racemic Mixtures and the Resolution of Enantiomers
Vector Algebra: Method of Components
In many applications, the magnitudes and directions of...
Collisions in Multiple Dimensions: Introduction
Classification of Systems-I
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Classification of Systems-II
Aggregates Classification
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...

