Sample size and dimensionality in multivariate classification: implications for body surface potential mapping

This paper presents empirically determined guidelines for specifying the number of features appropriate for multivariate classification studies for given sample sizes. Sample size was considered adequate if the mean distance between two sample sets, taken from the same continuous multivariate distribution and projected onto the best separating direction, remained below a prescribed level. To quantitate the sample size requirement, homogeneity of sample set pairs of equal size. N, taken from the same continuous multivariate distribution was studied as a function of dimensionality. M. Homogeneity was characterized by the maximum absolute distances (Dmax) between the corresponding pairs of empirical cumulative probability distributions on the best separating projection. Computer generated data sets were used to estimate the cumulative probability distribution, P(D)M.N, for sample sizes, N, ranging from 5 to 100 and the dimensionality, M, ranging from 1 to 4. An empirical relationship between the estimated step-polygons and the Kolmogorov type one dimensional limiting distribution L(z) has been established. Based on the sample size data of 34 key papers on clinical body surface potential mapping (BSPM) it is noted that in 30% of the cases only one, and in 6% of the cases only two parameters could be used for statistical group representation to ensure a reasonable reliability (Dmax less than 0.2). In 56% of the published cases the sample sizes could not guarantee this reliability even for one feature or parameter.