An exact statistical method for comparing topographic maps, with any number of subjects and electrodes

Statistical methods for testing differences between neural images (e.g., PET, MRI or EEG maps) are problematic because they require (1) an untenable assumption of data sphericity and (2) a high subject to electrode ratio. We propose and demonstrate an exact and distribution-free method of significance testing which avoids the sphericity assumption and may be computed for any combination of electrode and subject numbers. While this procedure is rigorously rooted in permutation test theory, it is intuitively comprehensible. The sensitivity of the permutation test to graded changes in dipole location for systematically varying levels of signal/noise ratio, intersubject variability and number of subjects was demonstrated through a simulation of 70 different conditions, generating 5,000 different data sets for each condition. Data sets were simulated from a homogeneous single-shell dipole model. For noise levels commonly encountered in evoked potential studies and for situations where the number of subjects was less than the number of electrodes, the permutation test was very sensitive to a change in dipole location of less than 0.75 cm. This method is especially sensitive to localized changes that would be "washed-out" by more traditional methods of analysis. It is superior to all previous methods of statistical analysis for comparing topographical maps, because the test is exact, there is no assumption of a multivariate normal distribution or of the correlation structure of the data requiring correction, the test can be tailored to the specific experimental hypotheses rather than allowing the statistical tests to limit the experimental design, and there is no limitation on the number of electrodes that can be simultaneously analyzed.