Related Experiment Video
Updated: Aug 15, 2026

Basics of Multivariate Analysis in Neuroimaging Data
Published on: July 24, 2010
Statistical conclusion validity: an empirical analysis of multiplicity in mental retardation research
1SUNY, Buffalo 14214.
Abstract:
The statistical conclusion validity of mental retardation research was evaluated by reviewing 41 recently published articles in the American Journal on Mental Retardation and the Journal of Mental Deficiency Research. The analysis was focused on the incidence of Type I error as reflected by three different measures: the experiment-wise error rate, the error rate per experiment, and the percentage error rate. Values for each of these measures indicated that the probability of committing a Type I error was considerably greater than the traditionally assumed level of p less than .05, or 5%. The percentage error rate computed for the 41 articles (369 statistical tests) suggested that approximately 20% of the statistically significant results may be erroneous. Procedures to evaluate the impact of Type I errors in mental retardation research were presented and briefly discussed.
Related Concept Videos
Regression Toward the Mean
Statistical Significance
Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Friedman Two-way Analysis of Variance by Ranks
McNemar's Test

