Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

One-Way ANOVA: Unequal Sample Sizes01:15

One-Way ANOVA: Unequal Sample Sizes

One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures from...
Wald-Wolfowitz Runs Test II01:17

Wald-Wolfowitz Runs Test II

The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and 0s. In...
Randomized Experiments01:13

Randomized Experiments

The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Test for Homogeneity01:23

Test for Homogeneity

The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can be stated as...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Large-Scale Social Feedback and Language Usage: a Distributional Analysis.

Computational brain & behavior·2026
Same author

True and false recognition in MINERVA2: Integrating fuzzy-trace theory and computational memory modeling.

Psychological review·2025
Same author

Determining the optimal environmental information for training computational models of lexical semantics and lexical organization.

Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale·2024
Same author

Determining the Relativity of Word Meanings Through the Construction of Individualized Models of Semantic Memory.

Cognitive science·2024
Same author

Neural evidence of switch processes during semantic and phonetic foraging in human memory.

Proceedings of the National Academy of Sciences of the United States of America·2023
Same author

Comparing word frequency, semantic diversity, and semantic distinctiveness in lexical organization.

Journal of experimental psychology. General·2023

Related Experiment Video

Updated: Jun 21, 2026

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

Randomization tests and the unequal-N/unequal-variance problem.

D J K Mewhort1, Mary Alexandria Kelly, Brendan T Johns

  • 1Department of Psychology, School of Computing, Queen's University, Kingston, Ontario, Canada. mewhortd@queensu.ca

Behavior Research Methods
|July 10, 2009
PubMed
Summary

Unequal variances and sample sizes in two-group designs distort Type I error rates. An algorithm corrects this when smaller groups have larger variances, restoring nominal error rates without impacting statistical power.

More Related Videos

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach
04:35

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach

Published on: July 3, 2020

Related Experiment Videos

Last Updated: Jun 21, 2026

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach
04:35

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach

Published on: July 3, 2020

Area of Science:

  • Statistics
  • Psychometrics
  • Quantitative Psychology

Background:

  • In two-group designs, unequal variances and sample sizes can compromise the accuracy of statistical tests.
  • Specifically, Type I error rates deviate from the nominal 5% when group variances and sample sizes (N) are unequal.

Purpose of the Study:

  • To address the Type I error rate inflation/deflation in two-group designs with unequal variances and sample sizes.
  • To present and validate a novel algorithm for correcting these errors when the smaller group possesses the larger variance.

Main Methods:

  • The study involved analyzing the impact of unequal variances and sample sizes on Type I error rates.
  • A simulation approach was employed to evaluate the performance of the proposed algorithm.
  • The algorithm was specifically designed to counteract the liberal error rate observed when the smaller group has a larger variance.

Main Results:

  • When variances and sample sizes are unequal, Type I error rates deviate from the nominal 5%.
  • The error rate becomes too liberal if the smaller group has the larger variance.
  • The proposed algorithm effectively restores the Type I error rate to the nominal level under these conditions.

Conclusions:

  • The developed algorithm successfully corrects distorted Type I error rates in two-group designs with unequal variances and sample sizes.
  • This correction is particularly effective when the smaller group exhibits greater variance.
  • The algorithm achieves this without compromising the statistical power to detect true effects.