Related Experiment Video
Updated: Jun 27, 2026

09:13
A Real-world What-Where-When Memory Test
Published on: May 16, 2017
Generalized Cohen's d for Multiple Means and Polytomous Settings
1Turku Research Institute for Learning Analytics (TRILA), Faculty of Mathematics and Natural Sciences, University of Turku, Turku, Finland.
Applied Psychological Measurement
|January 23, 2026
Summary
This study introduces general formulas to calculate Cohen
Area of Science:
- Statistics
- Psychometrics
- Quantitative Psychology
Background:
- Cohen's d is widely used for two-group mean difference effect size.
- Cohen's f is used for comparing multiple population means.
- Existing methods lack generalization for complex polytomous settings.
Purpose of the Study:
- To derive general formulas for Cohen's d in polytomous settings.
- To evaluate the accuracy of a simplified d = 2f estimator.
- To provide guidance on effect size estimation for multiple populations.
Main Methods:
- Utilized the relationship between Cohen's d and f in dichotomous cases.
- Developed generalized formulas extending Cohen's d to polytomous data.
- Analyzed the performance of the simplified estimator (d = 2f).
Main Results:
- General formulas for Cohen's d in polytomous settings were successfully derived.
- The simplified estimator d = 2f was found to be less accurate.
- Discrepancies in extreme proportions exceeding 0.40 highlight the need for general formulas.
Conclusions:
- Recommended using the derived general formulas for accurate effect size estimation.
- Advised against relying on the simplified d = 2f estimator in most cases.
- Emphasized the importance of accurate effect size measures in multiple population comparisons.
Related Concept Videos
Test for Homogeneity
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can be stated as...
One-Way ANOVA
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
One-Way ANOVA: Equal Sample Sizes
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Multiple Comparison Tests
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Friedman Two-way Analysis of Variance by Ranks
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures from...
Cochran's Q Test
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square distribution,...

