A close consideration of effect sizes reviewed by Jussim (2012)

Area of Science:

• Psychology
• Social Psychology
• Research Methodology

Background:

• The interpretation of effect sizes in psychological research is critical for understanding the magnitude of observed phenomena.
• Previous work, such as Jussim (2012), has relied on effect sizes to support arguments regarding accuracy in person perception.
• Potential limitations in the calculation and interpretation of effect sizes require careful consideration.

Purpose of the Study:

• To critically evaluate the utility and interpretation of effect sizes in psychological research.
• To highlight the influence of experimental design artifacts on reported effect sizes.
• To propose a method for correcting effect sizes for measurement error and discuss its implications.

Main Methods:

• This commentary analyzes the conceptual underpinnings of effect size calculations.
• A formula for correcting effect sizes for attenuation due to unreliability is presented.
• The implications of this correction are discussed in the context of existing literature.

Main Results:

• Effect sizes can be inflated or deflated by artifacts inherent in experimental designs, potentially misrepresenting true effects.
• Failure to correct for measurement error (attenuation) leads to an overestimation of the true effect size.
• Applying the proposed correction can significantly alter conclusions drawn from studies relying on effect sizes.

Conclusions:

• Researchers must critically assess whether reported effect sizes reflect genuine effects or methodological artifacts.
• Correcting for attenuation is essential for a more accurate estimation of effect sizes and their real-world relevance.
• The findings necessitate a re-evaluation of previous conclusions in person perception research that did not account for measurement error.