Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Statistical difficulties of detecting interactions and moderator effects

G H McClelland1, C M Judd

  • 1Department of Psychology, University of Colorado, Boulder 80309-0345.

Psychological Bulletin
|September 1, 1993
PubMed
Summary

Field researchers struggle to find interaction effects due to lower statistical power. This study shows field tests have less than 20% efficiency compared to experimental tests, impacting moderator effect detection.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Mental search processes in problem solving.

Memory & cognition·2013
Same author

The effects of perceptions of hazardous waste on migration: a laboratory experimental approach.

The Review of regional studies·2002
Same author

Spontaneous prejudice in context: variability in automatically activated attitudes.

Journal of personality and social psychology·2001
Same author

The communication of social stereotypes: the effects of group discussion and information distribution on stereotypic appraisals.

Journal of personality and social psychology·2001
Same author

Estimating and testing mediation and moderation in within-subject designs.

Psychological methods·2001
Same author

Framing interethnic ideology: effects of multicultural and color-blind perspectives on judgments of groups and individuals.

Journal of personality and social psychology·2000

Area of Science:

  • Social Sciences
  • Psychology
  • Statistics

Background:

  • Interaction effects are common in experimental research but difficult to detect in field studies.
  • Previous explanations include measurement error and nonlinear scales.
  • A key factor is the differential residual variance of interaction terms.

Purpose of the Study:

  • To explain the discrepancy in detecting interaction effects between experimental and field research.
  • To demonstrate the role of residual variance in the efficiency of moderator effect tests.
  • To provide guidance for designing more effective field studies.

Main Methods:

  • Derivation of an expression for residual variance of interaction effects.
  • Analysis of the joint distribution of component variables.

Related Experiment Videos

  • Comparison of statistical power between experimental and field tests of interactions.

    • Main Results:

    • Differential residual variance significantly impacts the efficiency of interaction tests.
    • Field tests for moderator effects can be less than 20% as efficient as optimal experimental tests.
    • Properties of the variable distribution influence test efficiency.

    Conclusions:

    • The lower efficiency of field tests is a major reason for difficulties in detecting moderator effects.
    • Researchers must consider residual variance when designing field studies.
    • Implications for improving the design and power of field research on interactions.