Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Don't characterize replications as successes or failures.

Andrew Gelman1

  • 1Department of Statistics,Columbia University,New York,NY 10027.gelman@stat.columbia.eduhttp://www.stat.columbia.edu/~gelman.

The Behavioral and Brain Sciences
|May 9, 2019
PubMed
Summary

Replication studies should abandon "direct" vs. "conceptual" labels. Instead, researchers should use continuous measures and raw data meta-analysis to compare treatment effects across varying conditions for better scientific understanding.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Distinct Metabolomic and Lipidomic Profiles Across Donation after Circulatory Death Recovery Strategies Reveal a Common Signature Associated with Primary Graft Dysfunction.

The Journal of heart and lung transplantation : the official publication of the International Society for Heart Transplantation·2026
Same author

FDA Draft Guidance for the Use of Bayesian Methods in Clinical Trials.

JAMA·2026
Same author

Pathfinder: Parallel quasi-Newton variational inference.

Journal of machine learning research : JMLR·2026
Same author

Multilevel regression and poststratification interface: an application to track community-level COVID-19 viral transmission.

Population health metrics·2026
Same author

A multilevel Bayesian approach to climate-fueled migration and conflict.

Scientific reports·2025
Same author

Meta-analysis with a single study.

Statistical methods in medical research·2025

Area of Science:

  • Psychology
  • Scientific Methodology

Background:

  • The classification of replication studies as "direct" or "conceptual" is problematic.
  • Current methods for evaluating replication outcomes (success/failure) lack nuance.

Purpose of the Study:

  • To propose a new framework for evaluating replication studies.
  • To advocate for a shift away from binary classifications in replication research.

Main Methods:

  • Critique of existing replication classification systems.
  • Proposal for a framework based on varying treatment effects across conditions.
  • Recommendation for using continuous measures and raw data meta-analysis.

Main Results:

  • Treatment effects inherently vary across different experimental conditions.

Related Experiment Videos

  • Binary success/failure labels obscure the nuances of replication findings.

    • Conclusions:

    • Abandon the "direct" vs. "conceptual" replication dichotomy.
    • Adopt a framework acknowledging the variability of treatment effects.
    • Utilize continuous measures and raw data meta-analysis for robust comparisons.