Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Scientific Nature of Social Psychology

Scientific Nature of Social Psychology

Social psychology is a scientific discipline dedicated to understanding how individuals think, feel, and behave in social contexts. Unlike common sense, which relies on anecdotal experiences and intuition, social psychology employs systematic research and empirical methods to ensure objectivity and reliability. This distinction is fundamental in distinguishing scientifically supported findings from mere speculation.Four fundamental scientific values guide a structured approach to research in...

What is an Experiment?

What is an Experiment?

An experiment is a planned activity carried out under controlled conditions. The purpose of an experiment is to investigate the relationship between two variables. When one variable causes change in another, we call the first variable the explanatory or independent variable. The affected variable is called the response or dependent variable. In a randomized experiment, the researcher manipulates values of the explanatory variable and measures the resulting changes in the response variable. The...

Group Design

Group Design

The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Social Proof

Social proof is a form of persuasion based on comparison and conformity. People compare their behavior and actions to what others are doing and will change to conform to do what their peers do.

The Scientific Method

The Scientific Method

Research is what makes the difference between facts and opinions. Facts are observable realities, and opinions are personal judgments, conclusions, or attitudes that may or may not be accurate. In the scientific community, facts can be established only using evidence collected through empirical research.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Does Testosterone Affect Cognitive Reflection? Evidence From a Double-Blind, Randomized Controlled Study of 1,000 Participants.

Psychological science·2026

Same author

Scientific workflow in experimental economics.

Philosophical transactions. Series A, Mathematical, physical, and engineering sciences·2026

Same author

2D:4D and Self-Employment: A Preregistered Replication Study in a Large General Population Sample.

Entrepreneurship theory and practice·2026

Same author

Publisher Correction: Reproducibility and robustness of economics and political science research.

Nature·2026

Same author

Investigating the replicability of the social and behavioural sciences.

Nature·2026

Same author

Investigating the analytical robustness of the social and behavioural sciences.

Nature·2026

Search research articles

Related Experiment Video

Updated: Jan 2, 2026

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan

Published on: June 29, 2018

Predicting the replicability of social science lab experiments.

Adam Altmejd^1,2, Anna Dreber^1,3, Eskil Forsell¹

¹Department of Economics, Stockholm School of Economics, Stockholm, Sweden.

|December 6, 2019

Summary

Predictive models accurately forecast experimental result replication using machine learning. These tools assess replication likelihood, aiding resource allocation for informative studies.

More Related Videos

An Open Source Technology Platform to Manufacture Hydrogel-Based 3D Culture Models in an Automated and Standardized Fashion

An Open Source Technology Platform to Manufacture Hydrogel-Based 3D Culture Models in an Automated and Standardized Fashion

Published on: March 31, 2022

Environmentally Induced Heritable Changes in Flax

Environmentally Induced Heritable Changes in Flax

Published on: January 26, 2011

Related Experiment Videos

Last Updated: Jan 2, 2026

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan

The Replica Set Method: A High-throughput Approach to Quantitatively Measure Caenorhabditis elegans Lifespan

Published on: June 29, 2018

An Open Source Technology Platform to Manufacture Hydrogel-Based 3D Culture Models in an Automated and Standardized Fashion

An Open Source Technology Platform to Manufacture Hydrogel-Based 3D Culture Models in an Automated and Standardized Fashion

Published on: March 31, 2022

Environmentally Induced Heritable Changes in Flax

Environmentally Induced Heritable Changes in Flax

Published on: January 26, 2011

Area of Science:

Psychology
Economics
Machine Learning
Reproducibility

Background:

Assessing the reproducibility of scientific findings is crucial for research integrity.
Previous methods for predicting replication success have limitations.

Purpose of the Study:

To develop and validate machine learning models for predicting the replication of experimental results.
To identify key variables that influence the predictability of replication.

Main Methods:

Utilized data from four large-scale replication projects in psychology and economics.
Trained black-box statistical models using machine learning techniques.
Validated model performance using cross-validation and an out-of-sample test.

Main Results:

Models achieved 70% accuracy (AUC 0.77) in predicting binary replication and a Spearman correlation of 0.38 for effect sizes.
Out-of-sample validation showed 71% accuracy (AUC 0.73) and a correlation of 0.25.
Key predictors included sample size, effect size, and type of reported effect (main effect vs. interaction).

Conclusions:

Machine learning models offer a cost-effective method for estimating the likelihood of result replication.
These prognostic replicability metrics can inform the evaluation of new findings and guide replication efforts.