Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Statistical Significance01:37

Statistical Significance

20.9K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.9K
Significance Testing: Overview01:04

Significance Testing: Overview

10.2K
Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
10.2K
Case Studies01:22

Case Studies

11.3K
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
11.3K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

627
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
627
Longitudinal Research02:20

Longitudinal Research

11.7K
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
11.7K
Ethics in Research01:56

Ethics in Research

23.7K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
23.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Bounding the average causal effect in Mendelian randomisation studies with multiple proposed instruments: An application to prenatal alcohol exposure and attention deficit hyperactivity disorder.

Paediatric and perinatal epidemiology·2023
Same author

Childhood Maltreatment and Mental Health Problems: A Systematic Review and Meta-Analysis of Quasi-Experimental Studies.

The American journal of psychiatry·2023
Same author

Reporting and methodological quality of studies that use Mendelian randomisation in UK Biobank: a meta-epidemiological study.

BMJ evidence-based medicine·2023
Same author

Is there a causal relationship between executive function and liability to mental health and substance use? A Mendelian randomization approach.

Royal Society open science·2022
Same author

Genetic diversity fuels gene discovery for tobacco and alcohol use.

Nature·2022
Same author

Multivariate analyses of molecular genetic associations between childhood psychopathology and adult mood disorders and related traits.

American journal of medical genetics. Part B, Neuropsychiatric genetics : the official publication of the International Society of Psychiatric Genetics·2022

Related Experiment Video

Updated: Apr 26, 2026

Task Interruption and Resumption Paradigm for Testing the Activation and Pursuit of an Abstract Thinking Goal
06:45

Task Interruption and Resumption Paradigm for Testing the Activation and Pursuit of an Abstract Thinking Goal

Published on: April 18, 2017

5.7K

Significance chasing in research practice: causes, consequences and possible solutions.

Jennifer J Ware1, Marcus R Munafò

  • 1School of Social and Community Medicine, University of Bristol, Bristol, UK; MRC Integrative Epidemiology Unit (IEU) at the University of Bristol, Bristol, UK; UK Centre for Tobacco and Alcohol Studies, University of Bristol, Bristol, UK.

Addiction (Abingdon, England)
|July 22, 2014
PubMed
Summary

Scientific reproducibility is declining due to false positives, driven by a publish-or-perish culture. Addressing this requires changes in journal incentives and research practices to prioritize veracity over novelty.

Keywords:
False positivefraudpre-registrationpublication biasreproducibilitysignificance chasing

More Related Videos

A Novel Method for Involving Women of Color at High Risk for Preterm Birth in Research Priority Setting
14:43

A Novel Method for Involving Women of Color at High Risk for Preterm Birth in Research Priority Setting

Published on: January 12, 2018

14.4K
Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
06:16

Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting

Published on: June 6, 2020

5.8K

Related Experiment Videos

Last Updated: Apr 26, 2026

Task Interruption and Resumption Paradigm for Testing the Activation and Pursuit of an Abstract Thinking Goal
06:45

Task Interruption and Resumption Paradigm for Testing the Activation and Pursuit of an Abstract Thinking Goal

Published on: April 18, 2017

5.7K
A Novel Method for Involving Women of Color at High Risk for Preterm Birth in Research Priority Setting
14:43

A Novel Method for Involving Women of Color at High Risk for Preterm Birth in Research Priority Setting

Published on: January 12, 2018

14.4K
Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting
06:16

Involving Individuals with Developmental Language Disorder and Their Parents/Carers in Research Priority Setting

Published on: June 6, 2020

5.8K

Area of Science:

  • Scientific research integrity
  • Publication ethics
  • Research methodology

Background:

  • Low reproducibility of scientific findings is a significant concern.
  • False positives in research can misdirect efforts and waste resources.
  • The prevalence of 'significant' findings may be inflated.

Purpose of the Study:

  • To review factors contributing to poor study reproducibility.
  • To examine the influence of incentive structures on research practices.
  • To identify potential solutions for improving scientific rigor.

Main Methods:

  • Literature review of factors affecting reproducibility.
  • Analysis of current incentive structures in academia.
  • Examination of research practices and their impact.

Main Results:

  • Questionable research practices, from minor to serious, contribute to false positives.
  • Incentive structures (e.g., pressure to publish) and journal emphasis on novelty drive these practices.
  • Potential solutions include new publishing formats focusing on research design over results.

Conclusions:

  • A 'publish or perish' culture and journal preference for novelty lead to significance chasing and poor reproducibility.
  • Top-down changes from funders and journals are likely necessary to modify incentive structures.
  • Addressing poor reproducibility requires systemic changes in scientific publishing and evaluation.