Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Extrasensory Perception01:23

Extrasensory Perception

1.1K
Extrasensory perception, or ESP, suggests the ability to perceive events beyond the conventional senses of sight, hearing, and touch. Parapsychologists, who research ESP and related psychic phenomena, categorize ESP into three main types: precognition, telepathy, and clairvoyance.
Precognition involves foreseeing future events, such as predicting an accident before it happens. An example of precognition could be someone dreaming about a specific event, like a car crash, which then occurs...
1.1K
Ethics in Research01:56

Ethics in Research

26.1K
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
26.1K
The Scientific Method02:40

The Scientific Method

67.0K
Research is what makes the difference between facts and opinions. Facts are observable realities, and opinions are personal judgments, conclusions, or attitudes that may or may not be accurate. In the scientific community, facts can be established only using evidence collected through empirical research.
67.0K
Psychosurgery01:30

Psychosurgery

2.2K
Psychosurgery, the surgical alteration or permanent removal of brain tissue to alleviate severe psychological conditions, stands as one of the most radical and controversial treatments in the history of mental health care. Its development and application have evolved significantly, marked by dramatic shifts in scientific understanding and ethical perspectives.
Historical Development of Psychosurgery
In the 1930s, Portuguese neurologist Antonio Egas Moniz introduced a surgical procedure designed...
2.2K
Statistical Significance01:37

Statistical Significance

23.7K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
23.7K
Psychology as a Science01:13

Psychology as a Science

4.2K
Psychology, as a scientific discipline, aims to understand the mind and behavior through rigorous and systematic methods. The foundation of psychological research is evidence-based, relying heavily on the scientific method to derive and validate knowledge. This structured approach ensures that findings are reliable, valid, and applicable to broader contexts.
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
4.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The cognitive and affective alexithymia dimensions in the regulation of sympathetic responses.

International journal of psychophysiology : official journal of the International Organization of Psychophysiology·2009
Same author

Intuitive decision making in complex situations: somatic markers in an artificial grammar learning task.

Cognitive, affective & behavioral neuroscience·2006
See all related articles

Related Experiment Video

Updated: Mar 21, 2026

Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images SDM-PSI
06:26

Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images SDM-PSI

Published on: November 27, 2019

78.9K

Testing for Questionable Research Practices in a Meta-Analysis: An Example from Experimental Parapsychology.

Dick J Bierman1,2, James P Spottiswoode3, Aron Bijl2

  • 1Experimental Psychology, University of Groningen, Groningen, The Netherlands.

Plos One
|May 5, 2016
PubMed
Summary

Questionable Research Practices (QRPs) may inflate meta-analysis results. This study simulated QRPs in a telepathy meta-analysis, finding they likely skewed findings, though some significance remained even with QRPs.

More Related Videos

Dissociation of the Confounding Influences of Expectancy and Integrative Difficulty Residing in Anomalous Sentences in Event-related Potential Studies
05:22

Dissociation of the Confounding Influences of Expectancy and Integrative Difficulty Residing in Anomalous Sentences in Event-related Potential Studies

Published on: May 9, 2019

5.8K
Combining Behavior and EEG to Study the Effects of Mindfulness Meditation on Episodic Memory
08:16

Combining Behavior and EEG to Study the Effects of Mindfulness Meditation on Episodic Memory

Published on: May 11, 2020

9.2K

Related Experiment Videos

Last Updated: Mar 21, 2026

Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images SDM-PSI
06:26

Meta-analysis of Voxel-Based Neuroimaging Studies using Seed-based d Mapping with Permutation of Subject Images SDM-PSI

Published on: November 27, 2019

78.9K
Dissociation of the Confounding Influences of Expectancy and Integrative Difficulty Residing in Anomalous Sentences in Event-related Potential Studies
05:22

Dissociation of the Confounding Influences of Expectancy and Integrative Difficulty Residing in Anomalous Sentences in Event-related Potential Studies

Published on: May 9, 2019

5.8K
Combining Behavior and EEG to Study the Effects of Mindfulness Meditation on Episodic Memory
08:16

Combining Behavior and EEG to Study the Effects of Mindfulness Meditation on Episodic Memory

Published on: May 11, 2020

9.2K

Area of Science:

  • Psychology
  • Research Methodology

Background:

  • Meta-analyses synthesize research findings but can be influenced by biases.
  • Questionable Research Practices (QRPs) are methodological choices that can distort results.
  • Assessing the impact of QRPs on meta-analysis outcomes is crucial for research integrity.

Purpose of the Study:

  • To develop and demonstrate a method for quantifying the effect of QRPs on meta-analysis results.
  • To assess the extent to which QRPs could explain findings in a controversial telepathy meta-analysis.

Main Methods:

  • Simulated a meta-analysis using parameters from a published telepathy study.
  • Incorporated QRP frequencies based on surveys of experimental psychologists.
  • Utilized a genetic algorithm to optimize QRP parameters and assessed fit using four key metrics.

Main Results:

  • Simulations indicated that unrealistic QRP parameter values were needed to match the empirical meta-analysis without an anomalous effect.
  • When restricting QRPs to observed ranges, the fit to the Ganzfeld meta-analysis was poor without an anomalous effect.
  • A moderate anomalous effect (27% hit rate) with QRPs yielded a good fit (F=1.8, p=0.47), suggesting QRPs likely inflate significance.

Conclusions:

  • The significant probability in the Ganzfeld meta-analysis is likely inflated by QRPs.
  • Even with QRPs, some results remained statistically significant (p=0.003).
  • Quantitative simulation of QRPs is a valuable method for assessing their impact in meta-analyses across various scientific domains.