#EEGManyLabs: Investigating the replicability of influential EEG experiments

Area of Science:

• Neuroscience
• Cognitive Science
• Psychology

Background:

• Growing awareness in neuroscience emphasizes the need for high statistical power and standardized analysis pipelines to improve the replicability of findings.
• Electroencephalography (EEG) has significantly advanced our understanding of human cognition, yet the replicability of highly cited EEG discoveries remains under-examined.

Purpose of the Study:

• To address the replicability crisis in neuroscience by evaluating foundational electroencephalography (EEG) findings.
• To foster a cultural shift towards large-scale, high-powered, multi-laboratory collaborations in cognitive neuroscience research.

Main Methods:

• A systematic search identified 27 influential EEG studies; 20 will be replicated by at least three independent laboratories each.
• Replication protocols will be submitted as Registered Reports for peer review before data collection.
• Prediction markets will be utilized to forecast community expectations regarding the replicability of selected EEG findings.

Main Results:

• The project will generate a large, open-access database of replication results.
• Confidence in influential EEG findings will be updated based on replication outcomes.
• The study aims to identify which foundational EEG findings are most/least replicable.

Conclusions:

• This international collaborative effort seeks to enhance the reliability and reproducibility of EEG research.
• The project will provide valuable data to inform future research practices and improve scientific rigor in cognitive neuroscience.
• A cultural shift towards open, collaborative, and high-powered research is anticipated.