Related Experiment Video
Updated: May 23, 2026
06:08
Exploring the Role of Deontic Reasoning and World Knowledge in Wason´s Selection Task
Published on: July 22, 2025
Ten ironic rules for non-statistical reviewers.
1The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, Queen Square, London WC1N 3BG, UK.
Neuroimage
|April 24, 2012
Summary
This technical note guides expert reviewers on critiquing statistical practices in neuroimaging studies. It provides universal critiques and rebuttal strategies to support manuscript rejection when necessary.
Area of Science:
- Neuroimaging
- Statistical Analysis
- Scientific Reviewing
Background:
- Peer review is crucial for scientific integrity.
- Identifying statistical flaws is a key reviewer responsibility.
- Neuroimaging studies present unique statistical challenges.
Purpose of the Study:
- To provide expert reviewers with methods to critique statistical analysis in neuroimaging papers.
- To offer strategies for maximizing the impact of statistical critiques during peer review.
- To prepare reviewers for author and editor rebuttals regarding statistical concerns.
Main Methods:
- Reviewing common statistical pitfalls in neuroimaging data analysis.
- Developing a framework for universally applicable critiques.
- Anticipating and preparing responses to author/editor rebuttals.
Main Results:
- Identification of specific, recurring statistical errors in neuroimaging research.
- A structured approach to formulating statistically-based rejection recommendations.
- Strategies for effectively communicating statistical concerns to authors and editors.
Conclusions:
- Rigorous critique of statistical methods is essential for maintaining neuroimaging research quality.
- Empowering reviewers with targeted statistical critique skills enhances the peer-review process.
- This guidance aims to improve the reliability and reproducibility of published neuroimaging findings.
Related Concept Videos
01:16Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance, comparing...
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance, comparing...
01:16Statistical Hypothesis Testing
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
01:02Quantifying and Rejecting Outliers: The Grubbs Test
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This number is...
01:56Ethics in Research
Today, scientists agree that good research is ethical in nature and is guided by a basic respect for human dignity and safety. However, this has not always been the case. Modern researchers must demonstrate that the research they perform is ethically sound.
01:28Introduction to Nonparametric Statistics
Nonparametric statistics offer a powerful alternative to traditional parametric methods, useful when assumptions about the population distribution cannot be made. Unlike parametric tests, which require data to follow a specific distribution with well-defined parameters (such as the mean and standard deviation), nonparametric tests do not require such constraints. This makes them particularly valuable when dealing with small sample sizes, skewed data, or ordinal and categorical variables.
One of...
One of...
01:00Detection of Gross Error: The Q Test
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...