Related Experiment Video
Updated: Aug 9, 2026
06:08
Exploring the Role of Deontic Reasoning and World Knowledge in Wason´s Selection Task
Published on: July 22, 2025
Participant recruitment methods and statistical reasoning performance
Gary L Brase1, Laurence Fiddick, Clare Harries
1University of Missouri-Columbia, Columbia, MI 65211, USA. braseg@missouri.edu
Quarterly Journal of Experimental Psychology (2006)
|April 13, 2006
Summary
Replication issues in Bayesian reasoning studies stem from participant sampling. Top university students, compensated for participation, yield the best results, highlighting the impact of participant quality and incentives on cognitive performance.
Area of Science:
- Cognitive Psychology
- Decision Science
- Bayesian Reasoning
Background:
- Optimal Bayesian reasoning performance has been difficult to replicate across studies.
- Previous research has proposed various explanations for these replication challenges.
- Methodological variations, particularly in participant selection, may underlie these discrepancies.
Purpose of the Study:
- To investigate the impact of participant-sampling methodologies on Bayesian reasoning performance.
- To identify specific factors related to participant source and incentives that influence performance.
- To explain the variability observed in previous Bayesian reasoning replication attempts.
Main Methods:
- Conducted a series of experiments manipulating participant source (top-tier vs. second-tier universities) and participation incentives (paid vs. unpaid).
- Compared performance of honours-programme undergraduates versus regular undergraduates.
- Assessed the effect of pictorial representations supplementing problem text on performance.
Main Results:
- Students from top-tier universities who were paid for participation demonstrated the highest Bayesian reasoning performance.
- Performance significantly decreased with unpaid participants or students from lower-ranked universities.
- Honours students outperformed regular students; pictorial aids had a slight facilitative effect.
Conclusions:
- Participant-sampling methodologies, including university tier and compensation, are critical determinants of Bayesian reasoning performance.
- Future research should account for these methodological details to ensure accurate replication.
- Focusing on relative performance levels, rather than absolute scores, is recommended.
More Related Videos
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
06:57Utilizing Electroencephalography Measurements for Comparison of Task-Specific Neural Efficiencies: Spatial Intelligence Tasks
Published on: August 9, 2016
Related Concept Videos
01:37Statistical Significance
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
02:01Group Design
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
01:24Testing a Claim about Population Proportion
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
01:13Randomized Experiments
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
01:16Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance, comparing...
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance, comparing...
01:30Reasoning
Reasoning is the action of thinking about something in a logical, sensible way. It is integral to problem-solving, decision-making, and critical thinking. Reasoning can be inductive or deductive. Reasoning involves transforming information into conclusions, which is essential for problem-solving, decision-making, and critical thinking.
Inductive reasoning involves deriving generalizations from specific observations. This type of reasoning helps form beliefs about the world. For example,...
Inductive reasoning involves deriving generalizations from specific observations. This type of reasoning helps form beliefs about the world. For example,...