Related Experiment Video
Updated: Jun 27, 2026
07:13
A Two-interval Forced-choice Task for Multisensory Comparisons
Published on: November 9, 2018
Probability assessment with response times and confidence in perception and knowledge.
William M Petrusic1, Joseph V Baranski
1Department of Psychology, Carleton University, 1125 Colonel By Drive, Ottawa, Ontario, Canada K1S 5B6. bill_petrusic@carleton.ca
Acta Psychologica
|December 17, 2008
Summary
This study found that while people can categorize their decision times, confidence ratings are better predictors of decision accuracy than response time (RT) categorization. Confidence does not appear to arise from simply scaling decision time.
Area of Science:
- Cognitive Psychology
- Decision Science
Background:
- Confidence judgments are crucial for metacognition.
- The relationship between decision time and confidence is debated.
- Previous research suggests decision time might influence confidence.
Purpose of the Study:
- To investigate whether confidence arises from scaling decision time.
- To compare the metacognitive properties of response time (RT) categorization and confidence ratings.
Main Methods:
- Participants performed perceptual and general knowledge tasks.
- They categorized their decision times (Slow to Fast) and provided confidence ratings (50% to 100%).
- Probability assessment analyses examined over/underconfidence, calibration, and resolution.
Main Results:
- Response time (RT) categorization showed a "hard-easy" effect similar to confidence ratings.
- Confidence ratings provided significantly better decision resolution than RT categorization.
- Subjective RT categorization yielded superior probability indices compared to objective RT scaling.
Conclusions:
- Findings do not support the hypothesis that confidence is derived from scaling decision time.
- Confidence ratings are more effective than RT categorization for metacognitive assessment.
- Decision time and confidence are distinct metacognitive signals.
Related Concept Videos
01:08The Availability Heuristic
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
01:24Testing a Claim about Population Proportion
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
01:14Probability in Statistics
Probability is the likelihood of an event occurring. The term event is defined as a collection of results of a procedure. An event is a simple event when an outcome cannot be divided into simpler parts.
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
01:19Interpretation of Confidence Intervals
A confidence interval is a better estimate of the population than a point estimate, as it uses a range of values from a sample instead of a single value.
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...
Confidence intervals have confidence coefficients that are crucial for their interpretation. The most common confidence coefficients are 0.90, 0.95, and 0.99, which can be written as percentages–90%, 95%, and 99%, respectively.
Suppose a person calculates a confidence interval with a confidence coefficient of 0.95. In that case, they can...
01:15Binomial Probability Distribution
A binomial distribution is a probability distribution for a procedure with a fixed number of trials, where each trial can have only two outcomes.
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
01:21Confidence Intervals
An unbiased point estimate is often insufficient to predict a population estimate, such as population mean or population proportion. In this scenario, a confidence interval is used. A confidence interval is an estimate similar to a sample proportion. However, unlike the point estimate which is a single value, the confidence interval contains a range of values. These values have lower and upper limits, known as confidence limits, and can be designated as L1 and L2, respectively.
A confidence...
A confidence...