Related Experiment Video
Updated: Jul 8, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Measures of metacognitive efficiency across cognitive models of decision confidence
Manuel Rausch1, Sebastian Hellmann1, Michael Zehetleitner1
1Catholic University of Eichstatt-Ingolstadt.
Abstract:
Meta-d'/d' has become the quasi-gold standard to quantify metacognitive efficiency because meta-d'/d' was developed to control for discrimination performance, discrimination criteria, and confidence criteria even without the assumption of a specific generative model underlying confidence judgments. Using simulations, we demonstrate that meta-d'/d' is not free from assumptions about confidence models: Only when we simulated data using a generative model of confidence according to which the evidence underlying confidence judgments is sampled independently from the evidence utilized in the choice process from a truncated Gaussian distribution, meta-d'/d' was unaffected by discrimination performance, discrimination task criteria, and confidence criteria. According to five alternative generative models of confidence, there exist at least some combination of parameters where meta-d'/d' is affected by discrimination performance, discrimination criteria, and confidence criteria. A simulation using empirically fitted parameter sets showed that the magnitude of the correlation between meta-d'/d' and discrimination performance, discrimination task criteria, and confidence criteria depends heavily on the generative model and the specific parameter set and varies between negligibly small and very large. These simulations imply that a difference in meta-d'/d' between conditions does not necessarily reflect a difference in metacognitive efficiency but might as well be caused by a difference in discrimination performance, discrimination task criterion, or confidence criteria. (PsycInfo Database Record (c) 2026 APA, all rights reserved).
More Related Videos
05:48The Adventures of Fundi Intervention Based on the Cognitive and Emotional Processing in Attention Deficit Hyperactive Disorder Patients
Published on: June 12, 2020
12:55Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
Related Concept Videos
Metacognition
Decision Making
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Confidence Coefficient
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...