Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Hindsight Biases01:12

Hindsight Biases

3.5K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now? 
3.5K
Metacognition01:26

Metacognition

236
Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...
236
Fundamental Attribution Error01:14

Fundamental Attribution Error

12.9K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
12.9K
Cognitive Learning01:21

Cognitive Learning

459
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
459
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

4.1K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.1K
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

233
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
233

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Molecular basis of UV lesion binding and repair inhibition by ETS-family transcription factors.

bioRxiv : the preprint server for biology·2026
Same author

Binding of Tetrapentylammonium to a c-MYC G-quadruplex Depicted through NMR and Volumetric Assessment.

Chemistry (Weinheim an der Bergstrasse, Germany)·2025
Same author

Evaluation of weighted Voronoi decompositions of physicochemical ensembles.

Physical chemistry chemical physics : PCCP·2025
Same author

Coupled Heterogeneity to Dimeric Site-Specific Binding by the POU-Family Transcription Factor OCT2.

The journal of physical chemistry. B·2025
Same author

One hundred thirty-four germ line PU.1 variants and the agammaglobulinemic patients carrying them.

Blood·2025
Same author

G-Quadruplex Recognition by Tetraalkylammonium Ions: A New Paradigm for Discrimination between Parallel and Antiparallel G-Quadruplexes.

The journal of physical chemistry. B·2024
Same journal

Item and Test Characteristic Curves of Rank-2PL Models for Multidimensional Forced-Choice Questionnaires.

Applied measurement in education·2025
See all related articles

Related Experiment Video

Updated: Jul 29, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.0K

Dissecting knowledge, guessing, and blunder in multiple choice assessments.

Rashid M Abu-Ghazalah1, David N Dubins2, Gregory M K Poon3

  • 1W. Booth School of Engineering Practice and Technology, Faculty of Engineering, McMaster University, Hamilton, Ontario, Canada.

Applied Measurement in Education
|May 24, 2023
PubMed
Summary
This summary is machine-generated.

This study introduces a new method to accurately assess student knowledge in multiple-choice tests by accounting for guessing and confident errors. Incorporating self-ranked confidence improves the objective evaluation of examinee knowledge.

Keywords:
Bayesian analysisMultiple choiceconfidenceguessingknowledgeprobabilistic modeling

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

831
A Real-world What-Where-When Memory Test
09:13

A Real-world What-Where-When Memory Test

Published on: May 16, 2017

11.4K

Related Experiment Videos

Last Updated: Jul 29, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.0K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

831
A Real-world What-Where-When Memory Test
09:13

A Real-world What-Where-When Memory Test

Published on: May 16, 2017

11.4K

Area of Science:

  • Educational Measurement
  • Psychometrics
  • Biotechnology Education

Background:

  • Multiple-choice (MC) tests yield probabilistic results influenced by knowledge, guessing, and errors (blunder).
  • Existing methods for knowledge estimation are sensitive to prior beliefs, limiting objectivity.
  • Accurate assessment requires differentiating true knowledge from response artifacts.

Purpose of the Study:

  • To develop and evaluate probabilistic models that explicitly separate knowledge, guessing, and blunder in MC test responses.
  • To investigate the utility of self-ranked confidence as a proxy for examinee knowledge.
  • To establish evidence-based pass marks for objective knowledge qualification.

Main Methods:

  • Evaluated probabilistic models incorporating knowledge, guessing, and blunder using Bayesian implementation.
  • Utilized eight assessments (>9,000 responses) from an undergraduate biotechnology curriculum.
  • Incorporated self-ranked confidence levels as a key indicator alongside test scores.

Main Results:

  • Knowledge estimators showed high sensitivity to prior beliefs when using scores alone.
  • Three confidence levels effectively resolved test performance, indicating partial knowledge in less confident responses.
  • Confident responses were associated with a higher rate of blunder, balancing partial knowledge findings.

Conclusions:

  • Self-ranked confidence provides a robust proxy for knowledge, overcoming limitations of score-based estimation.
  • The developed models offer practical utility in test analysis and design by quantifying guessing and blunder.
  • This approach enables the statistical qualification of desired examinee knowledge levels through evidence-based pass marks.