Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Metacognition01:26

Metacognition

1.1K
Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...
1.1K
Cochran's Q Test01:17

Cochran's Q Test

1.2K
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
1.2K
Surveys02:16

Surveys

17.3K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
17.3K
Retrieval01:12

Retrieval

567
Retrieval is the process of getting information out of memory storage and back into conscious awareness. This ability is essential for daily tasks like brushing hair and teeth, driving to work, and performing job duties. Retrieval occurs in three ways: recall, recognition, and relearning.
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
567
Multiple Comparison Tests01:13

Multiple Comparison Tests

4.7K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.7K
Critical Thinking II01:25

Critical Thinking II

5.3K
Critical thinking is a cognitive process with several attributes. The attributes of critical thinking include the following:
5.3K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Reconsideration of the type I error rate for psychological science in the era of replication.

Psychological methods·2022
Same author

Statistical Decision-Making Accuracies for Some Overlap- and Distance-based Measures for Single-Case Experimental Designs.

Perspectives on behavior science·2022
Same author

Looking behind: Turning cards in the selection task.

Quarterly journal of experimental psychology (2006)·2021
Same author

Development of a Distance-Based Effect Size Metric for Single-Case Research: Ratio of Distances.

Behavior therapy·2018
Same author

John A. Swets (1928-2016).

The American psychologist·2017
Same author

Are Social Scientists Harder on Their Colleagues Than Physical Scientists Were on Theirs in the Past? Commentary on Trafimow & Rice (2009).

Perspectives on psychological science : a journal of the Association for Psychological Science·2015
Same journal

Configurational antecedents of employee green behavior: A mixed methods study.

Journal of experimental psychology. Applied·2026
Same journal

The effects of counterfactual thinking on unilateral forgiveness: Can victims do it on their own?

Journal of experimental psychology. Applied·2026
Same journal

Gray swan neglect: Do forecasters account for low(ish) probability events?

Journal of experimental psychology. Applied·2026
Same journal

An inductive learning intervention to improve news veracity discernment.

Journal of experimental psychology. Applied·2026
Same journal

Forgetting and blame: When cognitive lapses excuse and when they backfire.

Journal of experimental psychology. Applied·2026
Same journal

Predecisional distortion of risk information seen in icon arrays.

Journal of experimental psychology. Applied·2026
See all related articles

Related Experiment Video

Updated: Apr 18, 2026

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.5K

Knowledge assessment: Squeezing information from multiple-choice testing.

Raymond S Nickerson1, Susan F Butler1, Michael T Carlin2

  • 1Department of Psychology, Tufts University.

Journal of Experimental Psychology. Applied
|February 3, 2015
PubMed
Summary
This summary is machine-generated.

This study introduces a novel multiple-choice testing method that measures both knowledge and confidence. It makes guessing detrimental, providing administrators with better insights into learner understanding and instructional effectiveness.

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.4K

Related Experiment Videos

Last Updated: Apr 18, 2026

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.5K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.4K

Area of Science:

  • Educational Psychology
  • Psychometrics

Background:

  • Traditional testing methods often fail to accurately assess an individual's true knowledge.
  • Distinguishing between partial knowledge and guessing remains a challenge in standard assessments.

Purpose of the Study:

  • To present a new procedure for administering and scoring multiple-choice tests.
  • To enable test takers to convey confidence levels for each answer choice.
  • To develop assessment methods that benefit both test administrators and test takers.

Main Methods:

  • Developed a multiple-choice test administration and scoring procedure.
  • Incorporated a confidence rating for each alternative answer.
  • Collected experimental data to validate the effectiveness of the proposed method.

Main Results:

  • The proposed method allows for the derivation of measures for both knowledge and confidence.
  • Experimental data demonstrate the effectiveness of this approach.
  • The procedure makes guessing unnecessary and actively detrimental to the score.

Conclusions:

  • This method provides more accurate estimates of knowledge than traditional systems.
  • It offers improved evaluation of individual knowledge and instructional effectiveness.
  • The assessment of partial knowledge is enhanced, leading to better educational insights.