Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Mechanistic Models: Compartment Models in Individual and Population Analysis01:23

Mechanistic Models: Compartment Models in Individual and Population Analysis

110
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
110
Sign Test for Median of Single Population01:20

Sign Test for Median of Single Population

199
In general, the sign test serves as a nonparametric method to test hypotheses about the median of a single population when the data does not follow a known distribution. This simplicity makes it particularly useful for small sample sizes or when the assumptions of parametric tests cannot be met. The process begins with identifying a null hypothesis, typically stating that the population median equals a specific value. The alternative hypothesis could be that the median is either not equal to,...
199
McNemar's Test01:23

McNemar's Test

507
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...
507
Sign Test for Matched Pairs01:17

Sign Test for Matched Pairs

229
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in...
229
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

6.5K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.5K
Gas Chromatography: Types of Detectors-II01:19

Gas Chromatography: Types of Detectors-II

699
In gas chromatography, different detectors are employed to meet specific analytical needs. These detectors are often categorized based on their detection mechanisms and the types of compounds they are best suited to analyze. Thermal Conductivity Detectors (TCD), Flame Ionization Detectors (FID), and Electron Capture Detectors (ECD) represent common categories, each with unique operating principles and applications. However, beyond these, several other detectors are designed for more specialized...
699

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A multiple-choice SDT model for cognitive diagnosis models.

The British journal of mathematical and statistical psychology·2026
Same author

On a Reparameterization of the MC-DINA Model.

Applied psychological measurement·2025
Same author

Fused SDT/IRT Models for Mixed-Format Exams.

Educational and psychological measurement·2024
Same author

An Item Response Model for True-False Exams Based on Signal Detection Theory.

Applied psychological measurement·2020
Same journal

The EM Algorithm and Its Variants in Cognitive Diagnostic Models: Comparing Their Propensity for Boundaries, Extremes, Convergence, and Suboptimal Solutions.

Applied psychological measurement·2026
Same journal

When Perceptions of Social Desirability Differ: Implications for the Multidimensional Nominal Response Model of Faking.

Applied psychological measurement·2026
Same journal

csemGT: An R Package for Estimating Raw-Score Conditional Standard Errors of Measurement in Generalizability Theory.

Applied psychological measurement·2026
Same journal

Confirmatory Factor Analysis with Adaptive Quadrature Estimator Using Four Link Functions.

Applied psychological measurement·2026
Same journal

Automatic Item Generation Measurement Models Respecting the Stochastic Sampling Space for Cross-Classified and Two-Level Sampling of Subjects and Incidentals.

Applied psychological measurement·2026
Same journal

Multistage Testing for Cognitive Diagnosis Based on Skill-Space Partitioning.

Applied psychological measurement·2026
See all related articles

Related Experiment Video

Updated: Oct 19, 2025

Design and Analysis for Fall Detection System Simplification
08:05

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

10.9K

A Signal Detection Model for Multiple-Choice Exams.

Lawrence T DeCarlo1

  • 1Teachers College, Columbia University, New York, NY, USA.

Applied Psychological Measurement
|September 27, 2021
PubMed
Summary
This summary is machine-generated.

A new signal detection choice model for multiple-choice exams treats correct answers as signals in noise. This model offers new ways to measure item difficulty and discrimination.

Keywords:
choice modelsgrade-of-membershipitem difficultyitem discriminationitem response theorymultiple choice examsnominal response modelsignal detection theory

More Related Videos

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
08:33

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

7.2K
A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.7K

Related Experiment Videos

Last Updated: Oct 19, 2025

Design and Analysis for Fall Detection System Simplification
08:05

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

10.9K
A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
08:33

A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences

Published on: September 4, 2019

7.2K
A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.7K

Area of Science:

  • Educational Measurement
  • Psychometrics
  • Cognitive Psychology

Background:

  • Traditional models for multiple-choice exams often lack a nuanced understanding of examinee decision-making processes.
  • Existing item response theory models may not fully capture the cognitive strategies employed by test-takers.

Purpose of the Study:

  • To develop a novel signal detection choice model for multiple-choice exams.
  • To provide a framework that integrates examinee knowledge and plausibility perceptions.
  • To derive new measures of item characteristics and alternative plausibility.

Main Methods:

  • Developed a signal detection choice model where correct alternatives are signals and incorrect ones are noise.
  • Formulated the model as a mixture extension of traditional choice models and a grade-of-membership extension.
  • Derived a simplified version using extreme value distributions, resulting in a mixture multinomial logit model.
  • Introduced measures for item discrimination, difficulty, and alternative plausibility.

Main Results:

  • The proposed model offers a unique perspective on examinee response behavior.
  • Derived measures provide insights comparable to item response theory but with a different theoretical basis.
  • Demonstrated the model's utility through an application to an educational dataset.

Conclusions:

  • The signal detection choice model provides a robust framework for analyzing multiple-choice tests.
  • The model enhances the understanding of item characteristics and examinee strategies.
  • This approach offers a valuable alternative or complement to existing psychometric models.