Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Cochran's Q Test01:17

Cochran's Q Test

305
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
305
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

6.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.1K
Introduction to Nonparametric Statistics01:28

Introduction to Nonparametric Statistics

709
Nonparametric statistics offer a powerful alternative to traditional parametric methods, useful when assumptions about the population distribution cannot be made. Unlike parametric tests, which require data to follow a specific distribution with well-defined parameters (such as the mean and standard deviation), nonparametric tests do not require such constraints. This makes them particularly valuable when dealing with small sample sizes, skewed data, or ordinal and categorical variables.
One of...
709
McNemar's Test01:23

McNemar's Test

209
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...
209
Multiple Comparison Tests01:13

Multiple Comparison Tests

3.9K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.9K
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test01:09

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

1.6K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
1.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Plausible and Proper Multiple-Choice Items for Diagnostic Classification.

Psychometrika·2025
Same author

Identifiability conditions in cognitive diagnosis: Implications for Q-matrix estimation algorithms.

The British journal of mathematical and statistical psychology·2025
Same author

A Two-Step Q-Matrix Estimation Method.

Applied psychological measurement·2024
Same author

MCMC stopping rules in latent variable modelling.

The British journal of mathematical and statistical psychology·2024
Same author

Commentary on "Extending the Basic Local Independence Model to Polytomous Data" by Stefanutti, de Chiusole, Anselmi, and Spoto.

Psychometrika·2022
Same author

Advances in CD-CAT: The General Nonparametric Item Selection Method.

Psychometrika·2021
Same journal

Proficiency order invariance of MLE, MAP, EAP, and WLE in item response theory.

The British journal of mathematical and statistical psychology·2026
Same journal

Bias and precision in true-score estimation.

The British journal of mathematical and statistical psychology·2026
Same journal

Polychoric correlations under the assumption of elliptical latent traits.

The British journal of mathematical and statistical psychology·2026
Same journal

Regularized reduced rank regression for mixed predictor and response variables.

The British journal of mathematical and statistical psychology·2026
Same journal

A multiple-choice SDT model for cognitive diagnosis models.

The British journal of mathematical and statistical psychology·2026
Same journal

Modular item response and structural equation modelling via measurement and uncertainty preserving parametric modelling.

The British journal of mathematical and statistical psychology·2026
See all related articles

Related Experiment Video

Updated: Jun 25, 2025

Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

5.8K

Nonparametric CD-CAT for multiple-choice items: Item selection method and Q-optimality.

Yu Wang1, Chia-Yi Chiu2, Hans Friedrich Köhn3

  • 1University of Minnesota, Twin Cities, Minneapolis, Minnesota, USA.

The British Journal of Mathematical and Statistical Psychology
|May 25, 2024
PubMed
Summary
This summary is machine-generated.

This study introduces new methods for selecting multiple-choice (MC) items in computerized adaptive testing for cognitive diagnosis (CD-CAT). These methods improve diagnostic accuracy, especially when calibration samples are limited.

Keywords:
CD‐CATMC‐DINA modelQ‐optimalcognitive diagnosismultiple‐choice nonparametric classification methodnonparametric item selection method

More Related Videos

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.5K
A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.5K

Related Experiment Videos

Last Updated: Jun 25, 2025

Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

5.8K
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.5K
A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.5K

Area of Science:

  • Educational Measurement
  • Psychometrics
  • Cognitive Science

Background:

  • Computerized adaptive testing for cognitive diagnosis (CD-CAT) enhances estimation efficiency and accuracy through tailored item selection.
  • Existing item selection methods primarily focus on binary responses, underemphasizing multiple-choice (MC) items.
  • The Jensen-Shannon divergence (JSD) index is the sole existing method for MC items but requires large calibration samples.

Purpose of the Study:

  • To address the limitations of existing MC item selection methods in CD-CAT.
  • To propose novel item selection algorithms for MC items that are effective with limited calibration data.
  • To enhance the diagnostic accuracy and efficiency of CD-CAT using MC items.

Main Methods:

  • Proposed a nonparametric item selection method for MC items (MC-NPS) utilizing a novel discrimination power metric.
  • Developed a Q-optimal procedure for MC items to improve early-stage classification in CD-CAT.
  • Evaluated the proposed algorithms through simulation studies.

Main Results:

  • The MC-NPS method demonstrates effectiveness in item selection for MC items.
  • The Q-optimal procedure enhances classification accuracy during the initial phase of CD-CAT.
  • Simulation studies confirmed the effectiveness and efficiency of both proposed algorithms.

Conclusions:

  • The developed MC-NPS and Q-optimal procedure offer viable solutions for MC item selection in CD-CAT, particularly with small or no calibration samples.
  • These methods improve the diagnostic capabilities of CD-CAT by leveraging richer information from MC items.
  • The findings contribute to advancing the field of adaptive testing for cognitive diagnosis.