Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

296
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
296
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

2.6K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n)  to the number of categories (k).
2.6K
Goodness-of-Fit Test01:16

Goodness-of-Fit Test

4.0K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
4.0K
Two-Way ANOVA01:17

Two-Way ANOVA

2.8K
The two-way ANOVA is an extension of the one-way ANOVA. It is a statistical test performed on three or more samples categorized by two factors - a row factor and a column factor. Ronald Fischer mentioned it in 1925 in his book 'Statistical Methods for Researchers.'
The two-way ANOVA analysis initially begins by stating the null hypothesis that there is an interaction effect between the two factors of a dataset. This effect can be visualized using line segments formed by joining the...
2.8K
Wilcoxon Rank-Sum Test01:21

Wilcoxon Rank-Sum Test

342
The Wilcoxon rank-sum test, also known as the Mann-Whitney U test, is a nonparametric test used to determine if there is a significant difference between the distributions of two independent samples. This test is designed specifically for two independent populations and has the following key requirements:
342
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test01:09

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

1.8K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
1.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A Genetic Algorithm for Automated Assembly of Linear Multidimensional Forced-Choice Questionnaires.

Psychometrika·2026
Same author

Can the Generalized Graded Unfolding Model Fit Dominance Responses?

Applied psychological measurement·2025
Same author

Multidimensional Generalized Partial Preference Model for Forced-Choice Items.

Psychometrika·2025
Same author

Information Functions of Rank-2PL Models for Forced-Choice Questionnaires.

Journal of educational measurement·2025
Same author

The Rank-2PL IRT Models for Forced-Choice Questionnaires: Maximum Marginal Likelihood Estimation with an EM Algorithm.

Journal of educational and behavioral statistics : a quarterly publication sponsored by the American Educational Research Association and the American Statistical Association·2025
Same author

From Likert to Forced Choice: Statement Parameter Invariance and Context Effects in Personality Assessment.

Measurement : interdisciplinary research and perspectives·2025
Same journal

Dissecting knowledge, guessing, and blunder in multiple choice assessments.

Applied measurement in education·2023
See all related articles

Related Experiment Video

Updated: Sep 9, 2025

A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

11.0K

Item and Test Characteristic Curves of Rank-2PL Models for Multidimensional Forced-Choice Questionnaires.

Jianbin Fu1, Xuan Tan1, Patrick C Kyllonen1

  • 1Educational Testing Service.

Applied Measurement in Education
|August 29, 2025
PubMed
Summary
This summary is machine-generated.

A new method creates one-dimensional expected item and test characteristic curves for multidimensional forced-choice questionnaires using Rank-2PL models. These characteristic curves help identify misfit trait scores in item response theory analysis.

Keywords:
Rank-2PL modelsforced-choice questionnaireitem characteristic curveitem response theorytest characteristic curve

More Related Videos

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.6K
A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
15:00

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

761

Related Experiment Videos

Last Updated: Sep 9, 2025

A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

11.0K
A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.6K
A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
15:00

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

761

Area of Science:

  • Psychometrics
  • Item Response Theory (IRT)
  • Statistical Modeling

Background:

  • Multidimensional forced-choice questionnaires are widely used in psychological and educational assessments.
  • Analyzing these complex data structures requires advanced item response theory (IRT) models.
  • Existing methods may not fully capture the nuances of trait measurement in forced-choice formats.

Purpose of the Study:

  • To propose a novel process for generating one-dimensional expected item characteristic curves (ICCs) and test characteristic curves (TCCs).
  • To apply this process to multidimensional forced-choice questionnaires utilizing Rank-2PL IRT models.
  • To demonstrate the utility of ICCs and TCCs in identifying trait score misfits at item and test levels.

Main Methods:

  • Development of a process based on Rank-2PL IRT models for analyzing forced-choice items with two or three statements.
  • Generation of one-dimensional expected ICCs and TCCs for individual traits within the multidimensional framework.
  • Application and visualization of ICC and TCC plots using data from real-world pair and triplet forms.

Main Results:

  • The proposed process successfully generates one-dimensional ICCs and TCCs for each trait.
  • Visualizations of ICC and TCC plots from real data demonstrated their effectiveness in identifying misfit trait scores.
  • An extension is proposed for TCC plots by converting negative statements to positive ones for enhanced interpretability.

Conclusions:

  • The developed method provides a valuable tool for analyzing multidimensional forced-choice data within an IRT framework.
  • Generated ICCs and TCCs are effective for diagnosing item and test level misfit, improving measurement accuracy.
  • The proposed modifications to TCC plots offer potential for more refined data diagnostics.