Jove
Visualize
Contact Us

Related Concept Videos

Goodness-of-Fit Test01:16

Goodness-of-Fit Test

4.4K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
4.4K
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

2.9K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n)  to the number of categories (k).
2.9K
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test01:09

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

2.1K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
2.1K
Residuals and Least-Squares Property01:11

Residuals and Least-Squares Property

7.9K
The vertical distance between the actual value of y and the estimated value of y. In other words, it measures the vertical distance between the actual data point and the predicted point on the line
If the observed data point lies above the line, the residual is positive, and the line underestimates the actual data value for y. If the observed data point lies below the line, the residual is negative, and the line overestimates the actual data value for y.
The process of fitting the best-fit...
7.9K
Response Surface Methodology01:16

Response Surface Methodology

308
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
308
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

718
In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
718

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Improving validity and efficiency of digital dyslexia screening through trial-by-trial feedback.

Psychological assessment·2026
Same author

Signposts on the Path From Nominal to Ordinal Scales: Moving From a Discrete to a Continuous View.

Educational and psychological measurement·2026
Same author

Evaluating Model Predictive Performance in Confirmatory Factor Analysis with Binary Outcomes Using the InterModel Vigorish.

Multivariate behavioral research·2026
Same author

Conditional Dependencies Between Response Time and Item Discrimination: An Item-Level Meta-Analysis.

Educational and psychological measurement·2026
Same author

The Propensity for Aggressive Behavior and Lifetime Incarceration Risk: A Test for Gene-environment Interaction (G×E) Using Whole-genome Data.

Aggression and violent behavior·2026
Same author

The InterModel Vigorish as a Lens for Understanding (and Quantifying) the Value of Item Response Models for Dichotomously Coded Items.

Psychometrika·2026
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Sep 30, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

931

Predictive Fit Metrics for Item Response Models.

Benjamin A Stenhaug1, Benjamin W Domingue1

  • 1The Graduate School of Education at Stanford University, Stanford, CA, USA.

Applied Psychological Measurement
|March 14, 2022
PubMed
Summary
This summary is machine-generated.

This study introduces "predictive fit" for item response models, evaluating their ability to predict new data. The best model depends on the specific prediction task, outperforming traditional methods like BIC and AIC in simulations.

Keywords:
cross-validationfititem response theorymodel comparisonprediction

More Related Videos

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.0K
A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
15:00

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

790

Related Experiment Videos

Last Updated: Sep 30, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

931
Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.0K
A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
15:00

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

790

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Statistical Modeling

Background:

  • Traditional item response model fit assesses data generation capability.
  • An alternative
  • predictive fit
  • evaluates a model's ability to predict novel data.

Purpose of the Study:

  • Advocate for
  • predictive fit
  • as a crucial metric for item response models.
  • Introduce two prediction tasks:
  • missing responses prediction
  • and
  • missing persons prediction
  • .

Main Methods:

  • Derive two predictive fit metrics based on long-run out-of-sample performance.
  • Conduct simulation studies to identify prediction-maximizing models.
  • Compare predictive fit with model selection criteria like AIC, BIC, and likelihood ratio tests.

Main Results:

  • Model selection performance varies based on the prediction task.
  • Likelihood ratio tests tend to select overly flexible models.
  • Bayesian Information Criterion (BIC) often selects overly parsimonious models.

Conclusions:

  • Predictive fit offers a valuable alternative perspective on item response model evaluation.
  • Cross-validation can be used to estimate predictive fit metrics using real-world data (e.g., PISA).
  • Findings have implications for selecting item response models in operational settings.