Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

705
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
705
Factorial Design02:01

Factorial Design

15.6K
Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
15.6K
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

8.9K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n)  to the number of categories (k).
8.9K
Goodness-of-Fit Test01:16

Goodness-of-Fit Test

9.4K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
9.4K
Receiver Operating Characteristic Plot01:15

Receiver Operating Characteristic Plot

575
A ROC (Receiver Operating Characteristic) plot is a graphical tool used to assess the performance of a binary classification model by illustrating the trade-off between sensitivity (true positive rate) and specificity (false positive rate). By plotting sensitivity against 1 - specificity across various threshold settings, the ROC curve shows how well the model distinguishes between classes, with a curve closer to the top-left corner indicating a more accurate model. The area under the ROC curve...
575
Multiple Comparison Tests01:13

Multiple Comparison Tests

4.6K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A randomised equivalence study of the EQ-5D-5L Shona versions: evaluation of measurement equivalence between digital and paper formats.

Health and quality of life outcomes·2026
Same author

Signposts on the Path From Nominal to Ordinal Scales: Moving From a Discrete to a Continuous View.

Educational and psychological measurement·2026
Same author

The InterModel Vigorish as a Lens for Understanding (and Quantifying) the Value of Item Response Models for Dichotomously Coded Items.

Psychometrika·2026
Same author

We need to understand economic inequality from children's perspectives.

Communications psychology·2026
Same author

A Beta Mixture Model for Careless Respondent Detection in Visual Analogue Scale Data.

Psychometrika·2025
Same author

Bayesian factor mixture modeling with response time for detecting careless respondents.

Behavior research methods·2025
Same journal

Bayesian Machine Learning Tools for Alcohol Use Disorder Research: The bpaup R Package.

Multivariate behavioral research·2026
Same journal

A Unified Framework for Jointly modelling Response Times and Item Position Effects in Computer-Based Learning Assessments.

Multivariate behavioral research·2026
Same journal

Generalizability Theory Applied to Daily Relationship Quality: Substantive and Statistical Directions.

Multivariate behavioral research·2026
Same journal

A Modularized Higher-Order Diagnostic Classification Model for Clustered Attribute Hierarchies.

Multivariate behavioral research·2026
Same journal

Generalizing Causal Effects to a Target Population Without Individual-Level Data from the Target Population.

Multivariate behavioral research·2026
Same journal

betaselectr: Selective (and Proper) Standardization in Structural Equation Models.

Multivariate behavioral research·2026
See all related articles

Related Experiment Video

Updated: Mar 31, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.3K

Evaluating Model Predictive Performance in Confirmatory Factor Analysis with Binary Outcomes Using the InterModel

Lijin Zhang1, Charles Rahal2, Klint Kanopka3

  • 1Graduate School of Education, Stanford University, Stanford, CA, USA.

Multivariate Behavioral Research
|March 30, 2026
PubMed
Summary
This summary is machine-generated.

Confirmatory Factor Analysis (CFA) now has a new tool, the InterModel Vigorish (IMV). This predictive fit index helps evaluate model generalizability and prevent overfitting in statistical analysis.

Keywords:
Confirmatory factor analysisbinary outcomesout-of-sample prediction

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

6.5K

Related Experiment Videos

Last Updated: Mar 31, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.3K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

1.3K
The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

6.5K

Area of Science:

  • Psychometrics
  • Statistical Modeling

Background:

  • Confirmatory Factor Analysis (CFA) is standard for assessing measurement model fit.
  • Existing fit indices may not fully capture a model's predictive accuracy or generalizability.

Purpose of the Study:

  • Introduce the InterModel Vigorish (IMV), a novel predictive fit index for CFA.
  • Evaluate the IMV's effectiveness in assessing model misspecification and generalizability, especially with binary outcomes.

Main Methods:

  • Developed the InterModel Vigorish (IMV) as a predictive fit index.
  • Extended IMV for use within the Confirmatory Factor Analysis (CFA) framework for binary outcomes.
  • Conducted four simulation studies to assess IMV's performance and generalizability.

Main Results:

  • The IMV effectively detects model misspecification at both scale and item levels.
  • IMV is insensitive to sample size variations, a key advantage over traditional indices.
  • The index discourages overfitting by prioritizing predictive accuracy and offers detailed item-level diagnostic information.

Conclusions:

  • The InterModel Vigorish (IMV) provides valuable, interpretable insights for model comparison and evaluation in CFA.
  • IMV enhances model assessment by focusing on predictive accuracy and generalizability to hold-out data.
  • An accompanying R package is available to support the practical application of IMV in research.