Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

408
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
408
Errors In Hypothesis Tests01:14

Errors In Hypothesis Tests

5.2K
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
5.2K
Detection of Gross Error: The Q Test01:00

Detection of Gross Error: The Q Test

6.6K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.6K
Cochran's Q Test01:17

Cochran's Q Test

680
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square...
680
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

4.8K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n)  to the number of categories (k).
4.8K
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

351
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
351

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The response readiness tool: An instrument to measure knowledge, skills, and attitude after taking a stop the Bleed® course.

Public health nursing (Boston, Mass.)·2024
Same author

What is your research question? A mixed methods evaluation of an academic statistical consulting center.

Evaluation and program planning·2021
Same author

Evaluation of a New Helicopter Crew Transport Fatigue Assessment.

Air medical journal·2019
Same author

Psychometric Evaluation of the Revised Current Statistics Self-efficacy (CSSE-26) in a Graduate Student Population using Rasch Analysis.

Journal of applied measurement·2018
Same author

Formative evaluation: Developing measures for online family mental health recovery education.

Evaluation and program planning·2015

Related Experiment Video

Updated: Nov 5, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

994

Evaluating the Impact of Multidimensionality on Type I and Type II Error Rates using the Q-Index Item Fit Statistic

Samantha Estrada1

  • 1Samantha Estrada, Department of Psychology and Counseling, The University of Texas at Tyler, 3900 University Blvd., Tyler, TX 75799, USA sestrada@uttyler.edu.

Journal of Applied Measurement
|May 14, 2021
PubMed
Summary

The Q-Index shows promise as an alternative fit statistic in Rasch measurement, demonstrating better sensitivity to multidimensionality than other common fit statistics.

More Related Videos

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
15:00

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

861
Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects
08:13

Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects

Published on: May 10, 2019

6.5K

Related Experiment Videos

Last Updated: Nov 5, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

994
A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
15:00

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

861
Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects
08:13

Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects

Published on: May 10, 2019

6.5K

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Statistical Modeling

Background:

  • Rasch measurement models require data to fit the model for valid application.
  • Fit statistics are crucial for assessing data-model congruence in Rasch analysis.
  • Existing fit statistics like MSQ Infit/Outfit and ZSTDs have limitations.

Purpose of the Study:

  • To evaluate the robustness and performance of the Q-Index.
  • To compare the Q-Index against MSQ Infit, MSQ Outfit, and ZSTDs.
  • To provide guidelines for applied researchers on using the Q-Index.

Main Methods:

  • Monte Carlo simulation was employed to assess fit statistics.
  • Varying conditions included test length, sample size, item difficulty, and dimensionality.
  • Type I and Type II error rates were examined for each fit index.

Main Results:

  • The Q-Index demonstrated greater sensitivity to multidimensionality compared to MSQ Infit, MSQ Outfit, and ZSTDs.
  • MSQ Infit, MSQ Outfit, and ZSTDs failed to detect simulated multidimensional conditions.
  • The Q-Index had a lower Type I error rate but a higher Type II error rate than anticipated.

Conclusions:

  • The Q-Index is a viable alternative fit statistic, particularly for detecting multidimensionality.
  • Applied researchers can consider the Q-Index for improved assessment of Rasch model fit.
  • Further research may be needed to optimize the Q-Index's Type II error performance.