The Standardized S-X 2 Statistic for Assessing Item Fit
Zhuangzhuang Han1, Sandip Sinharay1, Matthew S Johnson1
1Educational Testing Service, Princeton NJ, USA.
Applied Psychological Measurement
|November 25, 2022
Summary
Researchers often use the S-X^2 statistic for item fit assessment. A modified version, based on the Rao-Robson chi^2 statistic, reduces the number of items incorrectly flagged for misfit.
Area of Science:
- Psychometrics
- Statistical modeling
Background:
- The S-X^2 statistic is widely used for item fit assessment in statistical analyses.
- It faces limitations due to the Chernoff-Lehmann problem, lacking a known asymptotic null distribution.
Purpose of the Study:
- To address the limitations of the S-X^2 statistic.
- To propose a modified statistic with improved properties for item fit assessment.
Main Methods:
- Development of a modified S-X^2 statistic.
- Utilizing the modified Rao-Robson chi^2 statistic as a basis.
- Conducting simulation studies and real data analyses.
Main Results:
- The modified statistic demonstrates improved performance compared to the original S-X^2 statistic.
- Fewer items were flagged for misfit when using the modified statistic.
- The proposed method offers a more reliable approach to item fit assessment.
Conclusions:
- The modified S-X^2 statistic provides a viable alternative for item fit assessment.
- This modification helps to mitigate issues associated with the Chernoff-Lehmann problem.
- The findings support the use of the modified statistic in psychometric research and practice.
Related Concept Videos
Testing a Claim about Standard Deviation
2.5K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.5K
Test for Homogeneity
2.0K
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can...
2.0K
Goodness-of-Fit Test
3.8K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
3.8K
One-Way ANOVA: Unequal Sample Sizes
5.9K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.9K
Calculating Standard Deviation
7.6K
The standard deviation is the most common measure of variation. It is a value that tells us how far a data value is from the mean value in a dataset. Further, the standard deviation is always a positive value or zero.
The standard deviation value is small when all the data is concentrated close to the mean. Here the data exhibits low variation. The standard deviation value is larger when the data values are more spread out from the mean. Here, the data displays high...
The standard deviation value is small when all the data is concentrated close to the mean. Here the data exhibits low variation. The standard deviation value is larger when the data values are more spread out from the mean. Here, the data displays high...
7.6K
Chi-square Distribution
4.5K
How does one determine if bingo numbers are evenly distributed or if some numbers occurred with a greater frequency? Or if the types of movies people preferred were different across different age groups or if a coffee machine dispensed approximately the same amount of coffee each time. These questions can be addressed by conducting a hypothesis test. One distribution that can be used to find answers to such questions is known as the chi-square distribution. The chi-square distribution has...
4.5K


