Score-based tests of measurement invariance: use in practice
Ting Wang1, Edgar C Merkle1, Achim Zeileis2
1Department of Psychological Sciences, University of Missouri Columbia, MO, USA.
Frontiers in Psychology
|June 18, 2014
Summary
This study introduces new measurement invariance tests applicable to continuous or ordinal variables without needing pre-defined subgroups. These score-based tests help researchers identify specific parameter violations in structural equation models.
Area of Science:
- Psychometrics
- Statistical Modeling
- Quantitative Psychology
Background:
- Measurement invariance is crucial for comparing latent constructs across groups or conditions.
- Existing methods often require pre-specified subgroups, limiting flexibility.
- Score-based tests offer a powerful alternative for assessing measurement invariance.
Purpose of the Study:
- To introduce and explain a family of score-based measurement invariance tests.
- To demonstrate their utility with continuous and ordinal auxiliary variables.
- To guide researchers on applying these tests and interpreting results for model parameter violations.
Main Methods:
- Utilizing a family of score-based measurement invariance tests.
- Applying tests to continuous auxiliary variables without subgroup pre-specification.
- Adapting tests for ordinal auxiliary variables, sensitive to monotonic violations.
- Illustrating applications using R packages (lavaan, strucchange).
- Conducting novel simulations to evaluate practical performance.
Main Results:
- The score-based tests effectively assess measurement invariance with continuous auxiliary variables.
- Tests adapted for ordinal variables show sensitivity to monotonic invariance violations.
- Simulations confirm the practical utility and accuracy of the tests in identifying parameter violations.
- The R packages provide accessible tools for implementing these analyses.
Conclusions:
- This paper equips researchers with practical tools and knowledge for applying advanced measurement invariance tests.
- The score-based approach offers flexibility for continuous and ordinal auxiliary variables.
- These methods enhance the rigor of cross-group or cross-condition comparisons in various research fields.
Related Concept Videos
Measures of Intelligence
12.7K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
12.7K
One-Way ANOVA: Equal Sample Sizes
3.2K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.2K
One-Way ANOVA: Unequal Sample Sizes
5.8K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.8K
Friedman Two-way Analysis of Variance by Ranks
594
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
594
Ordinal Level of Measurement
24.1K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
24.1K
Test for Homogeneity
1.7K
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can...
1.7K


