dynamic : An R Package for Deriving Dynamic Fit Index Cutoffs for Factor Analysis.
Melissa G Wolf1, Daniel McNeish2
1Gevirtz Graduate School of Education, University of California Santa Barbara.
Multivariate Behavioral Research
|February 14, 2023
Summary
This study introduces the R package "dynamic" to create customized model fit cutoffs for confirmatory factor analysis. This improves accuracy by tailoring benchmarks to specific model characteristics, overcoming limitations of fixed values.
Area of Science:
- Psychometrics
- Statistical Modeling
- Quantitative Psychology
Background:
- Confirmatory factor analysis (CFA) model fit is often assessed using indices like SRMR, RMSEA, and CFI.
- Current benchmarks (e.g., SRMR=.08, RMSEA=.06, CFI=.96) by Hu and Bentler are widely used but have limitations.
- Fixed benchmarks are sensitive to model characteristics and may not accurately reflect model fit across different models.
Purpose of the Study:
- To address the limitations of fixed fit index cutoffs in confirmatory factor analysis.
- To provide empirical researchers with an accessible method for calculating dynamic, model-specific fit index cutoffs.
- To improve the accuracy and sensitivity of model fit evaluations in structural equation modeling.
Main Methods:
- Introduction of the R package "dynamic" for automating the computation of dynamic fit index cutoffs.
- The package utilizes custom Monte Carlo simulations tailored to the user's specific model characteristics.
- Requires only a lavaan object as input, simplifying the process for researchers without advanced statistical training.
Main Results:
- The "dynamic" R package successfully automates the generation of customized fit index cutoffs.
- These dynamic cutoffs are designed to be more sensitive to model misfit compared to fixed benchmarks.
- The package democratizes access to advanced psychometric methods for a broader range of empirical researchers.
Conclusions:
- Dynamic fit index cutoffs offer a more accurate and tailored approach to evaluating CFA model fit.
- The "dynamic" R package significantly lowers the technical barrier for implementing these improved evaluation methods.
- Adoption of dynamic cutoffs can lead to more reliable assessments of model adequacy in empirical research.
Related Concept Videos
Expected Frequencies in Goodness-of-Fit Tests
2.6K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
2.6K
Friedman Two-way Analysis of Variance by Ranks
269
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
269
Goodness-of-Fit Test
3.7K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
3.7K
Quantifying and Rejecting Outliers: The Grubbs Test
1.8K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.8K
Identifying Statistically Significant Differences: The F-Test
1.7K
The F-test is used to compare two sample variances to each other or compare the sample variance to the population variance. It is used to decide whether an indeterminate error can explain the difference in their values. The underlying assumptions that allow the use of the F-test include the data set or sets are normally distributed, and the data sets are independent of each other. The test statistic F is calculated by dividing one variance by another. In other words, the square of one standard...
1.7K
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
1.7K
In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
1.7K


