Dynamic Fit Index Cutoffs for Time Series Network Models.
Siwei Liu1, Christopher M Crawford2, Zachary F Fisher2
1Human Ecology, University of California, Davis, Davis, CA, USA.
Multivariate Behavioral Research
|October 1, 2025
Summary
This study adapts the dynamic fit index (DFI) for time series analysis, offering tailored cutoffs for network models. New methods, DFI_A and DFI_B, improve detection of model misspecification, especially with small sample sizes.
Area of Science:
- Statistics
- Psychometrics
- Network Analysis
Background:
- The dynamic fit index (DFI) is a simulation-based method for determining model fit index cutoffs.
- Existing methods may not adequately detect model misspecification in time series network models.
Purpose of the Study:
- Extend the dynamic fit index (DFI) to time series analysis.
- Develop improved methods for deriving fit index cutoffs to detect omitted paths in time series network models.
- Address limitations of the original DFI with small effect or sample sizes.
Main Methods:
- Simulation studies to evaluate DFI cutoffs for time series network models.
- Comparison of DFI cutoffs with established benchmarks (Hu & Bentler).
- Development and evaluation of two alternative DFI approaches (DFI_A and DFI_B) using lenient criteria.
Main Results:
- DFI cutoffs for detecting omitted paths in time series networks are closer to exact fit than traditional benchmarks.
- Cutoff values are influenced by the number of variables, network density, time points, and misspecification type.
- Original DFI fails to identify cutoffs for omitted paths under small effect or sample sizes with strict error rate limits.
- DFI_A and DFI_B provide viable alternatives for deriving cutoffs under more lenient criteria.
Conclusions:
- The extended DFI provides more accurate fit index cutoffs for time series network models.
- DFI_A and DFI_B offer practical solutions for detecting model misspecification, particularly in challenging data conditions.
- These methods enhance the reliability of model evaluation in time series network analysis.
Related Concept Videos
Expected Frequencies in Goodness-of-Fit Tests
7.2K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
7.2K
Prediction Intervals
3.3K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
3.3K
Goodness-of-Fit Test
8.1K
The goodness-of-fit test is a type of hypothesis test which determines whether the data "fits" a particular distribution. For example, one may suspect that some anonymous data may fit a binomial distribution. A chi-square test (meaning the distribution for the hypothesis test is chi-square) can be used to determine if there is a fit. The null and alternative hypotheses may be written in sentences or stated as equations or inequalities. The test statistic for a goodness-of-fit test is given as...
8.1K
Friedman Two-way Analysis of Variance by Ranks
480
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
480
Quantifying and Rejecting Outliers: The Grubbs Test
3.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
3.5K
Choosing Between z and t Distribution
3.5K
The z and the Student t distribution estimate the population mean using the sample mean and standard deviation. However, to decide which distribution to use for a calculation, one needs to determine the sample size, the nature of the distribution, and whether the population standard deviation is known. If the population standard deviation is known and the population is normally distributed, or if the sample size is greater than 30, the z distribution is preferred. The Student t distribution is...
3.5K


