Differential item functioning detection across multiple groups
1Department of Economics and Statistics, University of Udine, Udine, Italy.
The British Journal of Mathematical and Statistical Psychology
|December 16, 2025
Summary
This study introduces a new method for detecting differential item functioning (DIF) and converting scales simultaneously. This approach improves accuracy by accounting for DIF during scale conversion, enhancing psychometric analysis.
Area of Science:
- Psychometrics
- Educational Measurement
- Item Response Theory (IRT)
Background:
- Differential item functioning (DIF) analysis requires converting item parameters to a common metric across groups.
- Simultaneous scale conversion and DIF detection are challenging due to their interdependent nature.
Purpose of the Study:
- To propose a novel method for simultaneously performing scale conversion and DIF detection.
- To develop an approach where scale conversion automatically accounts for DIF.
Main Methods:
- A novel method integrating scale conversion and DIF detection.
- Penalized likelihood estimation for automatic selection of DIF items.
- Simultaneous estimation of item parameters and scale conversion factors.
Main Results:
- The proposed method effectively integrates scale conversion and DIF detection.
- Automatic selection of DIF items using penalized likelihood estimation.
- Real-data and simulation studies demonstrate the method's good performance.
Conclusions:
- The novel simultaneous approach improves the accuracy of DIF detection and scale conversion.
- This method provides a more robust way to analyze group differences in item parameters.
- The findings have implications for fair and accurate assessment across diverse populations.
Related Concept Videos
Test for Homogeneity
2.3K
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can...
2.3K
Multiple Comparison Tests
4.4K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.4K
Identifying Statistically Significant Differences: The F-Test
3.0K
The F-test is used to compare two sample variances to each other or compare the sample variance to the population variance. It is used to decide whether an indeterminate error can explain the difference in their values. The underlying assumptions that allow the use of the F-test include the data set or sets are normally distributed, and the data sets are independent of each other. The test statistic F is calculated by dividing one variance by another. In other words, the square of one standard...
3.0K
Behrens–Fisher Test
232
The Behrens-Fisher test is a statistical method designed to address the Behrens-Fisher problem, which arises when comparing the means of two normally distributed populations with unequal variances. Unlike the Student's t-test, which assumes equal variances, the Behrens-Fisher test allows for mean comparison without this restrictive assumption. This flexibility makes it particularly valuable in scenarios where two independent samples exhibit normality but lack variance homogeneity.
This test...
This test...
232
Friedman Two-way Analysis of Variance by Ranks
467
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
467
Comparing the Survival Analysis of Two or More Groups
533
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
533


