Related Experiment Video
Updated: Jul 10, 2026

Inverse Probability of Treatment Weighting (Propensity Score) using the Military Health System Data Repository and National Death Index
Published on: January 8, 2020
Mitigating the slipping effect in polytomous scales: The Generalized Conditional Reliability Weighting (G-CRW)
1Department of Educational Sciences, Division of Measurement and Evaluation in Education, Trakya University, İsmail Hakkı Tonguç Campus, 22030, Edirne, Türkiye. afarukkilic@trakya.edu.tr.
Abstract:
Traditional unit weighting (UW) remains ubiquitous in psychological assessment due to its simplicity, yet it assumes equal item contribution and struggles with person-item response inconsistencies, commonly known as the slipping effect. This study introduces the Generalized Conditional Reliability Weighting (G-CRW) algorithm, a parsimonious scoring method for polytomous scales that conditionally incorporates item reliability into observed scores based on a person-item congruence threshold. To evaluate its psychometric performance relative to UW, a comprehensive Monte Carlo simulation (1134 conditions, 1000 replications) and an empirical application (N = 349) using three established scales (Doomscrolling, DASS-21, AAQ-II) were conducted. Simulation results demonstrated that G-CRW yields superior explained variance ratios (EVR) and internal consistency coefficients compared to UW, particularly under normal distributions and high average factor loadings ( ). Confirmatory factor analysis (CFA) fit indices (CFI, TLI, SRMR) favored G-CRW under weaker loading conditions ( ), while method performance converged under highly skewed distributions due to algorithmic functional inertia. Empirical analyses showed that G-CRW scores were highly correlated with UW scores (r > .98) and preserved very similar patterns of associations with external variables, while producing selective score changes for only a subset of respondents. G-CRW provides applied researchers with a computationally efficient, open-source tool for improving psychometric indices without the stringent assumptions of full latent-variable modeling. To ensure immediate applicability and reproducibility, the proposed algorithm is implemented in the open-source WeightMyItems (available at https://cran.r-project.org/package=WeightMyItems ) R package and the user-friendly FAfA Shiny web application (available at https://cran.r-project.org/package=FAfA ).
Related Concept Videos
Friedman Two-way Analysis of Variance by Ranks
Weighted Mean
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
Parametric Survival Analysis: Weibull and Exponential Methods
Weibull Distribution
The Weibull distribution is a flexible model used in parametric survival analysis. It can handle both increasing and decreasing hazard rates, depending on its shape parameter...
Expected Frequencies in Goodness-of-Fit Tests
One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation
On...
Confidence Coefficient

