Related Experiment Video
Updated: Oct 17, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
Homogeneity-Pursuit Calibration of Item Response Theory Models with Limited Samples and Sparse Response Data
Shiyu Wang1, Cong Cheng2, Yuan Ke2
1Department of Educational Psychology, University of Georgia, Athens, GA, USA.
Abstract:
Calibrating item response theory models is challenging when item banks are large relative to available sample sizes and response data are sparsely observed, as commonly occurs in classroom assessment, low-stakes testing, and early-stage item bank development. These challenges are particularly pronounced for the two-parameter logistic model, where unconstrained estimation often yields unstable or extreme item parameter estimates. To address this problem, we propose a new calibration framework based on homogeneity pursuit (HP), which stabilizes estimation by adaptively pooling information across items with similar psychometric properties. Rather than aiming to recover exact latent groupings, HP reduces effective model complexity through data-driven equality constraints, improving finite-sample estimation accuracy. We develop two variants of the proposed framework-HP-Scott and HP-Silhouette-that differ in the criteria used to guide adaptive pooling. Three simulation studies evaluate the performance of HP under idealized and realistic item-bank settings, including continuous parameter variation, small sample sizes, and high missing-response rates. Across these conditions, HP consistently reduces estimation error and mitigates extreme parameter estimates compared with baseline approaches. A real classroom assessment application with over 60% missing responses further demonstrates that HP produces more plausible item parameter estimates and superior model fit.
Related Concept Videos
Mechanistic Models: Compartment Models in Individual and Population Analysis
Calibration Curves: Linear Least Squares
For data that follow a straight line, the standard method for fitting is the linear...
Response Surface Methodology
The process of RSM involves several key steps:
Test for Homogeneity
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Friedman Two-way Analysis of Variance by Ranks
