Related Experiment Video
Updated: Oct 3, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
A Comparative Study on the Detection Efficacy of CUSUM and CPA in Multidimensional Tests
Xinyu Liu1, Yinhong He1, Yuxing Zhang1
1School of Mathematics and Statistics, Nanjing University of Information Science and Technology, Nanjing, China.
Abstract:
Cumulative summation (CUSUM) and change point analysis (CPA) procedures are the two most widely used methods for flagging aberrant item responses, yet their relative merits have been examined almost exclusively in unidimensional settings. This study evaluated five person-fit statistics (PFSs) that have demonstrated strong detection power in earlier research: the CUSUM-based ( ), and the CPA-based ( ), in multidimensional testing scenarios. In addition, the Wald statistic was derived to a new form for multidimensional tests, which is much different from the unidimensional version. Both a simulation experiment and a case study were conducted to assess the performance of these PFSs in detecting back random response (BRR). Results showed that inter-dimensional ability correlation influenced detection rates, and this effect diminished as test length increased. Across all conditions, the newly proposed statistic achieved higher average detection efficiency than its competitors and exhibited the greatest stability.
Related Concept Videos
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
McNemar's Test
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Kendall's Tau Test
A τ value of +1 indicates that...
Correlations
Receiver Operating Characteristic Plot

