Examining classification criteria: a comparison of three cut score methods

This study compared 3 different methods of creating cut scores for a screening instrument, T scores, receiver operating characteristic curve (ROC) analysis, and the Rasch rating scale method (RSM), for use with the Behavioral and Emotional Screening System (BESS) Teacher Rating Scale for Children and Adolescents (Kamphaus & Reynolds, 2007). Using the BESS norm data set, we compared the methods across 7 classification indices. Additional information about accuracy was used with a subset of children who had been given a prior diagnosis for selected disorders. The results showed that the methods were generally in concordance, with similarities identified across methods. RSM and ROC analysis methods performed similarly, with both methods identifying the same optimal cut-point. The method based on T scores appeared to be more conservative, identifying a lower cut score as optimal.