An inter-rater reliability study for the rorschach performance assessment system

Based on available research findings, the Rorschach performance assessment system (Meyer, Viglione, Mihura, Erard, & Erdberg, 2011 ) was recently developed in an attempt to ground the administration, coding, and interpretation of the Rorschach in its evidence base, improve its normative foundation, integrate international findings, reduce examiner variability, and increase utility. This study sought to establish inter-rater reliability for the coding decisions in this new system. We randomly selected 50 Rorschach records from ongoing research projects using R-Optimized administration. The records were administered by 16 examiners and came from a diverse sample in terms of age, sex, ethnicity, educational background, and patient status. Results demonstrated a mean intraclass correlation of .88 and median of .92. Overall, the findings indicate good to excellent inter-rater reliability for the great majority of codes and are consistent with previous findings of strong inter-rater reliability for alternative Rorschach systems and scores.