An Investigation of Interrater Reliability for the Rorschach Performance Assessment System (R-PAS) in a Nonpatient...

Area of Science:

• Psychological assessment
• Psychometrics
• Clinical psychology

Background:

• The Rorschach Inkblot Method (RIM) requires standardized administration and coding for reliable interpretation.
• The Rorschach Performance Assessment System (R-PAS) was developed to enhance the empirical basis of RIM.
• Assessing interrater reliability is crucial for the consistency of R-PAS coding.

Purpose of the Study:

• To investigate the interrater reliability of the Rorschach Performance Assessment System (R-PAS) coding.
• To evaluate the concordance rates among different assessors for various R-PAS variables.

Main Methods:

• Data were collected from a nonpatient convenience sample of 50 participants.
• Blind recoding of R-PAS protocols was performed.
• SPSS was used to analyze discrepancies, calculating percent agreement and intraclass correlation coefficients.

Main Results:

• Interrater agreement varied by coding complexity, with higher agreement for simpler codes (e.g., Location) and lower agreement for complex codes (e.g., Cognitive, Thematic).
• Overall concordance rates between coders were found to be good to excellent.
• Analysis included variables such as Location, Space, Contents, Synthesis, Determinants, and others.

Conclusions:

• The R-PAS demonstrates high interrater reliability, supporting its validity as an evidence-based system.
• The findings suggest R-PAS is a reliable method for administering, coding, and interpreting the Rorschach Inkblot Method.
• The study reinforces the empirical foundation of R-PAS in psychological assessment.