Related Experiment Video
Updated: Jun 17, 2026

The Resident-intruder Paradigm: A Standardized Test for Aggression, Violence and Social Stress
Published on: July 4, 2013
The interrater reliability of Elizur's hostility systems and Holt's aggression variables: a meta-analytical review
Nicholas J Katko1, Gregory J Meyer, Joni L Mihura
1Department of Psychology, University of Toledo, Toledo, Ohio 43606-3390, USA. nkatko@UTNet.UToledo.Edu
Abstract:
We provide a meta-analytic review of interrater reliability for scoring the 2 most commonly studied Rorschach (2003) aggression measures: (a) The Elizur (1949) Hostility Scale and its main derivative scoring systems (Holtzman, Thorpe, Swartz, & Herron, 1961; Murstein, 1956) and (b) Holt's (1977, 2005) aggression variables. Substantial reliability was observed for both Elizur's hostility score (e.g., weighted mean summary score correlation = .91, N = 1,279) and Holt's aggression variables (e.g., weighted mean summary score correlation = .84, N = 226). These meta-analytic data suggest that like the contemporary variables included in Exner's Comprehensive System or Gacono and Meloy's (1994) extended aggression scores, the historically important Elizur scoring systems and Holt aggression variables can be scored reliably. [Supplementary materials are available for this article. Go to the publisher's online edition of the Journal of Personality Assessment for the following free supplemental resources: a document of results examining publication source, scoring system, amount of rater training, and severity of aggressive pathology in the sample as potential moderators of reliability.]
Related Concept Videos
Stereotype Content Model
Stereotypes, Prejudice, and Discrimination
Aggression
Self-Report Tests of Personality
Personality Theory by Eysenck and Eysenck
In the extroversion/introversion dimension, highly extroverted people are sociable, outgoing, and easily connect with others. In contrast,...
Robbers Cave
