Rater-Reliability of Assessing Driving Errors with a DriveSafety 250 Simulator

This study aimed to establish inter-rater reliability among three raters while training new driver rehabilitation specialists to correctly identify driving errors on a DriveSafety 250 driving simulator. Five participants completed adaptation, residential and suburban, and city and highway scenarios. Intraclass correlation coefficients indicated scores between .623-.877 (p = .003-.122) for the total driving errors recorded in the two scenario drives with rater agreement initially ranging between 7-8%. When analyzing the data for types of driving errors, the intraclass correlation coefficients ranged from .556-.973 (p < .05) and rater agreement between 15-100%. Through proper training and strategy development, raters reached 100% consensus on all aspects of inter-rater reliability while assessing driving errors.