Related Experiment Video
Updated: Sep 29, 2026

Operant Procedures for Assessing Behavioral Flexibility in Rats
Published on: February 15, 2015
Hand-scoring error rates in psychological testing
Roland Simons1, Richard Goddard, Wendy Patton
1Australian Centre in Strategic Management, Queensland University of Technology, Brisbane. r.simons@qut.edu.au
Abstract:
Despite the comprehensive treatment of test validity in most technical manuals, test authors appear to routinely assume that clients and professionals will score their instruments without error. Recently Allard and Faust challenged this assumption by suggesting that error rates "may not be rare or benign" and demonstrated that tests with more complex scoring procedures were associated with a greater number of scoring errors. This study investigated error rates that resulted from hand scoring seven psychometric tests commonly employed in psychological practice. Significant and serious error rates were identified for both psychologist and client scorers across all tests investigated. Scoring complexity was found to predict the base rate of scorer errors. The findings suggest that greater development in and attention to test-scoring procedures is required to restrict the likelihood of scorer error.
Related Concept Videos
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
Self-Report Tests of Personality
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Reliability and Validity
Errors and Mistakes in Surveying
Errors In Hypothesis Tests