Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Hand-scoring error rates in psychological testing.

Roland Simons1, Richard Goddard, Wendy Patton

  • 1Australian Centre in Strategic Management, Queensland University of Technology, Brisbane. r.simons@qut.edu.au

Assessment
|September 10, 2002
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

4-[4-(4-Chloro-1,2,5-thia-diazol-3-yl)phen-yl]morpholine.

IUCrData·2026
Same author

Cytochrome P450-Mediated Metabolism of Antimycobacterial <i>N</i>α-Aroyl-<i>N</i>-aryl-phenylalanine Amides.

ACS infectious diseases·2026
Same author

Nucleophilic substitution of a phthalimidyl group with morpholine in an N<sup>1</sup>-methyl-1,2,3-triazole: crystallographic evidence for migration of the methylene bridge.

Acta crystallographica. Section C, Structural chemistry·2026
Same author

Ph<sub>2</sub>SCCO: A New Versatile CCO-Fragment Transfer Reagent.

Angewandte Chemie (International ed. in English)·2025
Same author

Isolation and Characterization of an Organobismuth Dihydride.

Journal of the American Chemical Society·2025
Same author

Concomitant colour polymorphs of (Z)-N-(4-fluorophenyl)-2-oxopropanehydrazonoyl chloride.

Acta crystallographica. Section C, Structural chemistry·2025
Same journal

Modeling Individual Language Patterns and Psychological Constructs to Generate AI-Augmented Data for Scalable Psychological Assessment.

Assessment·2026
Same journal

The Psychometric Properties of the Perth Emotion Regulation Competency Inventory (PERCI) in Sexual and Gender Minority Adults: Minority Stress and Resilience Correlates of Positive and Negative Emotion Regulation Difficulties.

Assessment·2026
Same journal

Future Orientation Scale: A Psychometric Evaluation Across Health-Vulnerable Samples.

Assessment·2026
Same journal

Spurious Reliability Increase?: The Number of Response Options in the Likert-Type Scale Influences Only Internal Consistency, Not Criterion Validity.

Assessment·2026
Same journal

Measuring Moral Injury Outcome and Distress in High-Risk Populations in Germany: A Validation Study.

Assessment·2026
Same journal

Establishing Psychometric Validity of the PBSS-20 for Sexual Minority College Students.

Assessment·2026
See all related articles

Psychometric test scoring errors are common and serious, even among psychologists. Complex scoring procedures increase the likelihood of these errors, highlighting a need for improved test administration guidelines.

Area of Science:

  • Psychology
  • Psychometrics
  • Test Theory

Background:

  • Test manuals often assume error-free scoring.
  • Previous research suggests scoring complexity correlates with error rates.
  • Scoring errors may be frequent and impactful in psychological practice.

Purpose of the Study:

  • To investigate the frequency and severity of scoring errors in commonly used psychometric tests.
  • To determine if scoring complexity predicts the rate of scoring errors.
  • To assess error rates for both professional (psychologist) and lay (client) scorers.

Main Methods:

  • Hand scoring of seven frequently used psychometric tests.
  • Inclusion of both psychologist and client scorers.
  • Analysis of scoring accuracy and error rates.

Related Experiment Videos

Main Results:

  • Significant and serious scoring error rates were found across all tested instruments.
  • Both psychologist and client scorers made errors.
  • Scoring complexity was a significant predictor of the base rate of scorer errors.

Conclusions:

  • Current psychometric test scoring procedures are prone to significant errors.
  • Test developers need to simplify scoring or provide better error-checking mechanisms.
  • Reducing scorer error is crucial for maintaining the validity and reliability of psychological assessments.